Title: fix(csv): stream import rows to fix OOM on large files (fixes #52) · dfa1/vortex-java@d5280ae · GitHub
Open Graph Title: fix(csv): stream import rows to fix OOM on large files (fixes #52) · dfa1/vortex-java@d5280ae
X Title: fix(csv): stream import rows to fix OOM on large files (fixes #52) · dfa1/vortex-java@d5280ae
Description: Vortex columnar format, in pure Java (zero-copy, FFM, no JNI, no Unsafe) - fix(csv): stream import rows to fix OOM on large files (fixes #52) · dfa1/vortex-java@d5280ae
Open Graph Description: Replace readAllRows (full List<String[]> in heap) with two-pass streaming: - Pass 1: infer schema by streaming the file with O(1) memory - Pass 2: write in chunks of chunkSize without bufferi...
X Description: Replace readAllRows (full List<String[]> in heap) with two-pass streaming: - Pass 1: infer schema by streaming the file with O(1) memory - Pass 2: write in chunks of chunkSize without...
Opengraph URL: /dfa1/vortex-java/commit/d5280ae2f8b55de3a8a80a6b766f11ce020bbebb
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository/commit/:name(/*path) |
| route-controller | commit |
| route-action | show |
| fetch-nonce | v2:878c2e97-77db-2dd0-3225-99052d8cee60 |
| current-catalog-service-hash | f3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb |
| request-id | E5D8:BF556:BC649:FFB2F:6A4D2A3A |
| html-safe-nonce | e9e9187412e173d05fe531f78bd297b4b0cbb15e9784ec08f65dbc99c15f692b |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFNUQ4OkJGNTU2OkJDNjQ5OkZGQjJGOjZBNEQyQTNBIiwidmlzaXRvcl9pZCI6IjExNDM0MzYwNDk2NDIyMzY0NzQiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 83cbebb6a09cefee138691941ae0093fd5d0e8c898223c5d17cd33d04dce4a50 |
| hovercard-subject-tag | repository:1249412947 |
| github-keyboard-shortcuts | repository,commits,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/dfa1/vortex-java/commit/d5280ae2 |
| twitter:image | https://opengraph.githubassets.com/5b6732b9ad205e6b603686cd5ceb516620b914a8bb1f989df4dbd591f7379d2c/dfa1/vortex-java/commit/d5280ae2f8b55de3a8a80a6b766f11ce020bbebb |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/5b6732b9ad205e6b603686cd5ceb516620b914a8bb1f989df4dbd591f7379d2c/dfa1/vortex-java/commit/d5280ae2f8b55de3a8a80a6b766f11ce020bbebb |
| og:image:alt | Replace readAllRows (full List<String[]> in heap) with two-pass streaming: - Pass 1: infer schema by streaming the file with O(1) memory - Pass 2: write in chunks of chunkSize without bufferi... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:updated_time | 1781763276 |
| hostname | github.com |
| expected-hostname | github.com |
| None | 92571a8944142227b7e19cd10918b1ddd06e5066c1ad5bc7e4769cf6140a87e6 |
| turbo-cache-control | no-cache |
| go-import | github.com/dfa1/vortex-java git https://github.com/dfa1/vortex-java.git |
| octolytics-dimension-user_id | 5798698 |
| octolytics-dimension-user_login | dfa1 |
| octolytics-dimension-repository_id | 1249412947 |
| octolytics-dimension-repository_nwo | dfa1/vortex-java |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 1249412947 |
| octolytics-dimension-repository_network_root_nwo | dfa1/vortex-java |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 93f17a978ee60bc4668e1d7b90e6bd2d622261fd |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width