Title: decide if we want to support Pandas StringArray and ArrowStringArray internally · Issue #1181 · larray-project/larray · GitHub
Open Graph Title: decide if we want to support Pandas StringArray and ArrowStringArray internally · Issue #1181 · larray-project/larray
X Title: decide if we want to support Pandas StringArray and ArrowStringArray internally · Issue #1181 · larray-project/larray
Description: in 0.35.1, I fixed the issues converting Pandas Series and DataFrames which use those types internally (by using .to_numpy() instead of .values). However, this often yields object arrays and prevents zero-copy for string types, which is ...
Open Graph Description: in 0.35.1, I fixed the issues converting Pandas Series and DataFrames which use those types internally (by using .to_numpy() instead of .values). However, this often yields object arrays and preven...
X Description: in 0.35.1, I fixed the issues converting Pandas Series and DataFrames which use those types internally (by using .to_numpy() instead of .values). However, this often yields object arrays and preven...
Opengraph URL: https://github.com/larray-project/larray/issues/1181
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"decide if we want to support Pandas StringArray and ArrowStringArray internally","articleBody":"in 0.35.1, I fixed the issues converting Pandas Series and DataFrames which use those types internally (by using `.to_numpy()` instead of `.values`). However, this often yields object arrays and prevents zero-copy for string types, which is clearly less than optimal. \n\nWe might want to support using those types instead of only numpy arrays everywhere we use numpy arrays (Axis labels, group keys, Array .data and probably other places). This is a very large undertaking (especially regarding testing) for an undefined benefit (could be very large in some cases but will probably be very modest if not insignificant for our current models).\n\nSee https://dev.to/kaniel_outis/pandas-30s-pyarrow-string-revolution-a-deep-dive-into-memory-and-performance-357g for benchmarks.","author":{"url":"https://github.com/gdementen","@type":"Person","name":"gdementen"},"datePublished":"2026-03-30T13:18:38Z","url":"https://github.com/larray-project/larray/issues/1181"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:254eb031-569a-3c48-200a-c96178bd8070 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | E7D6:396A8E:14C4BE7:1B7D152:6B001BB7 |
| html-safe-nonce | 0019c2d24022b1612b92a0bc33025d36c52a015bb19d7851a3af0b954d7bbdc8 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFN0Q2OjM5NkE4RToxNEM0QkU3OjFCN0QxNTI6NkIwMDFCQjciLCJ2aXNpdG9yX2lkIjoiNDM2MzYxMTU5OTcxODU4NzMxOSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 1dbdd40b2ef455a69a6c12745c9e538fd8975153c08d5e61a191bbcbafaa0db8 |
| hovercard-subject-tag | issue:4170689092 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/larray-project/larray/1181/issue_layout |
| twitter:image | https://opengraph.githubassets.com/ececcd249efdb8b85f757855e52dd5b7e2a72cfe238de6871e8571adc1621b98/larray-project/larray/issues/1181 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/ececcd249efdb8b85f757855e52dd5b7e2a72cfe238de6871e8571adc1621b98/larray-project/larray/issues/1181 |
| og:image:alt | in 0.35.1, I fixed the issues converting Pandas Series and DataFrames which use those types internally (by using .to_numpy() instead of .values). However, this often yields object arrays and preven... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | gdementen |
| hostname | github.com |
| expected-hostname | github.com |
| None | 4eb4cba0d69f045374ac15de9666d22b0961e1d555cc3824f36b7734c00c78e0 |
| turbo-cache-control | no-preview |
| go-import | github.com/larray-project/larray git https://github.com/larray-project/larray.git |
| octolytics-dimension-user_id | 26460981 |
| octolytics-dimension-user_login | larray-project |
| octolytics-dimension-repository_id | 16981067 |
| octolytics-dimension-repository_nwo | larray-project/larray |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 16981067 |
| octolytics-dimension-repository_network_root_nwo | larray-project/larray |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 44c658b24abf00491fb7ae5f56d42c9f38cbeab2 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width