Title: Suggest : Using parquet and pyArrow, when R/W files · Issue #233 · visualpython/visualpython · GitHub
Open Graph Title: Suggest : Using parquet and pyArrow, when R/W files · Issue #233 · visualpython/visualpython
X Title: Suggest : Using parquet and pyArrow, when R/W files · Issue #233 · visualpython/visualpython
Description: How about using parquet and pyArrow, when read and write files? Starting with pandas 2.0, using pyArrow reduces file reading time. Also parquet data type is better performance than pickle. Reference 1 Reference 2 So I suggest that add ne...
Open Graph Description: How about using parquet and pyArrow, when read and write files? Starting with pandas 2.0, using pyArrow reduces file reading time. Also parquet data type is better performance than pickle. Referenc...
X Description: How about using parquet and pyArrow, when read and write files? Starting with pandas 2.0, using pyArrow reduces file reading time. Also parquet data type is better performance than pickle. Referenc...
Opengraph URL: https://github.com/visualpython/visualpython/issues/233
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Suggest : Using parquet and pyArrow, when R/W files","articleBody":"How about using parquet and pyArrow, when read and write files?\r\n\r\nStarting with pandas 2.0, using pyArrow reduces file reading time.\r\nAlso parquet data type is better performance than pickle.\r\n\r\n[Reference 1](https://medium.com/@santiagobasulto/pandas-2-0-performance-comparison-3f56b4719f58)\r\n[Reference 2](https://towardsdatascience.com/the-best-format-to-save-pandas-data-414dca023e0d)\r\n\r\nSo I suggest that add new data type(parquet), and new data read functions(pyArrow) **at File App.**\r\n\r\nThank you","author":{"url":"https://github.com/Minku-Koo","@type":"Person","name":"Minku-Koo"},"datePublished":"2023-08-14T15:18:38.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":3},"url":"https://github.com/233/visualpython/issues/233"}| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:903f5258-ac12-41ae-93c1-e9b5f37b8bff |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | 80AA:1C096D:130835F:1AA39D1:6972061C |
| html-safe-nonce | db0eedbf0a8bffaeda13028985ade582942fc3065ba9a67aa6ae9236cfa738d0 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4MEFBOjFDMDk2RDoxMzA4MzVGOjFBQTM5RDE6Njk3MjA2MUMiLCJ2aXNpdG9yX2lkIjoiMTYzMzgwNjEyODEwMzE2MzQyMSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 28a9c3d23e48b8dde75c64da2925df38385bf240186f858d02306b77e1b09c59 |
| hovercard-subject-tag | issue:1849998830 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/visualpython/visualpython/233/issue_layout |
| twitter:image | https://opengraph.githubassets.com/7822f66b70dbf27b47dc36be7c9eb62e625e099e7eaa038ac286673f86025440/visualpython/visualpython/issues/233 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/7822f66b70dbf27b47dc36be7c9eb62e625e099e7eaa038ac286673f86025440/visualpython/visualpython/issues/233 |
| og:image:alt | How about using parquet and pyArrow, when read and write files? Starting with pandas 2.0, using pyArrow reduces file reading time. Also parquet data type is better performance than pickle. Referenc... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | Minku-Koo |
| hostname | github.com |
| expected-hostname | github.com |
| None | 5d01a3551afdd1a0e12e78acaf3ba43a9a1f7dcb518695d6ed59db76a9290f13 |
| turbo-cache-control | no-preview |
| go-import | github.com/visualpython/visualpython git https://github.com/visualpython/visualpython.git |
| octolytics-dimension-user_id | 83543209 |
| octolytics-dimension-user_login | visualpython |
| octolytics-dimension-repository_id | 363663608 |
| octolytics-dimension-repository_nwo | visualpython/visualpython |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 363663608 |
| octolytics-dimension-repository_network_root_nwo | visualpython/visualpython |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 062b05dcdf64ee7a3dad7acabb746494ae0982cc |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width