Title: Serialization formats · PowerGridModel · Discussion #71 · GitHub
Open Graph Title: Serialization formats · PowerGridModel · Discussion #71
X Title: Serialization formats · PowerGridModel · Discussion #71
Description: Serialization formats
Open Graph Description: For PGM-DS we are looking into serialisation of Grid objects. PGM supports json & msgpack on which we could be build. However, we are also still considering parquet or numpy-binary. What were your ...
X Description: For PGM-DS we are looking into serialisation of Grid objects. PGM supports json & msgpack on which we could be build. However, we are also still considering parquet or numpy-binary. What were y...
Opengraph URL: https://github.com/orgs/PowerGridModel/discussions/71
X: @github
Domain: patch-diff.githubusercontent.com
{"@context":"https://schema.org","@type":"QAPage","mainEntity":{"@type":"Question","name":"Serialization formats","text":"For PGM-DS we are looking into serialisation of Grid objects. PGM supports json & msgpack on which we could be build. However, we are also still considering parquet or numpy-binary. What were your considerations for supporting json and msgpack?
","upvoteCount":1,"answerCount":2,"acceptedAnswer":{"@type":"Answer","text":"\nnumpy-binary is python/numpy specific, PGM core is in general language acoustic (with universal C-API).
\nAs far as I know, parquet cannot store multiple tables with different length and width inside one file. Also it misses the function to store sparse batch dataset, metadata, etc.
\nWe use json and msgpack because they are both well-known serialization format. We define our data model on top of the serialization.
","upvoteCount":1,"url":"https://github.com/orgs/PowerGridModel/discussions/71#discussioncomment-14673076"}}}
| route-pattern | /_view_fragments/Voltron::DiscussionsFragmentsController/show/orgs/:org/:discussion_number/discussion_layout(.:format) |
| route-controller | voltron_discussions_fragments |
| route-action | discussion_layout |
| fetch-nonce | v2:242e4484-2657-0780-aadb-11c89fbe953e |
| current-catalog-service-hash | 9f0abe34da433c9b6db74bffa2466494a717b579a96b30a5d252e5090baea7be |
| request-id | 8370:197F4C:EB40D0:12B8DAE:6990201F |
| html-safe-nonce | 8da6cade2c47cc2651fa6c54d1a1e75261273539a51346523a249a48e8d39c24 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4MzcwOjE5N0Y0QzpFQjQwRDA6MTJCOERBRTo2OTkwMjAxRiIsInZpc2l0b3JfaWQiOiIxNzU1NDY3ODg4NTgyNDY3NjE1IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0= |
| visitor-hmac | 2dfc652fad19c8c5cbff1be688af700ed659d8679d46a34a21d356fde6d9f966 |
| hovercard-subject-tag | discussion:9024939 |
| github-keyboard-shortcuts | repository,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/Voltron::DiscussionsFragmentsController/show/orgs/PowerGridModel/71/discussion_layout |
| twitter:image | https://opengraph.githubassets.com/5647c7efa7f2f92afaf769b4fd593591e7e02cd7a2fbf669c13c0ea9f876f658/orgs/PowerGridModel/discussions/71 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/5647c7efa7f2f92afaf769b4fd593591e7e02cd7a2fbf669c13c0ea9f876f658/orgs/PowerGridModel/discussions/71 |
| og:image:alt | For PGM-DS we are looking into serialisation of Grid objects. PGM supports json & msgpack on which we could be build. However, we are also still considering parquet or numpy-binary. What were your ... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 42c603b9d642c4a9065a51770f75e5e27132fef0e858607f5c9cb7e422831a7b |
| turbo-cache-control | no-preview |
| octolytics-dimension-user_id | 128388838 |
| octolytics-dimension-user_login | PowerGridModel |
| octolytics-dimension-repository_id | 616883724 |
| octolytics-dimension-repository_nwo | PowerGridModel/.github |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 616883724 |
| octolytics-dimension-repository_network_root_nwo | PowerGridModel/.github |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 3b33c5aedc9808f45bc5fcf0b1e4404cf749dac7 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width