René's URL Explorer Experiment


Title: Serialization formats · PowerGridModel · Discussion #71 · GitHub

Open Graph Title: Serialization formats · PowerGridModel · Discussion #71

X Title: Serialization formats · PowerGridModel · Discussion #71

Description: Serialization formats

Open Graph Description: For PGM-DS we are looking into serialisation of Grid objects. PGM supports json & msgpack on which we could be build. However, we are also still considering parquet or numpy-binary. What were your ...

X Description: For PGM-DS we are looking into serialisation of Grid objects. PGM supports json & msgpack on which we could be build. However, we are also still considering parquet or numpy-binary. What were y...

Opengraph URL: https://github.com/orgs/PowerGridModel/discussions/71

X: @github

direct link

Domain: patch-diff.githubusercontent.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"QAPage","mainEntity":{"@type":"Question","name":"Serialization formats","text":"

For PGM-DS we are looking into serialisation of Grid objects. PGM supports json & msgpack on which we could be build. However, we are also still considering parquet or numpy-binary. What were your considerations for supporting json and msgpack?

","upvoteCount":1,"answerCount":2,"acceptedAnswer":{"@type":"Answer","text":"

Hi @jaapschoutenalliander,

\n

numpy-binary is python/numpy specific, PGM core is in general language acoustic (with universal C-API).

\n

As far as I know, parquet cannot store multiple tables with different length and width inside one file. Also it misses the function to store sparse batch dataset, metadata, etc.

\n

We use json and msgpack because they are both well-known serialization format. We define our data model on top of the serialization.

","upvoteCount":1,"url":"https://github.com/orgs/PowerGridModel/discussions/71#discussioncomment-14673076"}}}

route-pattern/_view_fragments/Voltron::DiscussionsFragmentsController/show/orgs/:org/:discussion_number/discussion_layout(.:format)
route-controllervoltron_discussions_fragments
route-actiondiscussion_layout
fetch-noncev2:242e4484-2657-0780-aadb-11c89fbe953e
current-catalog-service-hash9f0abe34da433c9b6db74bffa2466494a717b579a96b30a5d252e5090baea7be
request-id8370:197F4C:EB40D0:12B8DAE:6990201F
html-safe-nonce8da6cade2c47cc2651fa6c54d1a1e75261273539a51346523a249a48e8d39c24
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4MzcwOjE5N0Y0QzpFQjQwRDA6MTJCOERBRTo2OTkwMjAxRiIsInZpc2l0b3JfaWQiOiIxNzU1NDY3ODg4NTgyNDY3NjE1IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac2dfc652fad19c8c5cbff1be688af700ed659d8679d46a34a21d356fde6d9f966
hovercard-subject-tagdiscussion:9024939
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/discussions_fragments/discussion_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/Voltron::DiscussionsFragmentsController/show/orgs/PowerGridModel/71/discussion_layout
twitter:imagehttps://opengraph.githubassets.com/5647c7efa7f2f92afaf769b4fd593591e7e02cd7a2fbf669c13c0ea9f876f658/orgs/PowerGridModel/discussions/71
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/5647c7efa7f2f92afaf769b4fd593591e7e02cd7a2fbf669c13c0ea9f876f658/orgs/PowerGridModel/discussions/71
og:image:altFor PGM-DS we are looking into serialisation of Grid objects. PGM supports json & msgpack on which we could be build. However, we are also still considering parquet or numpy-binary. What were your ...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None42c603b9d642c4a9065a51770f75e5e27132fef0e858607f5c9cb7e422831a7b
turbo-cache-controlno-preview
octolytics-dimension-user_id128388838
octolytics-dimension-user_loginPowerGridModel
octolytics-dimension-repository_id616883724
octolytics-dimension-repository_nwoPowerGridModel/.github
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id616883724
octolytics-dimension-repository_network_root_nwoPowerGridModel/.github
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release3b33c5aedc9808f45bc5fcf0b1e4404cf749dac7
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Forgs%2FPowerGridModel%2Fdiscussions%2F71
PowerGridModelhttps://patch-diff.githubusercontent.com/PowerGridModel
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Forgs%2FPowerGridModel%2Fdiscussions%2F71
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fdiscussions_fragments%2Fdiscussion_layout&source=header-repo&source_repo=PowerGridModel%2F.github
Reloadhttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
Reloadhttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
Reloadhttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
Power Grid Model https://patch-diff.githubusercontent.com/PowerGridModel
Overview https://patch-diff.githubusercontent.com/PowerGridModel
Repositories https://patch-diff.githubusercontent.com/orgs/PowerGridModel/repositories
Discussions https://patch-diff.githubusercontent.com/orgs/PowerGridModel/discussions
Projects https://patch-diff.githubusercontent.com/orgs/PowerGridModel/projects
Packages https://patch-diff.githubusercontent.com/orgs/PowerGridModel/packages
People https://patch-diff.githubusercontent.com/orgs/PowerGridModel/people
Overviewhttps://patch-diff.githubusercontent.com/PowerGridModel
Repositorieshttps://patch-diff.githubusercontent.com/orgs/PowerGridModel/repositories
Discussionshttps://patch-diff.githubusercontent.com/orgs/PowerGridModel/discussions
Projectshttps://patch-diff.githubusercontent.com/orgs/PowerGridModel/projects
Packageshttps://patch-diff.githubusercontent.com/orgs/PowerGridModel/packages
Peoplehttps://patch-diff.githubusercontent.com/orgs/PowerGridModel/people
Answered https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#discussioncomment-14673076
TonyXiang8787https://patch-diff.githubusercontent.com/TonyXiang8787
jaapschoutenalliander https://patch-diff.githubusercontent.com/jaapschoutenalliander
Q&Ahttps://patch-diff.githubusercontent.com/orgs/PowerGridModel/discussions/categories/q-a
Serialization formats https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#top
jaapschoutenalliander https://patch-diff.githubusercontent.com/jaapschoutenalliander
Answered https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#discussioncomment-14673076
TonyXiang8787https://patch-diff.githubusercontent.com/TonyXiang8787
Return to tophttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#top
Please reload this pagehttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
Please reload this pagehttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
jaapschoutenalliander https://patch-diff.githubusercontent.com/jaapschoutenalliander
Oct 14, 2025 https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#discussion-9024939
Give feedback.https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
TonyXiang8787 https://patch-diff.githubusercontent.com/TonyXiang8787
Oct 14, 2025 https://github.com/orgs/PowerGridModel/discussions/71#discussioncomment-14673076
@jaapschoutenallianderhttps://github.com/jaapschoutenalliander
View full answer https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#discussioncomment-14673076
Oldest https://patch-diff.githubusercontent.com/orgs/PowerGridModel/discussions/71?sort=old
Newest https://patch-diff.githubusercontent.com/orgs/PowerGridModel/discussions/71?sort=new
Top https://patch-diff.githubusercontent.com/orgs/PowerGridModel/discussions/71?sort=top
Please reload this pagehttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
Please reload this pagehttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
TonyXiang8787 https://patch-diff.githubusercontent.com/TonyXiang8787
Oct 14, 2025 https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#discussioncomment-14673076
@jaapschoutenallianderhttps://github.com/jaapschoutenalliander
Give feedback.https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/mgovers
Please reload this pagehttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
Please reload this pagehttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
mgovershttps://patch-diff.githubusercontent.com/mgovers
Oct 14, 2025 https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#discussioncomment-14675024
@jaapschoutenallianderhttps://github.com/jaapschoutenalliander
https://power-grid-model-io.readthedocs.io/en/stable/examples/arrow_example.htmlhttps://power-grid-model-io.readthedocs.io/en/stable/examples/arrow_example.html
Give feedback.https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
mgovershttps://patch-diff.githubusercontent.com/mgovers
Please reload this pagehttps://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
Thijss https://patch-diff.githubusercontent.com/Thijss
Oct 14, 2025 https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71#discussioncomment-14673077
Give feedback.https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
Sign up for freehttps://patch-diff.githubusercontent.com/join?source=comment-repo
Sign in to commenthttps://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Forgs%2FPowerGridModel%2Fdiscussions%2F71
🙏 Q&A https://patch-diff.githubusercontent.com/orgs/PowerGridModel/discussions/categories/q-a
question https://patch-diff.githubusercontent.com/orgs/PowerGridModel/discussions?discussions_q=label%3Aquestion
https://patch-diff.githubusercontent.com/jaapschoutenalliander
https://patch-diff.githubusercontent.com/Thijss
https://patch-diff.githubusercontent.com/mgovers
https://patch-diff.githubusercontent.com/TonyXiang8787
https://patch-diff.githubusercontent.com/PowerGridModel/.github/discussions/71
https://patch-diff.githubusercontent.com/settings/replies?return_to=1
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.