René's URL Explorer Experiment


Title: Python: convert data extensions to JSON by nickrolfe · Pull Request #23076 · github/codeql · GitHub

Open Graph Title: Python: convert data extensions to JSON by nickrolfe · Pull Request #23076 · github/codeql

X Title: Python: convert data extensions to JSON by nickrolfe · Pull Request #23076 · github/codeql

Description: CodeQL: the libraries and queries that power security researchers around the world, as well as code scanning in GitHub Advanced Security - Python: convert data extensions to JSON by nickrolfe · Pull Request #23076 · github/codeql

Open Graph Description: CodeQL CLI 2.27.3 supports JSON data extensions (aka MaD models), and can load them significantly faster than YAML. This PR converts those in Python's library pack (first commit), along with $T...

X Description: CodeQL CLI 2.27.3 supports JSON data extensions (aka MaD models), and can load them significantly faster than YAML. This PR converts those in Python's library pack (first commit), along wit...

Opengraph URL: https://github.com/github/codeql/pull/23076

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:8ecc6579-d988-51cd-b706-9919bfc492f3
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idD24E:5B1A8:1542BDB:1C22D86:6AF8989F
html-safe-nonce4db1ad19333eb66df49fcec963b4c0ffe27ea084c8b7e97ab9fbc0dec141e8d4
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEMjRFOjVCMUE4OjE1NDJCREI6MUMyMkQ4Njo2QUY4OTg5RiIsInZpc2l0b3JfaWQiOiI3NDcxNjA1ODE2NjQ2NzM2MDMxIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmacae0163dc5cd34b430d1d5b4492d5aef2b77f5fb0400b272bbf68b81c43d79f90
hovercard-subject-tagpull_request:5242106756
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/github/codeql/23076/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/373c6cf8797216db4fc298c457c9c482790d831d83cf2d14ae2b7af237e57aea/github/codeql/pull/23076
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/373c6cf8797216db4fc298c457c9c482790d831d83cf2d14ae2b7af237e57aea/github/codeql/pull/23076
og:image:altCodeQL CLI 2.27.3 supports JSON data extensions (aka MaD models), and can load them significantly faster than YAML. This PR converts those in Python's library pack (first commit), along with $T...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamenickrolfe
hostnamegithub.com
expected-hostnamegithub.com
None612d3e6ffd693e7ea8d9fcf452370995872baef31d825b1fedef704cd3d24ac7
turbo-cache-controlno-cache
go-importgithub.com/github/codeql git https://github.com/github/codeql.git
octolytics-dimension-user_id9919
octolytics-dimension-user_logingithub
octolytics-dimension-repository_id143040428
octolytics-dimension-repository_nwogithub/codeql
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id143040428
octolytics-dimension-repository_network_root_nwogithub/codeql
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release072e34035c13c31543fba9f025cbbbda4210dae4
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/github/codeql/pull/23076#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgithub%2Fcodeql%2Fpull%2F23076
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgithub%2Fcodeql%2Fpull%2F23076
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=github%2Fcodeql
Reloadhttps://github.com/github/codeql/pull/23076
Reloadhttps://github.com/github/codeql/pull/23076
Reloadhttps://github.com/github/codeql/pull/23076
githubhttps://github.com/github
codeqlhttps://github.com/github/codeql
Codehttps://github.com/github/codeql
Issues1k (1k)https://github.com/github/codeql/issues
Pull requests516 (516)https://github.com/github/codeql/pulls
Discussionshttps://github.com/github/codeql/discussions
Actionshttps://github.com/github/codeql/actions
Projectshttps://github.com/github/codeql/projects
Security and qualityhttps://github.com/github/codeql/security
Insightshttps://github.com/github/codeql/pulse
https://github.com/github/codeql
nickrolfehttps://github.com/nickrolfe
mainhttps://github.com/github/codeql/tree/main
nickrolfe/json-data-extensions-pythonhttps://github.com/github/codeql/tree/nickrolfe/json-data-extensions-python
Conversationhttps://github.com/github/codeql/pull/23076
Commits3 (3)https://github.com/github/codeql/pull/23076/commits
Checkshttps://github.com/github/codeql/pull/23076/checks
Findingshttps://github.com/github/codeql/pull/23076/findings
Files changedhttps://github.com/github/codeql/pull/23076/files
Python: convert data extensions to JSONhttps://github.com/github/codeql/pull/23076#top
nickrolfehttps://github.com/nickrolfe
mainhttps://github.com/github/codeql/tree/main
nickrolfe/json-data-extensions-pythonhttps://github.com/github/codeql/tree/nickrolfe/json-data-extensions-python
https://github.com/nickrolfe
nickrolfehttps://github.com/nickrolfe
Nov 10, 2026https://github.com/github/codeql/pull/23076#issue-6307815151
#23075https://github.com/github/codeql/pull/23075
Please reload this pagehttps://github.com/github/codeql/pull/23076
https://github.com/nickrolfe
Python: convert data extensions to JSONhttps://github.com/github/codeql/pull/23076/commits/2bde17c93691cd9e90ac958e621a6698306d0963
2bde17chttps://github.com/github/codeql/pull/23076/commits/2bde17c93691cd9e90ac958e621a6698306d0963
https://github.com/apps/github-actions
github-actionshttps://github.com/apps/github-actions
Python https://github.com/github/codeql/issues?q=state%3Aopen%20label%3APython
Nov 10, 2026https://github.com/github/codeql/pull/23076#event-35686261175
https://github.com/nickrolfe
Python: convert test data extensions to JSONhttps://github.com/github/codeql/pull/23076/commits/497b80394994c4fc40e0a1454ec1e3a29ccb2a90
497b803https://github.com/github/codeql/pull/23076/commits/497b80394994c4fc40e0a1454ec1e3a29ccb2a90
https://github.com/nickrolfe
nickrolfehttps://github.com/nickrolfe
force-pushedhttps://github.com/github/codeql/compare/6d8f897906b2438c5b7cc7c2d00f8a962b7da186..497b80394994c4fc40e0a1454ec1e3a29ccb2a90
6d8f897https://github.com/github/codeql/commit/6d8f897906b2438c5b7cc7c2d00f8a962b7da186
497b803https://github.com/github/codeql/commit/497b80394994c4fc40e0a1454ec1e3a29ccb2a90
Compare https://github.com/github/codeql/compare/6d8f897906b2438c5b7cc7c2d00f8a962b7da186..497b80394994c4fc40e0a1454ec1e3a29ccb2a90
November 10, 2026 13:58https://github.com/github/codeql/pull/23076#event-35688000663
https://github.com/nickrolfe
nickrolfehttps://github.com/nickrolfe
November 10, 2026 14:37https://github.com/github/codeql/pull/23076#event-35692006581
https://github.com/nickrolfe
nickrolfehttps://github.com/nickrolfe
code ownershttps://github.com/github/codeql/blob/a219774f679aeb259ce0131c48cbd164bfbb4cd1/CODEOWNERS#L18
November 10, 2026 14:38https://github.com/github/codeql/pull/23076#event-35692008363
https://github.com/apps/copilot-pull-request-reviewer
Copilothttps://github.com/apps/copilot-pull-request-reviewer
November 10, 2026 14:38https://github.com/github/codeql/pull/23076#event-35692010177
started reviewinghttps://github.com/github/codeql/sessions/83fc2cce-20cd-485d-b76a-0a373a70bb40
nickrolfehttps://github.com/nickrolfe
November 10, 2026 14:38https://github.com/github/codeql/pull/23076#event-35692090368
View session https://github.com/github/codeql/sessions/83fc2cce-20cd-485d-b76a-0a373a70bb40
https://github.com/nickrolfe
nickrolfehttps://github.com/nickrolfe
no-change-note-required https://github.com/github/codeql/issues?q=state%3Aopen%20label%3Ano-change-note-required
Nov 10, 2026https://github.com/github/codeql/pull/23076#event-35692308380
https://github.com/apps/copilot-pull-request-reviewer
Copilothttps://github.com/apps/copilot-pull-request-reviewer
Nov 10, 2026 https://github.com/github/codeql/pull/23076#pullrequestreview-5843700739
View reviewed changes https://github.com/github/codeql/pull/23076/files/497b80394994c4fc40e0a1454ec1e3a29ccb2a90
Copilothttps://github.com/apps/copilot-pull-request-reviewer
https://github.com/github/codeql/pull/23076#pullrequestreview-5843700739
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Include DCA results for the final conversionhttps://github.com/github/codeql/pull/23076#discussion_r4526238920
Update the generator to write the converted JSON modelhttps://github.com/github/codeql/pull/23076#discussion_r4526239035
Please reload this pagehttps://github.com/github/codeql/pull/23076
python/ql/lib/qlpack.ymlhttps://github.com/github/codeql/pull/23076/files/497b80394994c4fc40e0a1454ec1e3a29ccb2a90#diff-70a3fcfc5caa49f10df4502eeebef41e7158b81deb10708004fd975f8f9de2b0
python/ql/lib/semmle/python/frameworks/builtins.model.jsonhttps://github.com/github/codeql/pull/23076/files/497b80394994c4fc40e0a1454ec1e3a29ccb2a90#diff-9c5ac57db0d1b94160101b485dc9bbf5978dd4ec76dcce5825a015e7a1ebc6bc
https://github.com/nickrolfe
nickrolfehttps://github.com/nickrolfe
Nov 11, 2026 https://github.com/github/codeql/pull/23076#ref-pullrequest-6329518022
MaD: add script to convert YAML data extensions to JSON #23102 https://github.com/github/codeql/pull/23102
https://github.com/owen-mc
owen-mchttps://github.com/owen-mc
Nov 11, 2026 https://github.com/github/codeql/pull/23076#pullrequestreview-5862189756
View reviewed changes https://github.com/github/codeql/pull/23076/files/497b80394994c4fc40e0a1454ec1e3a29ccb2a90
owen-mchttps://github.com/owen-mc
https://github.com/github/codeql/pull/23076#pullrequestreview-5862189756
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/github/codeql/pull/23076
https://github.com/nickrolfe
Python: update model processing scripts to use JSONhttps://github.com/github/codeql/pull/23076/commits/88fd4d92840b254ce362f541277324bf6ce95815
88fd4d9https://github.com/github/codeql/pull/23076/commits/88fd4d92840b254ce362f541277324bf6ce95815
https://github.com/nickrolfe
nickrolfehttps://github.com/nickrolfe
Nov 12, 2026https://github.com/github/codeql/pull/23076#issuecomment-6821761163
Please reload this pagehttps://github.com/github/codeql/pull/23076
Please reload this pagehttps://github.com/github/codeql/pull/23076
https://github.com/owen-mc
owen-mchttps://github.com/owen-mc
Copilothttps://github.com/apps/copilot-pull-request-reviewer
November 13, 2026 09:51https://github.com/github/codeql/pull/23076#event-36015150798
started reviewinghttps://github.com/github/codeql/sessions/4ce073ca-84f2-44ec-b786-fcff4c38ed6e
owen-mchttps://github.com/owen-mc
November 13, 2026 09:51https://github.com/github/codeql/pull/23076#event-36015185203
View session https://github.com/github/codeql/sessions/4ce073ca-84f2-44ec-b786-fcff4c38ed6e
https://github.com/apps/copilot-pull-request-reviewer
Copilothttps://github.com/apps/copilot-pull-request-reviewer
Nov 13, 2026 https://github.com/github/codeql/pull/23076#pullrequestreview-5889080661
View reviewed changes https://github.com/github/codeql/pull/23076/files/88fd4d92840b254ce362f541277324bf6ce95815
Copilothttps://github.com/apps/copilot-pull-request-reviewer
https://github.com/github/codeql/pull/23076#pullrequestreview-5889080661
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Declare or remove the undeclared json5 dependencyhttps://github.com/github/codeql/pull/23076#discussion_r4561919875
Update the generator to write the converted JSON modelhttps://github.com/github/codeql/pull/23076#discussion_r4526239035
Include DCA results for the final conversionhttps://github.com/github/codeql/pull/23076#discussion_r4526238920
Please reload this pagehttps://github.com/github/codeql/pull/23076
python/ql/src/meta/ClassHierarchy/shared_subclass_functions.pyhttps://github.com/github/codeql/pull/23076/files/88fd4d92840b254ce362f541277324bf6ce95815#diff-36f1c8a225919ae3d6e16b30e55cb8f3d0f94ec34b24b97b91a63b8613c4c53d
nickrolfehttps://github.com/nickrolfe
Nov 13, 2026https://github.com/github/codeql/pull/23076#discussion_r4566231019
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/github/codeql/pull/23076
tausbnhttps://github.com/tausbn
Nov 13, 2026https://github.com/github/codeql/pull/23076#discussion_r4566287025
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
https://peps.python.org/pep-0723/#examplehttps://peps.python.org/pep-0723/#example
Please reload this pagehttps://github.com/github/codeql/pull/23076
https://github.com/owen-mc
owen-mchttps://github.com/owen-mc
Nov 13, 2026 https://github.com/github/codeql/pull/23076#pullrequestreview-5895604066
View reviewed changes https://github.com/github/codeql/pull/23076/files/88fd4d92840b254ce362f541277324bf6ce95815
https://github.co/hiddenchars
https://github.com/github/codeql/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgithub%2Fcodeql%2Fpull%2F23076
https://github.com/tausbn
tausbn https://github.com/tausbn
https://github.com/github/codeql/pull/23076/files/88fd4d92840b254ce362f541277324bf6ce95815
Copilot code review https://github.com/apps/copilot-pull-request-reviewer
Copilot https://github.com/apps/copilot-pull-request-reviewer
Learn more about Copilot code review.https://gh.io/copilot-code-review-docs
https://github.com/github/codeql/pull/23076/files/88fd4d92840b254ce362f541277324bf6ce95815
https://github.com/owen-mc
owen-mc https://github.com/owen-mc
https://github.com/github/codeql/pull/23076/files/88fd4d92840b254ce362f541277324bf6ce95815
Please reload this pagehttps://github.com/github/codeql/pull/23076
no-change-note-required https://github.com/github/codeql/issues?q=state%3Aopen%20label%3Ano-change-note-required
Python https://github.com/github/codeql/issues?q=state%3Aopen%20label%3APython
Please reload this pagehttps://github.com/github/codeql/pull/23076
https://github.com/nickrolfe
https://github.com/tausbn
https://github.com/owen-mc
https://github.com/apps/copilot-pull-request-reviewer
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.