René's URL Explorer Experiment


Title: Go: convert data extensions to JSON by nickrolfe · Pull Request #23079 · github/codeql · GitHub

Open Graph Title: Go: convert data extensions to JSON by nickrolfe · Pull Request #23079 · github/codeql

X Title: Go: convert data extensions to JSON by nickrolfe · Pull Request #23079 · github/codeql

Description: CodeQL CLI 2.27.3 supports JSON data extensions (aka MaD models), and can load them significantly faster than YAML. This PR converts those in Go's library pack (first commit), along with $TEST.ext.yml files (second commit). The conversions were automated by an LLM-generated Python script (which I will add in a separate PR). Although JSON is preferred going forward, go/ql/lib/qlpack.yml now has patterns that will pick up both .model.yml and .model.json files, so that any YAML files that do get checked in won't get silently dropped. To verify successful conversion in the first commit, I cherry-picked it onto #23078, which has a temporary test that enumerates all tuples from data extensions. The test still passes after conversion.

Open Graph Description: CodeQL CLI 2.27.3 supports JSON data extensions (aka MaD models), and can load them significantly faster than YAML. This PR converts those in Go's library pack (first commit), along with $TEST....

X Description: CodeQL CLI 2.27.3 supports JSON data extensions (aka MaD models), and can load them significantly faster than YAML. This PR converts those in Go's library pack (first commit), along with $T...

Opengraph URL: https://github.com/github/codeql/pull/23079

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:11757413-85fb-40bc-c1ee-afe27aefa87b
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idA3E2:2D9996:21077:2D78F:6AF89CE3
html-safe-nonce5af45fa0340b7d562e3f0222730ea3d15d915296c3bf9ee088bfeee3c5c7d828
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBM0UyOjJEOTk5NjoyMTA3NzoyRDc4Rjo2QUY4OUNFMyIsInZpc2l0b3JfaWQiOiI2NjM0NDQwOTc0Njc3ODc1OTM5IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac4068479bedc50d134642fceab4c1b67bc4956ebd3bf030cb8ca0ffa6ed519807
hovercard-subject-tagpull_request:5243098019
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/github/codeql/pull/23079/files
twitter:imagehttps://avatars.githubusercontent.com/u/158306?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/158306?s=400&v=4
og:image:altCodeQL CLI 2.27.3 supports JSON data extensions (aka MaD models), and can load them significantly faster than YAML. This PR converts those in Go's library pack (first commit), along with $TEST....
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None612d3e6ffd693e7ea8d9fcf452370995872baef31d825b1fedef704cd3d24ac7
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/github/codeql git https://github.com/github/codeql.git
octolytics-dimension-user_id9919
octolytics-dimension-user_logingithub
octolytics-dimension-repository_id143040428
octolytics-dimension-repository_nwogithub/codeql
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id143040428
octolytics-dimension-repository_network_root_nwogithub/codeql
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release072e34035c13c31543fba9f025cbbbda4210dae4
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/github/codeql/pull/23079/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgithub%2Fcodeql%2Fpull%2F23079%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgithub%2Fcodeql%2Fpull%2F23079%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=github%2Fcodeql
Reloadhttps://github.com/github/codeql/pull/23079/files
Reloadhttps://github.com/github/codeql/pull/23079/files
Reloadhttps://github.com/github/codeql/pull/23079/files
githubhttps://github.com/github
codeqlhttps://github.com/github/codeql
Codehttps://github.com/github/codeql
Issues1k (1k)https://github.com/github/codeql/issues
Pull requests516 (516)https://github.com/github/codeql/pulls
Discussionshttps://github.com/github/codeql/discussions
Actionshttps://github.com/github/codeql/actions
Projectshttps://github.com/github/codeql/projects
Security and qualityhttps://github.com/github/codeql/security
Insightshttps://github.com/github/codeql/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fgithub%2Fcodeql%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fgithub%2Fcodeql%2Fissues%2Fnew%2Fchoose
nickrolfehttps://github.com/nickrolfe
mainhttps://github.com/github/codeql/tree/main
nickrolfe/json-data-extensions-gohttps://github.com/github/codeql/tree/nickrolfe/json-data-extensions-go
Conversation 2 https://github.com/github/codeql/pull/23079
Commits 2 https://github.com/github/codeql/pull/23079/commits
Checks 13 https://github.com/github/codeql/pull/23079/checks
Findings https://github.com/github/codeql/pull/23079/findings
Files changed https://github.com/github/codeql/pull/23079/files
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
Go: convert data extensions to JSON https://github.com/github/codeql/pull/23079/files#top
Show all changes 2 commits https://github.com/github/codeql/pull/23079/files
f2947c2 Go: convert data extensiosn to JSON nickrolfe Nov 10, 2026 https://github.com/github/codeql/pull/23079/commits/f2947c20762266e02ba2f49f910d7476a109c54d
d5ac503 Go: convert test data extensions to JSON nickrolfe Nov 10, 2026 https://github.com/github/codeql/pull/23079/commits/d5ac503c3f40f3d483fcc0a1af737e5aeac18b5d
Clear filters https://github.com/github/codeql/pull/23079/files
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/archive.tar.model.jsonhttps://github.com/github/codeql/pull/23079/files#diff-0ce10a264bec7958ebec6f14e478b7c50425ac6929376e6641564fed5aa16df2
View file https://github.com/github/codeql/blob/d5ac503c3f40f3d483fcc0a1af737e5aeac18b5d/go/ql/lib/ext/archive.tar.model.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/github/codeql/pull/23079/{{ revealButtonHref }}
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/archive.tar.model.ymlhttps://github.com/github/codeql/pull/23079/files#diff-2854734f70f44c6f79e80085c030cf6cea043fc2db96c2f22718eb7756062031
View file https://github.com/github/codeql/blob/e173c08a568f76f3c7ee5bc6a9148e90c71ec33b/go/ql/lib/ext/archive.tar.model.yml
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/archive.zip.model.jsonhttps://github.com/github/codeql/pull/23079/files#diff-1030a00934e7b802e079d7dab02fa3262bf4aaa3b6e0f4bd00cc778f47c33e16
View file https://github.com/github/codeql/blob/d5ac503c3f40f3d483fcc0a1af737e5aeac18b5d/go/ql/lib/ext/archive.zip.model.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/github/codeql/pull/23079/{{ revealButtonHref }}
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/archive.zip.model.ymlhttps://github.com/github/codeql/pull/23079/files#diff-6eee5f69c91d5d84b08fbda312743df73bafba7e12b92a89e4390f1cfce729c3
View file https://github.com/github/codeql/blob/e173c08a568f76f3c7ee5bc6a9148e90c71ec33b/go/ql/lib/ext/archive.zip.model.yml
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/bufio.model.jsonhttps://github.com/github/codeql/pull/23079/files#diff-2dfde3b040859db357626f8347a5b19d6850c5a05c658ec713d8ba81548e77c1
View file https://github.com/github/codeql/blob/d5ac503c3f40f3d483fcc0a1af737e5aeac18b5d/go/ql/lib/ext/bufio.model.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/github/codeql/pull/23079/{{ revealButtonHref }}
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/bufio.model.ymlhttps://github.com/github/codeql/pull/23079/files#diff-4d4ffd46d8a94d0d6ed91de06080323a0acb42ccfad763d18f863888e7c6882a
View file https://github.com/github/codeql/blob/e173c08a568f76f3c7ee5bc6a9148e90c71ec33b/go/ql/lib/ext/bufio.model.yml
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/builtin.model.jsonhttps://github.com/github/codeql/pull/23079/files#diff-9abd1e412f9c2d4fb61ce70255574a375320298a7b979e4d6df426d2cfa41be1
View file https://github.com/github/codeql/blob/d5ac503c3f40f3d483fcc0a1af737e5aeac18b5d/go/ql/lib/ext/builtin.model.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/github/codeql/pull/23079/{{ revealButtonHref }}
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/builtin.model.ymlhttps://github.com/github/codeql/pull/23079/files#diff-49acfb1300f7330ae5b9809c5c5d03160b0490040271c671201b11afcb8972da
View file https://github.com/github/codeql/blob/e173c08a568f76f3c7ee5bc6a9148e90c71ec33b/go/ql/lib/ext/builtin.model.yml
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/bytes.model.jsonhttps://github.com/github/codeql/pull/23079/files#diff-a489bc87161f3da317db2a601d30ad3cab2082f837e401ad4cc5912e04f597ba
View file https://github.com/github/codeql/blob/d5ac503c3f40f3d483fcc0a1af737e5aeac18b5d/go/ql/lib/ext/bytes.model.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/github/codeql/pull/23079/{{ revealButtonHref }}
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/bytes.model.ymlhttps://github.com/github/codeql/pull/23079/files#diff-725c20cf4d020cd1875342537882ee3478c34d20e923bb42959f2cd19cf115f3
View file https://github.com/github/codeql/blob/e173c08a568f76f3c7ee5bc6a9148e90c71ec33b/go/ql/lib/ext/bytes.model.yml
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/clevergo.tech.clevergo.model.jsonhttps://github.com/github/codeql/pull/23079/files#diff-767f056e4019b97c89350ed891e726ecc7bd6147884f7639b9f45c7bbc865972
View file https://github.com/github/codeql/blob/d5ac503c3f40f3d483fcc0a1af737e5aeac18b5d/go/ql/lib/ext/clevergo.tech.clevergo.model.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/github/codeql/pull/23079/{{ revealButtonHref }}
https://github.com/github/codeql/blob/main/CODEOWNERS#L10
go/ql/lib/ext/clevergo.tech.clevergo.model.ymlhttps://github.com/github/codeql/pull/23079/files#diff-3293a1d1037c0f8ab255eb6b73c36ed156dd042087e6f44d24cde5fc5d4e1e6a
View file https://github.com/github/codeql/blob/e173c08a568f76f3c7ee5bc6a9148e90c71ec33b/go/ql/lib/ext/clevergo.tech.clevergo.model.yml
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
Please reload this pagehttps://github.com/github/codeql/pull/23079/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.