René's URL Explorer Experiment


Title: Python extractor: overlay support by d10c · Pull Request #20206 · github/codeql · GitHub

Open Graph Title: Python extractor: overlay support by d10c · Pull Request #20206 · github/codeql

X Title: Python extractor: overlay support by d10c · Pull Request #20206 · github/codeql

Description: This PR adds overlay support to the Python extractor, but no overlay compilation (to be merged separately since it needs further testing, see this PR). This PR also includes an initial pass at the discard predicates (see Overlay.qll), though these are ignored in full (non-overlay) evaluation; they probably still need to be tweaked, so I'm happy to move this commit to another PR and let this one be only about the extractor. Roadmap: Update the dbscheme Implement path transformer support Read the overlay-changes JSON file Read/write base metadata (CODEQL_EXTRACTOR__OVERLAY_BASE_METADATA_{IN,OUT})

Open Graph Description: This PR adds overlay support to the Python extractor, but no overlay compilation (to be merged separately since it needs further testing, see this PR). This PR also includes an initial pass at the ...

X Description: This PR adds overlay support to the Python extractor, but no overlay compilation (to be merged separately since it needs further testing, see this PR). This PR also includes an initial pass at the ...

Opengraph URL: https://github.com/github/codeql/pull/20206

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository/pull/:id/checks(.:format)
route-controllerpull_requests
route-actionchecks
fetch-noncev2:1a2e0862-a9c6-a425-921f-b4bf37fccbfe
current-catalog-service-hash87dc3bc62d9b466312751bfd5f889726f4f1337bdff4e8be7da7c93d6c00a25a
request-idB126:39FF80:BFF708:102ED6C:698F75CC
html-safe-noncec524fc9d3a50556b9cd0a717492e0fb3d0d1ee1d201de5768c0d343f6923737b
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCMTI2OjM5RkY4MDpCRkY3MDg6MTAyRUQ2Qzo2OThGNzVDQyIsInZpc2l0b3JfaWQiOiI1NTI1NzgyODc0NzE4OTU5MDUyIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac57723c1031982c6dfb6d87e985fb94efbd6f50401cafacddd5a0c2d03ac96eb6
hovercard-subject-tagpull_request:2735779914
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,checks,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/checks
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/github/codeql/pull/20206/checks
twitter:imagehttps://avatars.githubusercontent.com/u/9970661?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/9970661?s=400&v=4
og:image:altThis PR adds overlay support to the Python extractor, but no overlay compilation (to be merged separately since it needs further testing, see this PR). This PR also includes an initial pass at the ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Nonea40913be56b49e6322246e4bcd65ab6ec4b458c6dca6b691d30419da1e5ee35e
turbo-cache-controlno-cache
go-importgithub.com/github/codeql git https://github.com/github/codeql.git
octolytics-dimension-user_id9919
octolytics-dimension-user_logingithub
octolytics-dimension-repository_id143040428
octolytics-dimension-repository_nwogithub/codeql
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id143040428
octolytics-dimension-repository_network_root_nwogithub/codeql
turbo-body-classeslogged-out env-production page-responsive full-width full-width-p-0
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releaseca6051e0ba2303370981e3d01e2bc1044eb3b429
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgithub%2Fcodeql%2Fpull%2F20206%2Fchecks
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgithub%2Fcodeql%2Fpull%2F20206%2Fchecks
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Fchecks&source=header-repo&source_repo=github%2Fcodeql
Reloadhttps://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks
Reloadhttps://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks
Reloadhttps://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks
github https://patch-diff.githubusercontent.com/github
codeqlhttps://patch-diff.githubusercontent.com/github/codeql
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fgithub%2Fcodeql
Fork 1.9k https://patch-diff.githubusercontent.com/login?return_to=%2Fgithub%2Fcodeql
Star 9.2k https://patch-diff.githubusercontent.com/login?return_to=%2Fgithub%2Fcodeql
Code https://patch-diff.githubusercontent.com/github/codeql
Issues 927 https://patch-diff.githubusercontent.com/github/codeql/issues
Pull requests 367 https://patch-diff.githubusercontent.com/github/codeql/pulls
Discussions https://patch-diff.githubusercontent.com/github/codeql/discussions
Actions https://patch-diff.githubusercontent.com/github/codeql/actions
Projects 0 https://patch-diff.githubusercontent.com/github/codeql/projects
Models https://patch-diff.githubusercontent.com/github/codeql/models
Security 0 https://patch-diff.githubusercontent.com/github/codeql/security
Insights https://patch-diff.githubusercontent.com/github/codeql/pulse
Code https://patch-diff.githubusercontent.com/github/codeql
Issues https://patch-diff.githubusercontent.com/github/codeql/issues
Pull requests https://patch-diff.githubusercontent.com/github/codeql/pulls
Discussions https://patch-diff.githubusercontent.com/github/codeql/discussions
Actions https://patch-diff.githubusercontent.com/github/codeql/actions
Projects https://patch-diff.githubusercontent.com/github/codeql/projects
Models https://patch-diff.githubusercontent.com/github/codeql/models
Security https://patch-diff.githubusercontent.com/github/codeql/security
Insights https://patch-diff.githubusercontent.com/github/codeql/pulse
Sign up for GitHub https://patch-diff.githubusercontent.com/signup?return_to=%2Fgithub%2Fcodeql%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://patch-diff.githubusercontent.com/login?return_to=%2Fgithub%2Fcodeql%2Fissues%2Fnew%2Fchoose
d10chttps://patch-diff.githubusercontent.com/d10c
github:mainhttps://patch-diff.githubusercontent.com/github/codeql/tree/main
d10c:d10c/python-overlayhttps://patch-diff.githubusercontent.com/d10c/codeql/tree/d10c/python-overlay
Conversation 18 https://patch-diff.githubusercontent.com/github/codeql/pull/20206
Commits 14 https://patch-diff.githubusercontent.com/github/codeql/pull/20206/commits
Checks 10 https://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks
Files changed https://patch-diff.githubusercontent.com/github/codeql/pull/20206/files
Please reload this pagehttps://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks
Please reload this pagehttps://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks
Sign in for the full log viewhttps://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fgithub%2Fcodeql%2Fpull%2F20206%2Fchecks
Python extractor: overlay support https://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks#top
Please reload this pagehttps://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks
Check change note on: pull_request_target https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199345
check-change-note https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199345/job/50271474095?pr=20206
Pull Request Labeler on: pull_request_target https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199333
triage https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199333/job/50271474093?pr=20206
Check overlay annotations on: pull_request https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199434
sync https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199434/job/50271474118?pr=20206
Check QLdoc coverage on: pull_request https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199436
qldoc https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199436/job/50271474121?pr=20206
Ruby: Run RTJO Language Tests on: pull_request https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199459
qltest-rtjo https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199459/job/50271474216?pr=20206
Check synchronized files on: pull_request https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199465
sync https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199465/job/50271474108?pr=20206
Check framework coverage changes on: pull_request https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199485
Generate framework coverage artifacts https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199485/job/50271474117?pr=20206
Run QL for QL on: pull_request https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199507
analyze https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199507/job/50271474159?pr=20206
Compile all queries using the latest stable CodeQL CLI on: pull_request https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199510
compile-queries https://patch-diff.githubusercontent.com/github/codeql/actions/runs/17686199510/job/50271474115?pr=20206
CodeQL https://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks?check_run_id=50271647825
https://patch-diff.githubusercontent.com/github/codeql/pull/20206/checks#annotation:2:18
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.