René's URL Explorer Experiment


Title: gh-158283: Force dispatch tail duplication with Clang 19 and Apple clang 17 by matthiasgoergens · Pull Request #158286 · python/cpython · GitHub

Open Graph Title: gh-158283: Force dispatch tail duplication with Clang 19 and Apple clang 17 by matthiasgoergens · Pull Request #158286 · python/cpython

X Title: gh-158283: Force dispatch tail duplication with Clang 19 and Apple clang 17 by matthiasgoergens · Pull Request #158286 · python/cpython

Description: Clang 19 and Apple clang from Xcode 16.3–26.3 merge most or all of the computed-goto dispatch jumps into one shared indirect jump (gh-158283). This adds a configure check for those compilers that passes -mllvm -tail-dup-pred-size=1000 when compiling ceval.c, which restores one dispatch jump per opcode. The option controls the limit that llvm/llvm-project#78582 introduced. With --with-lto the option also has to reach the linker's LTO backend, where it applies to the whole LTO link rather than just ceval.c. The clang driver does not forward -mllvm there: with plain -mllvm on the link line it only warns "argument unused during compilation", and a thin-LTO build keeps 1 dispatch jump with Clang 19 (GNU ld or lld) or 94 with Apple clang 1700.6 (ld64). So it is passed as -Wl,-plugin-opt= for lld and GNU ld/gold with LLVMgold, and as -Wl,-mllvm, for ld64. Because it applies to the whole LTO link, it also un-merges the computed-goto dispatch of the regex engine (Modules/_sre/sre_lib.h): sre_ucs1_match, sre_ucs2_match and sre_ucs4_match go from 7, 14 and 18 indirect jumps to 33 each with Clang 19 (thin LTO, x86-64), and from 10–12 indirect branches to 29–30 with Apple clang 1700.6 (LTO, arm64). Without any flag, GCC 16 has 18–19 and Clang 22 has 21–25. This is where the 6–9% regex_effbot slowdown reported in the issue comes in, and its size depends strongly on code layout. With each build linked in three different function orders (-ffunction-sections -Wl,--shuffle-sections=.text*=, lld, thin LTO), regex_effbot is between 1% and 9% slower with this PR on the AMD EPYC 7763 runners (4.9% averaged over the layouts), regex_v8 and regex_dna get 3.0% and 1.1% faster, and the geometric mean of the three regex benchmarks is +0.2% (95% CI −0.1% to +0.5%). On an i9-13900K, an M4 Max and an M3 MacBook Air, all three get faster (geometric mean −7.1%, −3.7% and −5.7%). Keeping _sre merged, by making its shared dispatch block the target of an empty asm goto, removes the regex_effbot slowdown on the EPYC 7763 runners but is slower than this PR on the i9, M4 Max and M3, and under Stabilizer (LLVM 21, fresh code layout per process) it is also slower on the EPYC 7763 (+5.4% on the three regex benchmarks). So the PR leaves _sre alone. Data: shuffled layouts, Stabilizer, i9, M4 Max and M3. The check sits next to the Clang 22 -finline-max-stacksize workaround (gh-148284) and is written the same way. It is limited to the affected versions because Clang 18 and older reject the option. Dispatch jumps in _PyEval_EvalFrameDefault in the final binary, before → after: compiler build x86-64 arm64 Clang 19.1.7 --with-lto=thin 1 → 276 Clang 19.1.7 --enable-optimizations --with-lto 1–7 → 359–365 Xcode 16.4 (Apple clang 1700.0.13) --with-lto 1 → 276 1 → 300 Xcode 26.3 (Apple clang 1700.6) --with-lto 62 → 276 94 → 300 On GitHub's macOS runners the check matches Xcode 16.3, 16.4, 26.0.1, 26.1.1, 26.2 and 26.3, and not Xcode 15.0.1–15.4, 16.0–16.2 or 26.4.1–26.6. On Linux it matches Clang 19 but not Clang 18, Clang 21 or GCC. pyperformance, this PR vs main: 8.4% faster with Clang 19 PGO+LTO and 8.7% with Clang 19 thin LTO (FreeBSD's configuration) on Linux x86-64; 11.4% faster with Xcode 16.4 and 1.4% with Xcode 26.3 on macOS arm64. Confidence intervals and method are in the issue. The version test excludes GCC, Clang 18 and older, and Clang 20 and newer; MSVC builds do not use configure. This PR was prepared with the help of an AI assistant (Claude Code) and reviewed by me. Raw data and scripts are on the clang19-dispatch-data branch of my fork.

Open Graph Description: Clang 19 and Apple clang from Xcode 16.3–26.3 merge most or all of the computed-goto dispatch jumps into one shared indirect jump (gh-158283). This adds a configure check for those compilers that p...

X Description: Clang 19 and Apple clang from Xcode 16.3–26.3 merge most or all of the computed-goto dispatch jumps into one shared indirect jump (gh-158283). This adds a configure check for those compilers that p...

Opengraph URL: https://github.com/python/cpython/pull/158286

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:9a0099c1-0c4a-b6ca-ecc0-2372dc73d05d
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idDA26:AC3D5:3D62D2:50DFC1:6B023B2A
html-safe-nonce0282853a795882053aa40880d97e9c9a5de929bc7e575be1f982223b183317e1
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEQTI2OkFDM0Q1OjNENjJEMjo1MERGQzE6NkIwMjNCMkEiLCJ2aXNpdG9yX2lkIjoiMzc3ODQyNjg3OTc3ODg5NjY4MiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacfc40fcb5951e1653d5302db5d744f7bd9d2fee42211475f273940a2ffc029528
hovercard-subject-tagpull_request:4654517226
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/python/cpython/pull/158286/files
twitter:imagehttps://avatars.githubusercontent.com/u/57026?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/57026?s=400&v=4
og:image:altClang 19 and Apple clang from Xcode 16.3–26.3 merge most or all of the computed-goto dispatch jumps into one shared indirect jump (gh-158283). This adds a configure check for those compilers that p...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/python/cpython git https://github.com/python/cpython.git
octolytics-dimension-user_id1525981
octolytics-dimension-user_loginpython
octolytics-dimension-repository_id81598961
octolytics-dimension-repository_nwopython/cpython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id81598961
octolytics-dimension-repository_network_root_nwopython/cpython
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/python/cpython/pull/158286/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fpull%2F158286%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fpull%2F158286%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=python%2Fcpython
Reloadhttps://github.com/python/cpython/pull/158286/files
Reloadhttps://github.com/python/cpython/pull/158286/files
Reloadhttps://github.com/python/cpython/pull/158286/files
pythonhttps://github.com/python
cpythonhttps://github.com/python/cpython
Codehttps://github.com/python/cpython
Issues5k+ (5k+)https://github.com/python/cpython/issues
Pull requests2.4k (2.4k)https://github.com/python/cpython/pulls
Actionshttps://github.com/python/cpython/actions
Projectshttps://github.com/python/cpython/projects
Security and qualityhttps://github.com/python/cpython/security
Insightshttps://github.com/python/cpython/insights
Sign up for GitHub https://github.com/signup?return_to=%2Fpython%2Fcpython%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fpython%2Fcpython%2Fissues%2Fnew%2Fchoose
matthiasgoergenshttps://github.com/matthiasgoergens
python:mainhttps://github.com/python/cpython/tree/main
matthiasgoergens:pr/clang19-dispatchhttps://github.com/matthiasgoergens/cpython/tree/pr/clang19-dispatch
Conversation 1 https://github.com/python/cpython/pull/158286
Commits 1 https://github.com/python/cpython/pull/158286/commits
Checks 46 https://github.com/python/cpython/pull/158286/checks
Files changed https://github.com/python/cpython/pull/158286/files
Please reload this pagehttps://github.com/python/cpython/pull/158286/files
gh-158283: Force dispatch tail duplication with Clang 19 and Apple clang 17 https://github.com/python/cpython/pull/158286/files#top
Show all changes 1 commit https://github.com/python/cpython/pull/158286/files
65772c6 gh-158283: Force dispatch tail duplication with Clang 19 and Apple cl… matthiasgoergens Sep 27, 2026 https://github.com/python/cpython/pull/158286/commits/65772c6be36aee53f623f63c6e7df51bcf86defe
Clear filters https://github.com/python/cpython/pull/158286/files
Please reload this pagehttps://github.com/python/cpython/pull/158286/files
Please reload this pagehttps://github.com/python/cpython/pull/158286/files
2026-09-27-18-00-00.gh-issue-158283.cLg19d.rst https://github.com/python/cpython/pull/158286/files#diff-353de5a593f42942e1d95083a18b160d71cf3b8e14a14eca7e7a1d7fa441d909
configure https://github.com/python/cpython/pull/158286/files#diff-90d08e583c4c9c6f391b2ae90f819f600a6326928ea9512c9e0c6d98e9f29ac2
configure.ac https://github.com/python/cpython/pull/158286/files#diff-49473dca262eeab3b4a43002adb08b4db31020d190caaad1594b47f1d5daa810
Misc/NEWS.d/next/Build/2026-09-27-18-00-00.gh-issue-158283.cLg19d.rsthttps://github.com/python/cpython/pull/158286/files#diff-353de5a593f42942e1d95083a18b160d71cf3b8e14a14eca7e7a1d7fa441d909
View file https://github.com/python/cpython/blob/65772c6be36aee53f623f63c6e7df51bcf86defe/Misc/NEWS.d/next/Build/2026-09-27-18-00-00.gh-issue-158283.cLg19d.rst
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/python/cpython/pull/158286/{{ revealButtonHref }}
https://github.com/python/cpython/blob/main/.github/CODEOWNERS#L84
configurehttps://github.com/python/cpython/pull/158286/files#diff-90d08e583c4c9c6f391b2ae90f819f600a6326928ea9512c9e0c6d98e9f29ac2
View file https://github.com/python/cpython/blob/65772c6be36aee53f623f63c6e7df51bcf86defe/configure
Open in desktop https://desktop.github.com
how customized files appear on GitHubhttps://docs.github.com/github/administering-a-repository/customizing-how-changed-files-appear-on-github
Please reload this pagehttps://github.com/python/cpython/pull/158286/files
https://github.com/python/cpython/blob/main/.github/CODEOWNERS#L84
configure.achttps://github.com/python/cpython/pull/158286/files#diff-49473dca262eeab3b4a43002adb08b4db31020d190caaad1594b47f1d5daa810
View file https://github.com/python/cpython/blob/65772c6be36aee53f623f63c6e7df51bcf86defe/configure.ac
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/python/cpython/pull/158286/{{ revealButtonHref }}
https://github.com/python/cpython/pull/158286/files#diff-49473dca262eeab3b4a43002adb08b4db31020d190caaad1594b47f1d5daa810
https://github.com/python/cpython/pull/158286/files#diff-49473dca262eeab3b4a43002adb08b4db31020d190caaad1594b47f1d5daa810
Please reload this pagehttps://github.com/python/cpython/pull/158286/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.