René's URL Explorer Experiment


Title: Scaling bottlenecks in the free-threaded build · Issue #118527 · python/cpython · GitHub

Open Graph Title: Scaling bottlenecks in the free-threaded build · Issue #118527 · python/cpython

X Title: Scaling bottlenecks in the free-threaded build · Issue #118527 · python/cpython

Description: There are a few remaining scaling bottlenecks in the free-threaded build that we should fix. I have been using the following benchmark to detect bottlenecks that were previously issues in older versions of the nogil forks: https://gist.g...

Open Graph Description: There are a few remaining scaling bottlenecks in the free-threaded build that we should fix. I have been using the following benchmark to detect bottlenecks that were previously issues in older ver...

X Description: There are a few remaining scaling bottlenecks in the free-threaded build that we should fix. I have been using the following benchmark to detect bottlenecks that were previously issues in older ver...

Opengraph URL: https://github.com/python/cpython/issues/118527

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Scaling bottlenecks in the free-threaded build","articleBody":"There are a few remaining scaling bottlenecks in the free-threaded build that we should fix.\r\n\r\nI have been using the following benchmark to detect bottlenecks that were previously issues in older versions of the nogil forks:\r\nhttps://gist.github.com/colesbury/429fe9f90036d43ad43576c3d357a12e\r\n\r\nNote that for reliable results the above benchmark requires some setup:\r\n\r\n* Adjust `NTHREADS` if necessary on your system \r\n* Disable [turbo boost](https://askubuntu.com/a/1163808) or equivalent on your system\r\n* Avoid running on hyper-threading siblings (i.e., use `taskset -c 0-\u003cN>` to choose separate physical cores)\r\n\r\n### Current bottlenecks\r\n\r\n* cmodule_function\r\n* load_string_const \r\n* load_tuple_const\r\n* create_closure\r\n\r\n### Underlying issues\r\n\r\n* Reference count contention on non-string constants. We will want to immortalize most constants in `PyCodeObject`.\r\n* Reference count contention on `func.__qualname__` or `code.co_qualname` (when creating closure)\r\n* Reference count contention on module-level `PyCFunctionObjects`\n\n\u003c!-- gh-linked-prs -->\n### Linked PRs\n* gh-118528\n* gh-118529\n* gh-118558\n* gh-118576\n* gh-118667\n\u003c!-- /gh-linked-prs -->\n","author":{"url":"https://github.com/colesbury","@type":"Person","name":"colesbury"},"datePublished":"2024-05-02T23:59:34Z","url":"https://github.com/python/cpython/issues/118527"}

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:36a6e2c8-fd5c-8357-8059-0e6ee0095d0d
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-idAD1C:62F48:1250982:1820C9B:6B021B85
html-safe-nonce22993b1971d3503a5eed1a28f6ce15d64569d7338cc8593aee1c996a3274e826
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBRDFDOjYyRjQ4OjEyNTA5ODI6MTgyMEM5Qjo2QjAyMUI4NSIsInZpc2l0b3JfaWQiOiI1NzA5MDg3NzY2Nzg5MzY0NjEzIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmacc190c8a77375e44d6558c5b320f4343879922ad87ba50c76f1aa31435f54d3d8
hovercard-subject-tagissue:2276683867
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/python/cpython/118527/issue_layout
twitter:imagehttps://opengraph.githubassets.com/cd7e1a503918c67c780b2143899538323bb8feefc7d111549971966e51f66382/python/cpython/issues/118527
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/cd7e1a503918c67c780b2143899538323bb8feefc7d111549971966e51f66382/python/cpython/issues/118527
og:image:altThere are a few remaining scaling bottlenecks in the free-threaded build that we should fix. I have been using the following benchmark to detect bottlenecks that were previously issues in older ver...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamecolesbury
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-preview
go-importgithub.com/python/cpython git https://github.com/python/cpython.git
octolytics-dimension-user_id1525981
octolytics-dimension-user_loginpython
octolytics-dimension-repository_id81598961
octolytics-dimension-repository_nwopython/cpython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id81598961
octolytics-dimension-repository_network_root_nwopython/cpython
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-nameissues

Links:

Skip to contenthttps://github.com/python/cpython/issues/118527#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fissues%2F118527
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fissues%2F118527
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=python%2Fcpython
Reloadhttps://github.com/python/cpython/issues/118527
Reloadhttps://github.com/python/cpython/issues/118527
Reloadhttps://github.com/python/cpython/issues/118527
pythonhttps://github.com/python
cpythonhttps://github.com/python/cpython
Codehttps://github.com/python/cpython
Issues5k+ (5k+)https://github.com/python/cpython/issues
Pull requests2.4k (2.4k)https://github.com/python/cpython/pulls
Actionshttps://github.com/python/cpython/actions
Projectshttps://github.com/python/cpython/projects
Security and qualityhttps://github.com/python/cpython/security
Insightshttps://github.com/python/cpython/insights
https://github.com/python/cpython
New issuehttps://github.com/login?return_to=https://github.com/python/cpython/issues/118527
New issuehttps://github.com/login?return_to=https://github.com/python/cpython/issues/118527
Scaling bottlenecks in the free-threaded buildhttps://github.com/python/cpython/issues/118527#top
topic-free-threadinghttps://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22topic-free-threading%22
https://github.com/colesbury
colesburyhttps://github.com/colesbury
on May 2, 2024https://github.com/python/cpython/issues/118527#issue-2276683867
https://gist.github.com/colesbury/429fe9f90036d43ad43576c3d357a12ehttps://gist.github.com/colesbury/429fe9f90036d43ad43576c3d357a12e
turbo boosthttps://askubuntu.com/a/1163808
gh-118527: Use _Py_ID(__main__) for main module name #118528https://github.com/python/cpython/pull/118528
gh-118527: Use deferred reference counting for C functions on modules #118529https://github.com/python/cpython/pull/118529
gh-118527: Intern filename, name, and qualname in code objects. #118558https://github.com/python/cpython/pull/118558
gh-118527: Intern code name and filename on default build #118576https://github.com/python/cpython/pull/118576
gh-118527: Intern code consts in free-threaded build #118667https://github.com/python/cpython/pull/118667
colesburyhttps://github.com/colesbury
topic-free-threadinghttps://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22topic-free-threading%22
on May 2, 2024https://github.com/python/cpython/issues/118527#event-12690498484
colesburyhttps://github.com/colesbury
on May 3, 2024https://github.com/python/cpython/issues/118527#event-12690548170
pythongh-118527: Use constant for `__main__` namehttps://github.com/colesbury/cpython/commit/1513a2bea07e93768165deb662cd2bae9f098b1e
pythongh-118527https://github.com/python/cpython/issues/118527
1513a2bhttps://github.com/colesbury/cpython/commit/1513a2bea07e93768165deb662cd2bae9f098b1e
pythongh-118527: Use deferred reference counting for C functions on m…https://github.com/colesbury/cpython/commit/11d421fad9b0c6d5e0b503eab19be8a7b70d4193
pythongh-118527https://github.com/python/cpython/issues/118527
11d421fhttps://github.com/colesbury/cpython/commit/11d421fad9b0c6d5e0b503eab19be8a7b70d4193
gh-118527: Use `_Py_ID(__main__)` for main module name (#118528)https://github.com/python/cpython/commit/24e643d4ef024a3561c927dc07c59c435bb27bcc
gh-118527https://github.com/python/cpython/issues/118527
#118528https://github.com/python/cpython/pull/118528
24e643dhttps://github.com/python/cpython/commit/24e643d4ef024a3561c927dc07c59c435bb27bcc
gh-118527: Use deferred reference counting for C functions on modules (…https://github.com/python/cpython/commit/608192ee2f6c60aaae1c6f2f64ea45ad2667ff2d
gh-118527https://github.com/python/cpython/issues/118527
…https://github.com/python/cpython/pull/118529
608192ehttps://github.com/python/cpython/commit/608192ee2f6c60aaae1c6f2f64ea45ad2667ff2d
pythongh-118527: Intern filename, name, and qualname in code objects.https://github.com/colesbury/cpython/commit/7aa1b1fd18da0df30de6adf5284831fcf2933b52
pythongh-118527https://github.com/python/cpython/issues/118527
7aa1b1fhttps://github.com/colesbury/cpython/commit/7aa1b1fd18da0df30de6adf5284831fcf2933b52
gh-118527: Intern filename, name, and qualname in code objects. (#118558https://github.com/python/cpython/commit/37c31bea72fb6971f1008faa2e253d12167c221f
gh-118527https://github.com/python/cpython/issues/118527
#118558https://github.com/python/cpython/pull/118558
37c31behttps://github.com/python/cpython/commit/37c31bea72fb6971f1008faa2e253d12167c221f
pythongh-118527: Intern code name and filename on default buildhttps://github.com/colesbury/cpython/commit/d27f1d1e75f341f6af57d8a255aa17a04d3aefad
pythongh-118527https://github.com/python/cpython/issues/118527
d27f1d1https://github.com/colesbury/cpython/commit/d27f1d1e75f341f6af57d8a255aa17a04d3aefad
pythongh-118527: Intern code consts in free-threaded buildhttps://github.com/colesbury/cpython/commit/c7f501567686027ba394de3ed0d79d0b47f48f6c
pythongh-118527https://github.com/python/cpython/issues/118527
c7f5015https://github.com/colesbury/cpython/commit/c7f501567686027ba394de3ed0d79d0b47f48f6c
pythongh-118527: Intern code consts in free-threaded buildhttps://github.com/colesbury/cpython/commit/8f7e58e7c89295ec385b3dc675e173011ee2498e
pythongh-118527https://github.com/python/cpython/issues/118527
8f7e58ehttps://github.com/colesbury/cpython/commit/8f7e58e7c89295ec385b3dc675e173011ee2498e
pythongh-118527: Intern code consts in free-threaded buildhttps://github.com/colesbury/cpython/commit/5e8c0f02ce90db20aef2062e09df5fcaef83b8ce
pythongh-118527https://github.com/python/cpython/issues/118527
5e8c0f0https://github.com/colesbury/cpython/commit/5e8c0f02ce90db20aef2062e09df5fcaef83b8ce
gh-118527: Intern code name and filename on default build (#118576)https://github.com/python/cpython/commit/2ba2c142a615abbd8138d253edfe02426c386961
gh-118527https://github.com/python/cpython/issues/118527
#118576https://github.com/python/cpython/pull/118576
2ba2c14https://github.com/python/cpython/commit/2ba2c142a615abbd8138d253edfe02426c386961
Merge branch 'main' into pythongh-118527-code-constshttps://github.com/colesbury/cpython/commit/e3893b5e47f2f0bf8edfe53d41a43ec33a1c2b9b
pythongh-118527https://github.com/python/cpython/issues/118527
e3893b5https://github.com/colesbury/cpython/commit/e3893b5e47f2f0bf8edfe53d41a43ec33a1c2b9b
gh-118527: Intern code consts in free-threaded build (#118667)https://github.com/python/cpython/commit/723d4d2fe8e77b398f0ccffcfa541149caaac6a1
gh-118527https://github.com/python/cpython/issues/118527
#118667https://github.com/python/cpython/pull/118667
723d4d2https://github.com/python/cpython/commit/723d4d2fe8e77b398f0ccffcfa541149caaac6a1
https://github.com/colesbury
colesburyhttps://github.com/colesbury
on May 7, 2024https://github.com/python/cpython/issues/118527#issuecomment-2098665558
colesburyhttps://github.com/colesbury
completedhttps://github.com/python/cpython/issues?q=is%3Aissue%20state%3Aclosed%20archived%3Afalse%20reason%3Acompleted
on May 7, 2024https://github.com/python/cpython/issues/118527#event-12731221730
SonicFieldhttps://github.com/SonicField
on May 8, 2024https://github.com/python/cpython/issues/118527#event-12745321171
pythongh-118527: Use `_Py_ID(__main__)` for main module name (python#…https://github.com/SonicField/cpython/commit/0fec708520c82b2a3082c9e03e5a811d548be73d
pythongh-118527https://github.com/python/cpython/issues/118527
python#…https://github.com/python/cpython/pull/118528
0fec708https://github.com/SonicField/cpython/commit/0fec708520c82b2a3082c9e03e5a811d548be73d
pythongh-118527: Use deferred reference counting for C functions on m…https://github.com/SonicField/cpython/commit/fcbfe02f291ad553762ad13f2280a48bdd6fba6e
pythongh-118527https://github.com/python/cpython/issues/118527
fcbfe02https://github.com/SonicField/cpython/commit/fcbfe02f291ad553762ad13f2280a48bdd6fba6e
pythongh-118527: Intern filename, name, and qualname in code objects. (…https://github.com/SonicField/cpython/commit/f104f9f6dcaf0af9eb3c58dfb0a8eb01cadf16d8
pythongh-118527https://github.com/python/cpython/issues/118527
…https://github.com/python/cpython/pull/118558
f104f9fhttps://github.com/SonicField/cpython/commit/f104f9f6dcaf0af9eb3c58dfb0a8eb01cadf16d8
pythongh-118527: Intern code name and filename on default build (pyth…https://github.com/SonicField/cpython/commit/a73f2a5010e2791c7daa7da10fa7ba3712091492
pythongh-118527https://github.com/python/cpython/issues/118527
pyth…https://github.com/python/cpython/pull/118576
a73f2a5https://github.com/SonicField/cpython/commit/a73f2a5010e2791c7daa7da10fa7ba3712091492
pythongh-118527: Intern code consts in free-threaded build (python#11…https://github.com/SonicField/cpython/commit/aca31c6fdfbbae120e83e8d5786d645fa50d3664
pythongh-118527https://github.com/python/cpython/issues/118527
python#11…https://github.com/python/cpython/pull/118667
aca31c6https://github.com/SonicField/cpython/commit/aca31c6fdfbbae120e83e8d5786d645fa50d3664
Sign up for freehttps://github.com/signup?return_to=https://github.com/python/cpython/issues/118527
Sign in to commenthttps://github.com/login?return_to=https://github.com/python/cpython/issues/118527
topic-free-threadinghttps://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22topic-free-threading%22
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.