René's URL Explorer Experiment


Title: gh-161145: Use _Py_find_first_nonascii in the tokenizer by cmaloney · Pull Request #161146 · python/cpython · GitHub

Open Graph Title: gh-161145: Use _Py_find_first_nonascii in the tokenizer by cmaloney · Pull Request #161146 · python/cpython

X Title: gh-161145: Use _Py_find_first_nonascii in the tokenizer by cmaloney · Pull Request #161146 · python/cpython

Description: The Python programming language. Contribute to python/cpython development by creating an account on GitHub.

Open Graph Description: Skip sequence of ASCII at once rather than one char per loop reusing faster code from unicodeobject. Can't use the checking from stringlib or unicodeobject fully because those assume copying/wr...

X Description: Skip sequence of ASCII at once rather than one char per loop reusing faster code from unicodeobject. Can't use the checking from stringlib or unicodeobject fully because those assume copyin...

Opengraph URL: https://github.com/python/cpython/pull/161146

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:6572fe05-1301-e3c9-4d8f-5dc356be6fac
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idCF5C:97D39:107CC28:15BA666:6B021069
html-safe-nonce84e68793424a9b722e747f82a410cb1425db70ae4a4057c8cb0254b2d8c9a68b
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDRjVDOjk3RDM5OjEwN0NDMjg6MTVCQTY2Njo2QjAyMTA2OSIsInZpc2l0b3JfaWQiOiI1MDUwMDI3NDk2MjM0NDIyMzc3IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmacbfb55703b12c6c39e4462c4062a3c31642f4ebbccbf065c332f3b6c424e6e430
hovercard-subject-tagpull_request:5112600902
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/python/cpython/161146/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/a8506b8022b911b3d4feb78a10b9251de2a7a4bd250ffd9101079b6b6f45ea29/python/cpython/pull/161146
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/a8506b8022b911b3d4feb78a10b9251de2a7a4bd250ffd9101079b6b6f45ea29/python/cpython/pull/161146
og:image:altSkip sequence of ASCII at once rather than one char per loop reusing faster code from unicodeobject. Can't use the checking from stringlib or unicodeobject fully because those assume copying/wr...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamecmaloney
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-cache
go-importgithub.com/python/cpython git https://github.com/python/cpython.git
octolytics-dimension-user_id1525981
octolytics-dimension-user_loginpython
octolytics-dimension-repository_id81598961
octolytics-dimension-repository_nwopython/cpython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id81598961
octolytics-dimension-repository_network_root_nwopython/cpython
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/python/cpython/pull/161146#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fpull%2F161146
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fpull%2F161146
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=python%2Fcpython
Reloadhttps://github.com/python/cpython/pull/161146
Reloadhttps://github.com/python/cpython/pull/161146
Reloadhttps://github.com/python/cpython/pull/161146
pythonhttps://github.com/python
cpythonhttps://github.com/python/cpython
Codehttps://github.com/python/cpython
Issues5k+ (5k+)https://github.com/python/cpython/issues
Pull requests2.4k (2.4k)https://github.com/python/cpython/pulls
Actionshttps://github.com/python/cpython/actions
Projectshttps://github.com/python/cpython/projects
Security and qualityhttps://github.com/python/cpython/security
Insightshttps://github.com/python/cpython/insights
https://github.com/python/cpython
cmaloneyhttps://github.com/cmaloney
python:mainhttps://github.com/python/cpython/tree/main
cmaloney:tokenizer_ascii_scanhttps://github.com/cmaloney/cpython/tree/tokenizer_ascii_scan
Conversationhttps://github.com/python/cpython/pull/161146
Commits2 (2)https://github.com/python/cpython/pull/161146/commits
Checkshttps://github.com/python/cpython/pull/161146/checks
Files changedhttps://github.com/python/cpython/pull/161146/files
gh-161145: Use _Py_find_first_nonascii in the tokenizerhttps://github.com/python/cpython/pull/161146#top
cmaloneyhttps://github.com/cmaloney
python:mainhttps://github.com/python/cpython/tree/main
cmaloney:tokenizer_ascii_scanhttps://github.com/cmaloney/cpython/tree/tokenizer_ascii_scan
https://github.com/cmaloney
cmaloneyhttps://github.com/cmaloney
Nov 1, 2026https://github.com/python/cpython/pull/161146#issue-6153333390
Please reload this pagehttps://github.com/python/cpython/pull/161146
Speed up UTF-8 validation in tokenizer and ASCII scanning in UTF-8 decoding #161145https://github.com/python/cpython/issues/161145
Please reload this pagehttps://github.com/python/cpython/pull/161146
https://github.com/cmaloney
https://github.com/claude
pythongh-161145https://github.com/python/cpython/issues/161145
: Use _Py_find_first_nonascii in the tokenizerhttps://github.com/python/cpython/pull/161146/commits/ec3b950076d271580e8f6fb752ae11901283c1da
ec3b950https://github.com/python/cpython/pull/161146/commits/ec3b950076d271580e8f6fb752ae11901283c1da
https://github.com/cmaloney
cmaloneyhttps://github.com/cmaloney
lysnikolaouhttps://github.com/lysnikolaou
pablogsalhttps://github.com/pablogsal
code ownershttps://github.com/python/cpython/blob/4b21d154b4864531641f90e1b87108575e673d75/.github/CODEOWNERS#L309
November 1, 2026 23:21https://github.com/python/cpython/pull/161146#event-34860321199
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
awaiting review https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22awaiting%20review%22
type-feature https://github.com/python/cpython/issues?q=state%3Aopen%20label%3Atype-feature
Nov 1, 2026https://github.com/python/cpython/pull/161146#event-34860322838
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
Nov 1, 2026 https://github.com/python/cpython/pull/161146#ref-issue-6153216697
Speed up UTF-8 validation in tokenizer and ASCII scanning in UTF-8 decoding #161145 https://github.com/python/cpython/issues/161145
https://github.com/cmaloney
cmaloneyhttps://github.com/cmaloney
skip news https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22skip%20news%22
Nov 1, 2026https://github.com/python/cpython/pull/161146#event-34860373674
https://github.com/picnixz
picnixzhttps://github.com/picnixz
Nov 1, 2026https://github.com/python/cpython/pull/161146#issuecomment-6565460537
Please reload this pagehttps://github.com/python/cpython/pull/161146
https://github.com/cmaloney
cmaloneyhttps://github.com/cmaloney
Nov 1, 2026https://github.com/python/cpython/pull/161146#issuecomment-6565548094
Please reload this pagehttps://github.com/python/cpython/pull/161146
https://github.com/cmaloney
cmaloneyhttps://github.com/cmaloney
Nov 1, 2026https://github.com/python/cpython/pull/161146#issuecomment-6565793423
#153568https://github.com/python/cpython/issues/153568
Please reload this pagehttps://github.com/python/cpython/pull/161146
https://github.com/cmaloney
cmaloneyhttps://github.com/cmaloney
Nov 15, 2026 https://github.com/python/cpython/pull/161146#ref-pullrequest-6153417513
gh-161145: Test more bytes simultaneously in find_first_nonascii #161147 https://github.com/python/cpython/pull/161147
https://github.com/cmaloney
Merge branch 'main' into tokenizer_ascii_scanhttps://github.com/python/cpython/pull/161146/commits/f9eaf42706a664f0b54b9ccacda4b9fc908a902a
f9eaf42https://github.com/python/cpython/pull/161146/commits/f9eaf42706a664f0b54b9ccacda4b9fc908a902a
https://github.com/vstinner
vstinnerhttps://github.com/vstinner
Nov 15, 2026 https://github.com/python/cpython/pull/161146#pullrequestreview-5910550330
View reviewed changes https://github.com/python/cpython/pull/161146/files/f9eaf42706a664f0b54b9ccacda4b9fc908a902a
Parser/tokenizer/helpers.chttps://github.com/python/cpython/pull/161146/files/f9eaf42706a664f0b54b9ccacda4b9fc908a902a#diff-2f9c676ca7974a32907e7c98153e5942c869a80c67d2fd075acb5b589b45eddb
vstinnerhttps://github.com/vstinner
Nov 15, 2026https://github.com/python/cpython/pull/161146#discussion_r4578265838
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/python/cpython/pull/161146
https://github.com/vstinner
vstinnerhttps://github.com/vstinner
Nov 15, 2026https://github.com/python/cpython/pull/161146#issuecomment-6893986572
Please reload this pagehttps://github.com/python/cpython/pull/161146
https://github.com/cmaloney
cmaloneyhttps://github.com/cmaloney
Nov 19, 2026https://github.com/python/cpython/pull/161146#event-36690790400
https://github.co/hiddenchars
https://github.com/python/cpython/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fpull%2F161146
https://github.com/vstinner
vstinner https://github.com/vstinner
https://github.com/python/cpython/pull/161146/files/f9eaf42706a664f0b54b9ccacda4b9fc908a902a
https://github.com/pablogsal
pablogsal https://github.com/pablogsal
https://github.com/lysnikolaou
lysnikolaou https://github.com/lysnikolaou
Please reload this pagehttps://github.com/python/cpython/pull/161146
awaiting review https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22awaiting%20review%22
skip news https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22skip%20news%22
type-feature https://github.com/python/cpython/issues?q=state%3Aopen%20label%3Atype-feature
Please reload this pagehttps://github.com/python/cpython/pull/161146
https://github.com/cmaloney
https://github.com/picnixz
https://github.com/vstinner
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.