René's URL Explorer Experiment


Title: Add Python 3.15 encoding normalization helper by youknowdot · Pull Request #9115 · RustPython/RustPython · GitHub

Open Graph Title: Add Python 3.15 encoding normalization helper by youknowdot · Pull Request #9115 · RustPython/RustPython

X Title: Add Python 3.15 encoding normalization helper by youknowdot · Pull Request #9115 · RustPython/RustPython

Description: I did not use AI to write the code of this patch. This PR follows our AI policy, using the maintainer exemption. Summary Extract the native _codecs._normalize_encoding helper from #8954, alongside the final Python 3.15 encodings.normalize_encoding delegation. Preserve ASCII case and dots, collapse other UTF-8 bytes to interior underscores, and validate the whole string before stopping normalization at NUL. Accept string subclasses and the encoding= keyword. The Python wrapper retains its existing non-ASCII deprecation warning and ASCII bytes support. Main already has that warning and the cache bound; this is not presented as a fix for an email warning. Registry lookup normalization/error messages are unchanged. No IDNA, punycode, bytearray, or other encoding module changes. CPython provenance Only Lib/encodings/__init__.py was updated, using the repository's actual exact-file workflow: python3 scripts/update_lib migrate /workspace/shared/cpython-315-final/Lib/encodings/__init__.py Source: CPython d220409a13b77de7a6c30abe16ea90db01528edc. Input and generated output are byte-identical: SHA256: 849a5e31effe6c647b6d526b92f2f063a67fac36e7750267f721f15e3693de08 Git blob: 169c48324f227bf51b88d8b2e1a6a9df39067533 The supported migrate command was chosen because copy-lib resolves the top-level package and would copy all of encodings. No manual Lib edits or new test skips were used. Native behavior was source-reviewed against final CPython _codecsmodule.c:1025–1062 and unicodeobject.c:3465–3513. Validation Passed: narrow release build, cargo build --release --locked --no-default-features --features threading,stdlib,stdio,importlib,host_env --bin rustpython -j 1. Passed: the new assertions appended to stdlib_codecs_wide.py, extracted by AST into a bounded script and run on the candidate RustPython binary with a 30-second timeout. The candidate encodings.__file__ was asserted. Covers positional/keyword/subclass binding, argument errors, case/dot preservation, punctuation collapse, Unicode, NUL, surrogate-after-NUL validation, native warning absence, and wrapper warning/bytes behavior. Passed: strict VM Clippy, cargo clippy --release --locked -p rustpython-vm --no-default-features --features compiler,threading,host_env -j 1 -- -D warnings. Passed: normal configured pre-commit hooks during the local commit (merge conflicts, ruff format/check, rustfmt, cspell). Independently source-reviewed the exact patch and update_lib provenance. Not run: the pre-existing whole codec snippet, pytest/full snippet suite, full codecs test suites, workspace/C-API tests, all-target Clippy, WASM, or a CPython 3.15 runtime oracle. These are focused automated results, not full-suite or platform validation. AI assistance OpenAI Codex extracted and source-reviewed the implementation, ran the library update tool, wrote bounded regression assertions, and performed the automated checks listed above. This contribution is made under the maintainer exemption. No human manual testing is claimed.

Open Graph Description: I did not use AI to write the code of this patch. This PR follows our AI policy, using the maintainer exemption. Summary Extract the native _codecs._normalize_encoding helper from #8954, alongsid...

X Description: I did not use AI to write the code of this patch. This PR follows our AI policy, using the maintainer exemption. Summary Extract the native _codecs._normalize_encoding helper from #8954, alongsid...

Opengraph URL: https://github.com/RustPython/RustPython/pull/9115

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:13f16085-6c71-6249-546e-1f51e3712f9a
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idB63C:2E7EBB:3E026AD:4E7C81D:6B020366
html-safe-noncec66d8230b4d845ba8de8b883b0855cc100355303245f9a2c94ea6fb7c9cdedec
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCNjNDOjJFN0VCQjozRTAyNkFEOjRFN0M4MUQ6NkIwMjAzNjYiLCJ2aXNpdG9yX2lkIjoiMjg2NjIxMTM0NTQ4ODAyMDMyNiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac887b9316cd9466cc7f1c67f823e497941a9d6b60c755b864189ce1e092e16552
hovercard-subject-tagpull_request:4856956094
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/RustPython/RustPython/pull/9115/files
twitter:imagehttps://avatars.githubusercontent.com/u/336763669?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/336763669?s=400&v=4
og:image:altI did not use AI to write the code of this patch. This PR follows our AI policy, using the maintainer exemption. Summary Extract the native _codecs._normalize_encoding helper from #8954, alongsid...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/RustPython/RustPython git https://github.com/RustPython/RustPython.git
octolytics-dimension-user_id39710557
octolytics-dimension-user_loginRustPython
octolytics-dimension-repository_id135201145
octolytics-dimension-repository_nwoRustPython/RustPython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id135201145
octolytics-dimension-repository_network_root_nwoRustPython/RustPython
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/RustPython/RustPython/pull/9115/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FRustPython%2FRustPython%2Fpull%2F9115%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FRustPython%2FRustPython%2Fpull%2F9115%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=RustPython%2FRustPython
Reloadhttps://github.com/RustPython/RustPython/pull/9115/files
Reloadhttps://github.com/RustPython/RustPython/pull/9115/files
Reloadhttps://github.com/RustPython/RustPython/pull/9115/files
RustPythonhttps://github.com/RustPython
RustPythonhttps://github.com/RustPython/RustPython
Codehttps://github.com/RustPython/RustPython
Issues195 (195)https://github.com/RustPython/RustPython/issues
Pull requests133 (133)https://github.com/RustPython/RustPython/pulls
Discussionshttps://github.com/RustPython/RustPython/discussions
Actionshttps://github.com/RustPython/RustPython/actions
Projectshttps://github.com/RustPython/RustPython/projects
Wikihttps://github.com/RustPython/RustPython/wiki
Security and qualityhttps://github.com/RustPython/RustPython/security
Insightshttps://github.com/RustPython/RustPython/insights
Sign up for GitHub https://github.com/signup?return_to=%2FRustPython%2FRustPython%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2FRustPython%2FRustPython%2Fissues%2Fnew%2Fchoose
youknowonehttps://github.com/youknowone
RustPython:mainhttps://github.com/RustPython/RustPython/tree/main
youknowdot:split-codec-normalization-315https://github.com/youknowdot/RustPython/tree/split-codec-normalization-315
Conversation 5 https://github.com/RustPython/RustPython/pull/9115
Commits 1 https://github.com/RustPython/RustPython/pull/9115/commits
Checks 29 https://github.com/RustPython/RustPython/pull/9115/checks
Files changed https://github.com/RustPython/RustPython/pull/9115/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9115/files
Add Python 3.15 encoding normalization helper https://github.com/RustPython/RustPython/pull/9115/files#top
Show all changes 1 commit https://github.com/RustPython/RustPython/pull/9115/files
a93f8f8 Add Python 3.15 encoding normalization helper youknowdot Oct 14, 2026 https://github.com/RustPython/RustPython/pull/9115/commits/a93f8f85feee011a5a7413fec4e8e8679f2c1524
Clear filters https://github.com/RustPython/RustPython/pull/9115/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9115/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9115/files
__init__.py https://github.com/RustPython/RustPython/pull/9115/files#diff-38af5bbf673bff3d4ba85c8191e4c2ecc36bfa5da5946e2e32fb70abe005c452
_codecs.rs https://github.com/RustPython/RustPython/pull/9115/files#diff-b2a9b9730c8278dc0964ea9e0b1fb0d3dc472e23ce20b5264bba3f1f6c585226
stdlib_codecs_wide.py https://github.com/RustPython/RustPython/pull/9115/files#diff-df0602b393096da9a8fc2f562042275fc9c05c41de86cc46e2e699b9a0b47df9
Lib/encodings/__init__.pyhttps://github.com/RustPython/RustPython/pull/9115/files#diff-38af5bbf673bff3d4ba85c8191e4c2ecc36bfa5da5946e2e32fb70abe005c452
View file https://github.com/youknowdot/RustPython/blob/a93f8f85feee011a5a7413fec4e8e8679f2c1524/Lib/encodings/__init__.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9115/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9115/files#diff-38af5bbf673bff3d4ba85c8191e4c2ecc36bfa5da5946e2e32fb70abe005c452
https://github.com/RustPython/RustPython/pull/9115/files#diff-38af5bbf673bff3d4ba85c8191e4c2ecc36bfa5da5946e2e32fb70abe005c452
https://github.com/RustPython/RustPython/pull/9115/files#diff-38af5bbf673bff3d4ba85c8191e4c2ecc36bfa5da5946e2e32fb70abe005c452
https://github.com/RustPython/RustPython/pull/9115/files#diff-38af5bbf673bff3d4ba85c8191e4c2ecc36bfa5da5946e2e32fb70abe005c452
crates/vm/src/stdlib/_codecs.rshttps://github.com/RustPython/RustPython/pull/9115/files#diff-b2a9b9730c8278dc0964ea9e0b1fb0d3dc472e23ce20b5264bba3f1f6c585226
View file https://github.com/youknowdot/RustPython/blob/a93f8f85feee011a5a7413fec4e8e8679f2c1524/crates/vm/src/stdlib/_codecs.rs
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9115/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9115/files#diff-b2a9b9730c8278dc0964ea9e0b1fb0d3dc472e23ce20b5264bba3f1f6c585226
https://github.com/RustPython/RustPython/pull/9115/files#diff-b2a9b9730c8278dc0964ea9e0b1fb0d3dc472e23ce20b5264bba3f1f6c585226
extra_tests/snippets/stdlib_codecs_wide.pyhttps://github.com/RustPython/RustPython/pull/9115/files#diff-df0602b393096da9a8fc2f562042275fc9c05c41de86cc46e2e699b9a0b47df9
View file https://github.com/youknowdot/RustPython/blob/a93f8f85feee011a5a7413fec4e8e8679f2c1524/extra_tests/snippets/stdlib_codecs_wide.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9115/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9115/files#diff-df0602b393096da9a8fc2f562042275fc9c05c41de86cc46e2e699b9a0b47df9
chatgpt-codex-connectorhttps://github.com/apps/chatgpt-codex-connector
Oct 14, 2026https://github.com/RustPython/RustPython/pull/9115/files#r4273188212
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
https://camo.githubusercontent.com/a08bbb8a949f7033433a88444eeae385ff6a5e599d92f878fb05fa85707b7816/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f50312d6f72616e67653f7374796c653d666c6174
AGENTS.md:L273-L279https://github.com/RustPython/RustPython/blob/a93f8f85feee011a5a7413fec4e8e8679f2c1524/AGENTS.md#L273-L279
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9115/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9115/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.