René's URL Explorer Experiment


Title: Fix string casing against the pinned Unicode database by youknowdot · Pull Request #9824 · RustPython/RustPython · GitHub

Open Graph Title: Fix string casing against the pinned Unicode database by youknowdot · Pull Request #9824 · RustPython/RustPython

X Title: Fix string casing against the pinned Unicode database by youknowdot · Pull Request #9824 · RustPython/RustPython

Description: Summary Use the project's pinned ICU Unicode data consistently for str.lower, str.upper, str.istitle, and the lowercase/uppercase portions of capitalize, title and swapcase. Preserve the ASCII VM fast paths and WTF-8 surrogate handling. Rust 1.100 ships Unicode 18 data, while CPython 3.15 and our Unicode database use Unicode 17. Mixing Rust's char/str case operations with ICU predicates makes test_unicodedata.UnicodeMethodsTest.test_method_checksum fail on main, independently of #9816 and #9820. For example, '\u0277'.upper() must remain unchanged with Unicode 17, but Rust's newer tables map it to U+A7DD. The existing Unicode build script generates compact full-mapping and contextual-property tables from ICU. Runtime casing uses immutable table lookups, including one-to-many mappings, and CPython's lower_ucs4 final-sigma context rules. Lone surrogates remain context boundaries. There is no runtime cache or toolchain-version exception, and no Lib test expectations change. A direct ICU runtime implementation was rejected after release benchmarks showed substantial Latin-text overhead. The generated-table implementation retains an ASCII-prefix path and statically dispatched character output. The tiny table/output helpers are inlined to avoid the measured call overhead. CPython reference: Objects/unicodeobject.c, v3.15.0 (lower_ucs4, do_upper_or_lower, do_swapcase, unicode_istitle_impl). Validation Reproduced main's exact checksum mismatch: a6f9fa98bde3bc2c24ab040ad9fe67b073971bbe versus 8b2615a9fc627676cbc0b6fac0191177df97ef5f. Unicode crate: 26 unit/integration tests passed, including all scalar values against ICU for generated lower/upper mappings and all four casing predicates; ASCII-prefix sigma/combining-mark and lone-surrogate cases included. Release microbenchmarks of actual helpers against Rust std, short and repeated Latin, mixed ASCII/non-ASCII, Greek, Deseret and Turkish/full-expansion inputs. Final Latin/mixed lower was 0.876–0.950 times baseline time, upper 0.856–1.002 times baseline. Other tested inputs were faster. Against the previous main helper implementations, title/capitalize/swapcase took 0.209–0.654 times baseline time on Latin, Greek, mixed and full-expansion inputs. These are microbenchmarks, not a universal speedup claim. Pure ASCII interpreter dispatch is unchanged. Independent source review completed. Commit hooks passed. Rebuilt the interpreter on main 9f6a743 plus this change. All 0x110000 code points matched CPython 3.15.2 for lower/upper/title/capitalize/swapcase/casefold/istitle, with additional sigma, case-ignorable and surrogate-context cases. -m test test_unicodedata test_str: 212 tests passed, 19 skipped. cargo clippy -p rustpython-unicode --all-targets -- -D warnings: passed. Workspace tests were attempted but the local filesystem filled while linking the call_between_rust_and_python example (ld Bus error), before aggregate tests ran. This is not recorded as a passing local aggregate run; the subsequent hosted runs below provide aggregate coverage. Workspace strict Clippy (--all-targets, excluding wasm/venvlauncher/capi, -D warnings): passed. Separate CAPI strict Clippy (--all-targets -- -D warnings): passed. Hosted CI run 43373063655 completed successfully on head 2012fb1b53d5205b806d5098a83adfb6db977a23: native Rust and Python tests on Ubuntu/macOS/Windows, WASI Python tests, WASM package, Miri, lint and remaining scheduled checks passed. Ubuntu CAPI build/tests/doctests steps were individually verified as successful. Conditional matrix/parity jobs were skipped by the workflow. AI-assisted implementation and verification with OpenAI Codex, with independent source review. Exact model version is not exposed in this environment.

Open Graph Description: Summary Use the project's pinned ICU Unicode data consistently for str.lower, str.upper, str.istitle, and the lowercase/uppercase portions of capitalize, title and swapcase. Preserve the ASCII ...

X Description: Summary Use the project's pinned ICU Unicode data consistently for str.lower, str.upper, str.istitle, and the lowercase/uppercase portions of capitalize, title and swapcase. Preserve the AS...

Opengraph URL: https://github.com/RustPython/RustPython/pull/9824

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:cb6fb861-e9d9-6f89-12ed-78cea7b0c0fe
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-id8E78:785A9:362E4AF:44CCA05:6B01E6B2
html-safe-nonce776eebc352e1332139800687b7aa5cfef5ac10a51fa31c90772d83bfcddf561d
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4RTc4Ojc4NUE5OjM2MkU0QUY6NDRDQ0EwNTo2QjAxRTZCMiIsInZpc2l0b3JfaWQiOiI5MTc0MTc1NDM0NTQyMjc4MzIyIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac983d3330a0c1b70c8d93830930280c7c47cfae495aab215912cf9bc024cb0911
hovercard-subject-tagpull_request:5290670676
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/RustPython/RustPython/pull/9824/files
twitter:imagehttps://avatars.githubusercontent.com/u/336763669?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/336763669?s=400&v=4
og:image:altSummary Use the project's pinned ICU Unicode data consistently for str.lower, str.upper, str.istitle, and the lowercase/uppercase portions of capitalize, title and swapcase. Preserve the ASCII ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Nonecc5dfdd32f62ebd3223cab3af3aa2b268d3605218237326a48a99d1efd89495c
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/RustPython/RustPython git https://github.com/RustPython/RustPython.git
octolytics-dimension-user_id39710557
octolytics-dimension-user_loginRustPython
octolytics-dimension-repository_id135201145
octolytics-dimension-repository_nwoRustPython/RustPython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id135201145
octolytics-dimension-repository_network_root_nwoRustPython/RustPython
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release8c77c9e8439031ad54c75a250694842892f693e1
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/RustPython/RustPython/pull/9824/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FRustPython%2FRustPython%2Fpull%2F9824%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FRustPython%2FRustPython%2Fpull%2F9824%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=RustPython%2FRustPython
Reloadhttps://github.com/RustPython/RustPython/pull/9824/files
Reloadhttps://github.com/RustPython/RustPython/pull/9824/files
Reloadhttps://github.com/RustPython/RustPython/pull/9824/files
RustPythonhttps://github.com/RustPython
RustPythonhttps://github.com/RustPython/RustPython
Codehttps://github.com/RustPython/RustPython
Issues195 (195)https://github.com/RustPython/RustPython/issues
Pull requests133 (133)https://github.com/RustPython/RustPython/pulls
Discussionshttps://github.com/RustPython/RustPython/discussions
Actionshttps://github.com/RustPython/RustPython/actions
Projectshttps://github.com/RustPython/RustPython/projects
Wikihttps://github.com/RustPython/RustPython/wiki
Security and qualityhttps://github.com/RustPython/RustPython/security
Insightshttps://github.com/RustPython/RustPython/insights
Sign up for GitHub https://github.com/signup?return_to=%2FRustPython%2FRustPython%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2FRustPython%2FRustPython%2Fissues%2Fnew%2Fchoose
youknowonehttps://github.com/youknowone
RustPython:mainhttps://github.com/RustPython/RustPython/tree/main
youknowdot:fix/unicode-casing-version-20261113https://github.com/youknowdot/RustPython/tree/fix/unicode-casing-version-20261113
Conversation 4 https://github.com/RustPython/RustPython/pull/9824
Commits 1 https://github.com/RustPython/RustPython/pull/9824/commits
Checks 19 https://github.com/RustPython/RustPython/pull/9824/checks
Files changed https://github.com/RustPython/RustPython/pull/9824/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9824/files
Fix string casing against the pinned Unicode database https://github.com/RustPython/RustPython/pull/9824/files#top
Show all changes 1 commit https://github.com/RustPython/RustPython/pull/9824/files
2012fb1 Fix string casing against the pinned Unicode database youknowdot Nov 13, 2026 https://github.com/RustPython/RustPython/pull/9824/commits/2012fb1b53d5205b806d5098a83adfb6db977a23
Clear filters https://github.com/RustPython/RustPython/pull/9824/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9824/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9824/files
Cargo.toml https://github.com/RustPython/RustPython/pull/9824/files#diff-7f3a442136bd9e1ed84129215164ccaecf56d1ce7aefe5cc0470be85acfe0a6d
build.rs https://github.com/RustPython/RustPython/pull/9824/files#diff-464cd88cda362800866919e2a54b4e6cb8c07f5ffed8c30fb1e03d41da07cb6c
case.rs https://github.com/RustPython/RustPython/pull/9824/files#diff-be3ce82912f4945758b0b76567641500bd0a493a61307e4b98743cf392591f6e
str.rs https://github.com/RustPython/RustPython/pull/9824/files#diff-a04ea1f7734fe40189e756196e034e6dedfcd5c82f2925e58cfd51ba7432073a
crates/unicode/Cargo.tomlhttps://github.com/RustPython/RustPython/pull/9824/files#diff-7f3a442136bd9e1ed84129215164ccaecf56d1ce7aefe5cc0470be85acfe0a6d
View file https://github.com/youknowdot/RustPython/blob/2012fb1b53d5205b806d5098a83adfb6db977a23/crates/unicode/Cargo.toml
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9824/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9824/files#diff-7f3a442136bd9e1ed84129215164ccaecf56d1ce7aefe5cc0470be85acfe0a6d
https://github.com/RustPython/RustPython/pull/9824/files#diff-7f3a442136bd9e1ed84129215164ccaecf56d1ce7aefe5cc0470be85acfe0a6d
crates/unicode/build.rshttps://github.com/RustPython/RustPython/pull/9824/files#diff-464cd88cda362800866919e2a54b4e6cb8c07f5ffed8c30fb1e03d41da07cb6c
View file https://github.com/youknowdot/RustPython/blob/2012fb1b53d5205b806d5098a83adfb6db977a23/crates/unicode/build.rs
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9824/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9824/files#diff-464cd88cda362800866919e2a54b4e6cb8c07f5ffed8c30fb1e03d41da07cb6c
https://github.com/RustPython/RustPython/pull/9824/files#diff-464cd88cda362800866919e2a54b4e6cb8c07f5ffed8c30fb1e03d41da07cb6c
https://github.com/RustPython/RustPython/pull/9824/files#diff-464cd88cda362800866919e2a54b4e6cb8c07f5ffed8c30fb1e03d41da07cb6c
https://github.com/RustPython/RustPython/pull/9824/files#diff-464cd88cda362800866919e2a54b4e6cb8c07f5ffed8c30fb1e03d41da07cb6c
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9824/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9824/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.