René's URL Explorer Experiment

Title: Extract shared `rustpython-unicode` crate and route core Unicode semantics through it by Copilot · Pull Request #7561 · RustPython/RustPython · GitHub

Open Graph Title: Extract shared `rustpython-unicode` crate and route core Unicode semantics through it by Copilot · Pull Request #7561 · RustPython/RustPython

X Title: Extract shared `rustpython-unicode` crate and route core Unicode semantics through it by Copilot · Pull Request #7561 · RustPython/RustPython

Description: This change introduces a shared rustpython-unicode crate to own CPython-aligned Unicode semantics and data access, instead of keeping that logic spread across str, regex, literal escaping, and unicodedata. The goal is to make Unicode behavior reusable across RustPython components while preserving higher-level string behavior in existing runtime crates. New shared Unicode crate Adds crates/unicode with low-level, reusable APIs for: character classification identifier predicates regex Unicode predicates case mapping / casefold helpers normalization unicodedata-style database lookups Keeps the API codepoint-oriented where needed and compatible with no_std consumers. Refactor core runtime call sites rustpython-vm now uses rustpython-unicode for: str.isdecimal() str.isspace() str.isprintable() str.isidentifier() WTF-8 lowercase / uppercase / casefold helpers rustpython-literal now uses the shared printable classification for repr/escape behavior. rustpython-sre_engine now routes its Unicode character-class and case helpers through the shared crate. Thin unicodedata integration crates/stdlib/src/unicodedata.rs now delegates reusable Unicode database and normalization operations to rustpython-unicode. This keeps module behavior in place while moving the underlying data/semantics into the shared layer. Focused coverage Adds unit coverage in rustpython-unicode for classification, identifiers, regex predicates, case mapping, normalization, and Unicode database access. Adds a RustPython snippet covering integration across str, re, and unicodedata. Example of the new shared API shape: use rustpython_unicode::{classify, identifier, normalize::NormalizeForm, normalize}; assert!(classify::is_decimal('५' as u32)); assert!(identifier::is_python_identifier("유니코드")); let text = rustpython_wtf8::Wtf8Buf::from("e\u{301}"); let normalized = normalize::normalize(NormalizeForm::Nfc, &text); assert_eq!(normalized, rustpython_wtf8::Wtf8Buf::from("é"));

Open Graph Description: This change introduces a shared rustpython-unicode crate to own CPython-aligned Unicode semantics and data access, instead of keeping that logic spread across str, regex, literal escaping, and unic...

X Description: This change introduces a shared rustpython-unicode crate to own CPython-aligned Unicode semantics and data access, instead of keeping that logic spread across str, regex, literal escaping, and unic...

Opengraph URL: https://github.com/RustPython/RustPython/pull/7561

X: @github

direct link

Domain: github.com

Links:

Viewport: width=device-width