René's URL Explorer Experiment


Title: Proposal: Native `char` type for fast char ops in mypyc · Issue #21418 · python/mypy · GitHub

Open Graph Title: Proposal: Native `char` type for fast char ops in mypyc · Issue #21418 · python/mypy

X Title: Proposal: Native `char` type for fast char ops in mypyc · Issue #21418 · python/mypy

Description: Feature Add mypy_extensions.char as a mypyc native type for one Unicode codepoint, stored unboxed as int32. Models the existing i64 / i32 / i16 / u8 pattern, applied to str. Pitch CPython already has codepoint-classification macros (Py_U...

Open Graph Description: Feature Add mypy_extensions.char as a mypyc native type for one Unicode codepoint, stored unboxed as int32. Models the existing i64 / i32 / i16 / u8 pattern, applied to str. Pitch CPython already h...

X Description: Feature Add mypy_extensions.char as a mypyc native type for one Unicode codepoint, stored unboxed as int32. Models the existing i64 / i32 / i16 / u8 pattern, applied to str. Pitch CPython already h...

Opengraph URL: https://github.com/python/mypy/issues/21418

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Proposal: Native `char` type for fast char ops in mypyc","articleBody":"### **Feature**\n\nAdd `mypy_extensions.char` as a mypyc native type for one Unicode codepoint, stored unboxed as `int32`. Models the existing `i64` / `i32` / `i16` / `u8` pattern, applied to `str`.\n\n\n### **Pitch**\n\nCPython already has codepoint-classification macros (`Py_UNICODE_ISALNUM`, `Py_UNICODE_ISSPACE`, `Py_UNICODE_TOUPPER`, etc.) that take an integer codepoint. The current str-method path goes through a 1-character `PyUnicode` only to dispatch into those same macros; `char` skips the round trip. The result is that `PyObject` operations, refcount pairs etc collapse to inlined integer ops. \n\n\nConsider this function which scans forward while the char is part of a word (could be part of a lexer):\n\n```python3\ndef find_word_end(s: str, start: int) -> int:\n    i = start\n    while i \u003c len(s):\n        c = s[i]\n        if not (c.isalnum() or c == '_'):\n            return i\n        i += 1\n    return i\n```\n\n\u003cbr />\n\n**Today**, with `c: str` inferred, the loop body lowers to roughly:\n\n```c\nPyObject *t = CPyStr_GetItem(s, i);    // cache lookup, INCREF\nint alnum = CPyStr_IsAlnum(t);         // method dispatch on the 1-char str\nint eq = CPyStr_Equal(t, underscore);  // string compare\nPy_DECREF(t);                          // refcount op\n```\n\n\u003cbr />\n\n\n**With `c: char = s[i]`** (the proposed type), the same body lowers to:\n\n```c\nint32_t c = CPyStr_GetCharAt(s, i);  // inlined PyUnicode_READ\nint alnum = Py_UNICODE_ISALNUM(c);   // inline macro on int32\nint eq = (c == '_');                  // int compare\n```\n\n\u003cbr />\n\nSpeedups from a [working prototype](https://github.com/VaggelisD/sqlglot-mypy/commit/b3fbc77600e53c51dfcd3a9cb5addacd835fc72b), both columns mypyc-compiled:\n\n| Workload | Speedup |\n|---|---:|\n| `c.isspace()` per char | 3.27x |\n| `c.isdigit()` per char | 1.63x |\n| ASCII `c.upper()` | 10.92x |\n| Identifier validator (tokenizer-shaped) | 1.57x |\n| Token classifier (lexer inner loop) | 2.12x |\n\n\u003cbr />\n\nNote: On Latin-1 text (most source-code-like input), `s[i]` does not actually allocate, since CPython caches single-character strings under `U+0100`. The savings are refcount traffic, function-call overheads, and the codepoint-to-`PyObject`-and-back round trip that `s[i].method()` forces. For non-Latin-1 text the picture changes and `char` would pull further ahead.\n\nImplementation would follow the existing `i64` template: new rprimitive, the same type-promotion plumbing that makes `i64` and `int` interoperate, codepoint-taking method ops for the common `str` methods, and one IR pass to fold `s[i] -> char` into a direct int32 read. There are a couple of design choices to settle along the way (promotion direction, runtime class shape), but the question I'm asking here is whether the team is interested in the direction at all.\n","author":{"url":"https://github.com/VaggelisD","@type":"Person","name":"VaggelisD"},"datePublished":"2026-05-06T10:59:42Z","url":"https://github.com/python/mypy/issues/21418"}

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:d0d65333-b4c9-0289-0710-c45593783a49
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-id88D4:30263F:243827B:3153B29:6B0033F6
html-safe-nonce4ab8f8ae60415b83bb44d252143ee3b599e4ec93d3754d10216f6fc60f012251
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4OEQ0OjMwMjYzRjoyNDM4MjdCOjMxNTNCMjk6NkIwMDMzRjYiLCJ2aXNpdG9yX2lkIjoiNzc5Mzg0NDI2NzgzNDY4NDQwNiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacc43e38649a2ac4eafeef4246bd40ac9c5585961427b968a7733b9606e6801808
hovercard-subject-tagissue:4390792454
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/python/mypy/21418/issue_layout
twitter:imagehttps://opengraph.githubassets.com/fff51c0361147fa542812824bb7f049b9ebc9e8efddcaf246d9fc85fb2f6cdce/python/mypy/issues/21418
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/fff51c0361147fa542812824bb7f049b9ebc9e8efddcaf246d9fc85fb2f6cdce/python/mypy/issues/21418
og:image:altFeature Add mypy_extensions.char as a mypyc native type for one Unicode codepoint, stored unboxed as int32. Models the existing i64 / i32 / i16 / u8 pattern, applied to str. Pitch CPython already h...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameVaggelisD
hostnamegithub.com
expected-hostnamegithub.com
None7d0829bbde9e48b2486cb5dd6d147896eb01d32134627091f818958a935ef3f0
turbo-cache-controlno-preview
go-importgithub.com/python/mypy git https://github.com/python/mypy.git
octolytics-dimension-user_id1525981
octolytics-dimension-user_loginpython
octolytics-dimension-repository_id7053637
octolytics-dimension-repository_nwopython/mypy
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id7053637
octolytics-dimension-repository_network_root_nwopython/mypy
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasef3f3a43ca095cdea3abbb394112e971f9fdb94fa
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-nameissues

Links:

Skip to contenthttps://github.com/python/mypy/issues/21418#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fmypy%2Fissues%2F21418
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fmypy%2Fissues%2F21418
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=python%2Fmypy
Reloadhttps://github.com/python/mypy/issues/21418
Reloadhttps://github.com/python/mypy/issues/21418
Reloadhttps://github.com/python/mypy/issues/21418
pythonhttps://github.com/python
mypyhttps://github.com/python/mypy
Codehttps://github.com/python/mypy
Issues2.7k (2.7k)https://github.com/python/mypy/issues
Pull requests546 (546)https://github.com/python/mypy/pulls
Actionshttps://github.com/python/mypy/actions
Projectshttps://github.com/python/mypy/projects
Wikihttps://github.com/python/mypy/wiki
Security and qualityhttps://github.com/python/mypy/security
Insightshttps://github.com/python/mypy/insights
https://github.com/python/mypy
New issuehttps://github.com/login?return_to=https://github.com/python/mypy/issues/21418
New issuehttps://github.com/login?return_to=https://github.com/python/mypy/issues/21418
Proposal: Native char type for fast char ops in mypychttps://github.com/python/mypy/issues/21418#top
featurehttps://github.com/python/mypy/issues?q=state%3Aopen%20label%3A%22feature%22
https://github.com/VaggelisD
VaggelisDhttps://github.com/VaggelisD
on May 6, 2026https://github.com/python/mypy/issues/21418#issue-4390792454
working prototypehttps://github.com/VaggelisD/sqlglot-mypy/commit/b3fbc77600e53c51dfcd3a9cb5addacd835fc72b
VaggelisDhttps://github.com/VaggelisD
featurehttps://github.com/python/mypy/issues?q=state%3Aopen%20label%3A%22feature%22
on May 6, 2026https://github.com/python/mypy/issues/21418#event-25214883614
https://github.com/JukkaL
JukkaLhttps://github.com/JukkaL
on May 6, 2026https://github.com/python/mypy/issues/21418#issuecomment-4390061924
https://github.com/VaggelisD
VaggelisDhttps://github.com/VaggelisD
on May 7, 2026https://github.com/python/mypy/issues/21418#issuecomment-4398687425
VaggelisDhttps://github.com/VaggelisD
completedhttps://github.com/python/mypy/issues?q=is%3Aissue%20state%3Aclosed%20archived%3Afalse%20reason%3Acompleted
on May 7, 2026https://github.com/python/mypy/issues/21418#event-25268967176
p-sawickihttps://github.com/p-sawicki
on May 14, 2026https://github.com/python/mypy/issues/21418#event-25527873204
[mypyc] Add `librt.strings.isspace` char primitive (#21462)https://github.com/python/mypy/commit/d7f703625bcde2b26a3b16d1fe2919b093933e57
#21462https://github.com/python/mypy/pull/21462
d7f7036https://github.com/python/mypy/commit/d7f703625bcde2b26a3b16d1fe2919b093933e57
[mypyc] Add `librt.strings.isdigit` codepoint primitive (#21504)https://github.com/python/mypy/commit/d9f17fba251699162640b74cec74931b87c0c443
#21504https://github.com/python/mypy/pull/21504
d9f17fbhttps://github.com/python/mypy/commit/d9f17fba251699162640b74cec74931b87c0c443
[mypyc] Add `librt.strings.isalnum` codepoint primitive (#21509)https://github.com/python/mypy/commit/739a65244eb085703bc52e26326bd3a034e8076c
#21509https://github.com/python/mypy/pull/21509
739a652https://github.com/python/mypy/commit/739a65244eb085703bc52e26326bd3a034e8076c
[mypyc] Add `librt.strings.isalpha` codepoint primitive (#21521)https://github.com/python/mypy/commit/a9d2d1476a8ccad967a19f9d562f1703f51aae73
#21521https://github.com/python/mypy/pull/21521
a9d2d14https://github.com/python/mypy/commit/a9d2d1476a8ccad967a19f9d562f1703f51aae73
alicederynhttps://github.com/alicederyn
on May 20, 2026https://github.com/python/mypy/issues/21418#event-25762568911
[mypyc] Add `librt.strings.isalnum` codepoint primitive (python#21509)https://github.com/alicederyn/mypy/commit/8e458c20e01f06676c4f28ecebb684409d7917ea
python#21509https://github.com/python/mypy/pull/21509
8e458c2https://github.com/alicederyn/mypy/commit/8e458c20e01f06676c4f28ecebb684409d7917ea
p-sawickihttps://github.com/p-sawicki
on May 26, 2026https://github.com/python/mypy/issues/21418#event-25976818953
[mypyc] Add `librt.strings.isidentifier` codepoint primitive (#21522)https://github.com/python/mypy/commit/965dd31224bc2a0694e7343f927ff9c164b4b673
#21522https://github.com/python/mypy/pull/21522
965dd31https://github.com/python/mypy/commit/965dd31224bc2a0694e7343f927ff9c164b4b673
[mypyc] Add `librt.strings.toupper` and `tolower` codepoint primitives (https://github.com/python/mypy/commit/8f2d0f12ff1e475889d3a2f4de9b1e87a18425d2
8f2d0f1https://github.com/python/mypy/commit/8f2d0f12ff1e475889d3a2f4de9b1e87a18425d2
[mypyc] Specialize `s[i] == 'x'` to a codepoint int compare (#21579)https://github.com/python/mypy/commit/84a20bdbf993d6eb1bdfa9d4e5d26d7096a241db
#21579https://github.com/python/mypy/pull/21579
84a20bdhttps://github.com/python/mypy/commit/84a20bdbf993d6eb1bdfa9d4e5d26d7096a241db
Sign up for freehttps://github.com/signup?return_to=https://github.com/python/mypy/issues/21418
Sign in to commenthttps://github.com/login?return_to=https://github.com/python/mypy/issues/21418
featurehttps://github.com/python/mypy/issues?q=state%3Aopen%20label%3A%22feature%22
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.