René's URL Explorer Experiment


Title: History for Python/Python-tokenize.c - lpyu001/cpython · GitHub

Open Graph Title: History for Python/Python-tokenize.c - lpyu001/cpython

X Title: History for Python/Python-tokenize.c - lpyu001/cpython

Description: The Python programming language. Contribute to lpyu001/cpython development by creating an account on GitHub.

Open Graph Description: The Python programming language. Contribute to lpyu001/cpython development by creating an account on GitHub.

X Description: The Python programming language. Contribute to lpyu001/cpython development by creating an account on GitHub.

Opengraph URL: https://github.com/lpyu001/cpython

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/commits(/*name)
route-controllercommits
route-actionshow
fetch-noncev2:da4d98eb-2e81-131a-f04a-164286c64ac9
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idE7D0:19E4BB:4653985:5980ED5:6B024510
html-safe-nonce2482a37d1b5110ca6ab564ebe57d1f1e2891e85b9d2ba24b83c489b8166200ae
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFN0QwOjE5RTRCQjo0NjUzOTg1OjU5ODBFRDU6NkIwMjQ1MTAiLCJ2aXNpdG9yX2lkIjoiMzAyMDQ3Mzk1MTEyNDM3MDA4IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac47d7ada0b22b98be026609bf513f4cc9cf6ee1a67a46f4e50277d5d9a08a003d
hovercard-subject-tagrepository:1233452867
github-keyboard-shortcutsrepository,commit-list,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///commits/show
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/lpyu001/cpython/commits/string_parser/Python/Python-tokenize.c
twitter:imagehttps://opengraph.githubassets.com/e551c09b3e845cccbdb31e2c7d34d0e50429e30c2807b3f29a635baff8c331d9/lpyu001/cpython
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/e551c09b3e845cccbdb31e2c7d34d0e50429e30c2807b3f29a635baff8c331d9/lpyu001/cpython
og:image:altThe Python programming language. Contribute to lpyu001/cpython development by creating an account on GitHub.
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-cache
go-importgithub.com/lpyu001/cpython git https://github.com/lpyu001/cpython.git
octolytics-dimension-user_id189712014
octolytics-dimension-user_loginlpyu001
octolytics-dimension-repository_id1233452867
octolytics-dimension-repository_nwolpyu001/cpython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id81598961
octolytics-dimension-repository_parent_nwopython/cpython
octolytics-dimension-repository_network_root_id81598961
octolytics-dimension-repository_network_root_nwopython/cpython
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namecommits

Links:

Skip to contenthttps://github.com/lpyu001/cpython/commits/string_parser/Python/Python-tokenize.c#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Flpyu001%2Fcpython%2Fcommits%2Fstring_parser%2FPython%2FPython-tokenize.c
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Flpyu001%2Fcpython%2Fcommits%2Fstring_parser%2FPython%2FPython-tokenize.c
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fcommits%2Fshow&source=header-repo&source_repo=lpyu001%2Fcpython
Reloadhttps://github.com/lpyu001/cpython/commits/string_parser/Python/Python-tokenize.c
Reloadhttps://github.com/lpyu001/cpython/commits/string_parser/Python/Python-tokenize.c
Reloadhttps://github.com/lpyu001/cpython/commits/string_parser/Python/Python-tokenize.c
lpyu001https://github.com/lpyu001
cpythonhttps://github.com/lpyu001/cpython
Codehttps://github.com/lpyu001/cpython
Pull requestshttps://github.com/lpyu001/cpython/pulls
Actionshttps://github.com/lpyu001/cpython/actions
Projectshttps://github.com/lpyu001/cpython/projects
Security and qualityhttps://github.com/lpyu001/cpython/security
Insightshttps://github.com/lpyu001/cpython/pulse
https://github.com/lpyu001/cpython
cpythonhttps://github.com/lpyu001/cpython/commits
Pythonhttps://github.com/lpyu001/cpython/commits/string_parser/Python
Python-tokenize.chttps://github.com/lpyu001/cpython/commits/string_parser/Python/Python-tokenize.c
string_parserhttps://github.com/lpyu001/cpython/tree/string_parser
gh-153569: hide tokenizer state behind token and source operations (#156654)https://github.com/lpyu001/cpython/commit/7bfa97f4dca58ab45def2ca0a1e8088997a4fa0b
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
7bfa97fhttps://github.com/lpyu001/cpython/commit/7bfa97f4dca58ab45def2ca0a1e8088997a4fa0b
https://github.com/lpyu001/cpython/blob/7bfa97f4dca58ab45def2ca0a1e8088997a4fa0b/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/7bfa97f4dca58ab45def2ca0a1e8088997a4fa0b
gh-153569: centralize formatted-string state and source spans (#156484)https://github.com/lpyu001/cpython/commit/2ddc218b20625ef4a6293aee3696e605c6bac5b9
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
2ddc218https://github.com/lpyu001/cpython/commit/2ddc218b20625ef4a6293aee3696e605c6bac5b9
https://github.com/lpyu001/cpython/blob/2ddc218b20625ef4a6293aee3696e605c6bac5b9/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/2ddc218b20625ef4a6293aee3696e605c6bac5b9
gh-153569: return token spans and unify decoded source storage (#156482)https://github.com/lpyu001/cpython/commit/09117bc3173b6854f3d614fb0efe79bca4b4cc63
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
09117bchttps://github.com/lpyu001/cpython/commit/09117bc3173b6854f3d614fb0efe79bca4b4cc63
https://github.com/lpyu001/cpython/blob/09117bc3173b6854f3d614fb0efe79bca4b4cc63/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/09117bc3173b6854f3d614fb0efe79bca4b4cc63
gh-153569: Unify tokenizer input readers (#156472)https://github.com/lpyu001/cpython/commit/f5dbcbafaea6b4243e7a92861ad56c5ce5e66308
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
f5dbcbahttps://github.com/lpyu001/cpython/commit/f5dbcbafaea6b4243e7a92861ad56c5ce5e66308
https://github.com/lpyu001/cpython/blob/f5dbcbafaea6b4243e7a92861ad56c5ce5e66308/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/f5dbcbafaea6b4243e7a92861ad56c5ce5e66308
gh-128341: Use _Py_ABI_SLOT in stdlib modules (#145770)https://github.com/lpyu001/cpython/commit/1887a95f515274868be31b27231dfcbfc055f03c
befelemehttps://github.com/lpyu001/cpython/commits?author=befeleme
vstinnerhttps://github.com/lpyu001/cpython/commits?author=vstinner
1887a95https://github.com/lpyu001/cpython/commit/1887a95f515274868be31b27231dfcbfc055f03c
https://github.com/lpyu001/cpython/blob/1887a95f515274868be31b27231dfcbfc055f03c/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/1887a95f515274868be31b27231dfcbfc055f03c
GH-145247: Use _PyTuple_FromPair in Parser and Python (#145842)https://github.com/lpyu001/cpython/commit/d19de375a204c74ab5f3a28ec42335bae139033d
https://github.com/sergey-miryanov
sergey-miryanovhttps://github.com/lpyu001/cpython/commits?author=sergey-miryanov
d19de37https://github.com/lpyu001/cpython/commit/d19de375a204c74ab5f3a28ec42335bae139033d
https://github.com/lpyu001/cpython/blob/d19de375a204c74ab5f3a28ec42335bae139033d/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/d19de375a204c74ab5f3a28ec42335bae139033d
gh-111178: Fix function signatures for test_types (#131455)https://github.com/lpyu001/cpython/commit/bbe5baad6c84615aa9a4473b1391137c1db3403b
https://github.com/vstinner
vstinnerhttps://github.com/lpyu001/cpython/commits?author=vstinner
bbe5baahttps://github.com/lpyu001/cpython/commit/bbe5baad6c84615aa9a4473b1391137c1db3403b
https://github.com/lpyu001/cpython/blob/bbe5baad6c84615aa9a4473b1391137c1db3403b/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/bbe5baad6c84615aa9a4473b1391137c1db3403b
gh-115754: Use Py_GetConstant(Py_CONSTANT_EMPTY_STR) (#125194)https://github.com/lpyu001/cpython/commit/b9a8ca0a6aa9251cb798f34f0c9d2cc95107eec6
https://github.com/vstinner
vstinnerhttps://github.com/lpyu001/cpython/commits?author=vstinner
b9a8ca0https://github.com/lpyu001/cpython/commit/b9a8ca0a6aa9251cb798f34f0c9d2cc95107eec6
https://github.com/lpyu001/cpython/blob/b9a8ca0a6aa9251cb798f34f0c9d2cc95107eec6/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/b9a8ca0a6aa9251cb798f34f0c9d2cc95107eec6
gh-120317: Lock around global state in the tokenize module (#120318)https://github.com/lpyu001/cpython/commit/8549559f383dfcc0ad0c32496f62a4b737c05b4f
lysnikolaouhttps://github.com/lpyu001/cpython/commits?author=lysnikolaou
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
8549559https://github.com/lpyu001/cpython/commit/8549559f383dfcc0ad0c32496f62a4b737c05b4f
https://github.com/lpyu001/cpython/blob/8549559f383dfcc0ad0c32496f62a4b737c05b4f/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/8549559f383dfcc0ad0c32496f62a4b737c05b4f
gh-120343: Fix column offsets of multiline tokens in tokenize (#120391)https://github.com/lpyu001/cpython/commit/4b5d3e0e721a952f4ac9d17bee331e6dfe543dcd
https://github.com/lysnikolaou
lysnikolaouhttps://github.com/lpyu001/cpython/commits?author=lysnikolaou
4b5d3e0https://github.com/lpyu001/cpython/commit/4b5d3e0e721a952f4ac9d17bee331e6dfe543dcd
https://github.com/lpyu001/cpython/blob/4b5d3e0e721a952f4ac9d17bee331e6dfe543dcd/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/4b5d3e0e721a952f4ac9d17bee331e6dfe543dcd
gh-120343: Do not reset byte_col_offset_diff after multiline tokens (#120352)https://github.com/lpyu001/cpython/commit/1b62bcee941e54244b3ce6476aef8913604987c9
lysnikolaouhttps://github.com/lpyu001/cpython/commits?author=lysnikolaou
blurb-it[bot]https://github.com/lpyu001/cpython/commits?author=blurb-it%5Bbot%5D
1b62bcehttps://github.com/lpyu001/cpython/commit/1b62bcee941e54244b3ce6476aef8913604987c9
https://github.com/lpyu001/cpython/blob/1b62bcee941e54244b3ce6476aef8913604987c9/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/1b62bcee941e54244b3ce6476aef8913604987c9
gh-119704: Fix reference leak in the ``Python/Python-tokenize.c`` (#119705)https://github.com/lpyu001/cpython/commit/c0faade891e6ccb61137041fe10cc05e5fa8d534
https://github.com/Eclips4
Eclips4https://github.com/lpyu001/cpython/commits?author=Eclips4
c0faadehttps://github.com/lpyu001/cpython/commit/c0faade891e6ccb61137041fe10cc05e5fa8d534
https://github.com/lpyu001/cpython/blob/c0faade891e6ccb61137041fe10cc05e5fa8d534/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/c0faade891e6ccb61137041fe10cc05e5fa8d534
gh-119118: Fix performance regression in tokenize module (#119615)https://github.com/lpyu001/cpython/commit/d87b0151062e36e67f9e42e1595fba5bf23a485c
lysnikolaouhttps://github.com/lpyu001/cpython/commits?author=lysnikolaou
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
d87b015https://github.com/lpyu001/cpython/commit/d87b0151062e36e67f9e42e1595fba5bf23a485c
https://github.com/lpyu001/cpython/blob/d87b0151062e36e67f9e42e1595fba5bf23a485c/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/d87b0151062e36e67f9e42e1595fba5bf23a485c
gh-116322: Add Py_mod_gil module slot (#116882)https://github.com/lpyu001/cpython/commit/c2627d6eea924daf80f374c18a5fd73ef61283fa
https://github.com/swtaarrs
swtaarrshttps://github.com/lpyu001/cpython/commits?author=swtaarrs
c2627d6https://github.com/lpyu001/cpython/commit/c2627d6eea924daf80f374c18a5fd73ef61283fa
https://github.com/lpyu001/cpython/blob/c2627d6eea924daf80f374c18a5fd73ef61283fa/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/c2627d6eea924daf80f374c18a5fd73ef61283fa
gh-112943: Correctly compute end offsets for multiline tokens in the tokenize module (#112949)https://github.com/lpyu001/cpython/commit/a135a6d2c6d503b186695f01efa7eed65611b04e
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
a135a6dhttps://github.com/lpyu001/cpython/commit/a135a6d2c6d503b186695f01efa7eed65611b04e
https://github.com/lpyu001/cpython/blob/a135a6d2c6d503b186695f01efa7eed65611b04e/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/a135a6d2c6d503b186695f01efa7eed65611b04e
Remove unnecessary includes (GH-111633)https://github.com/lpyu001/cpython/commit/a12f624a9dc1c44bb20a20b13fd164c14b987892
https://github.com/serhiy-storchaka
serhiy-storchakahttps://github.com/lpyu001/cpython/commits?author=serhiy-storchaka
a12f624https://github.com/lpyu001/cpython/commit/a12f624a9dc1c44bb20a20b13fd164c14b987892
https://github.com/lpyu001/cpython/blob/a12f624a9dc1c44bb20a20b13fd164c14b987892/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/a12f624a9dc1c44bb20a20b13fd164c14b987892
gh-104169: Refactor tokenizer into lexer and wrappers (#110684)https://github.com/lpyu001/cpython/commit/01481f2dc13341c84b64d6dffc08ffed022712a6
01481f2https://github.com/lpyu001/cpython/commit/01481f2dc13341c84b64d6dffc08ffed022712a6
https://github.com/lpyu001/cpython/blob/01481f2dc13341c84b64d6dffc08ffed022712a6/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/01481f2dc13341c84b64d6dffc08ffed022712a6
gh-107015: Remove async_hacks from the tokenizer (#107018)https://github.com/lpyu001/cpython/commit/da8f87b7ea421894c41dfc37f578e03409c5d280
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
da8f87bhttps://github.com/lpyu001/cpython/commit/da8f87b7ea421894c41dfc37f578e03409c5d280
https://github.com/lpyu001/cpython/blob/da8f87b7ea421894c41dfc37f578e03409c5d280/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/da8f87b7ea421894c41dfc37f578e03409c5d280
gh-105564: Don't include artificial newlines in the line attribute of tokens (#105565)https://github.com/lpyu001/cpython/commit/d7f46bcd989580340675bf0a9fdbfa1505a37e81
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
d7f46bchttps://github.com/lpyu001/cpython/commit/d7f46bcd989580340675bf0a9fdbfa1505a37e81
https://github.com/lpyu001/cpython/blob/d7f46bcd989580340675bf0a9fdbfa1505a37e81/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/d7f46bcd989580340675bf0a9fdbfa1505a37e81
gh-105390: Add explicit type cast (#105466)https://github.com/lpyu001/cpython/commit/264a0110ffa4e08b0c7b1023e67a6bd7cb9617c6
https://github.com/Eclips4
Eclips4https://github.com/lpyu001/cpython/commits?author=Eclips4
264a011https://github.com/lpyu001/cpython/commit/264a0110ffa4e08b0c7b1023e67a6bd7cb9617c6
https://github.com/lpyu001/cpython/blob/264a0110ffa4e08b0c7b1023e67a6bd7cb9617c6/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/264a0110ffa4e08b0c7b1023e67a6bd7cb9617c6
gh-105435: Fix spurious NEWLINE token if file ends with comment without a newline (#105442)https://github.com/lpyu001/cpython/commit/7279fb64089abc73c03247fb8191082ee42a9671
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
7279fb6https://github.com/lpyu001/cpython/commit/7279fb64089abc73c03247fb8191082ee42a9671
https://github.com/lpyu001/cpython/blob/7279fb64089abc73c03247fb8191082ee42a9671/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/7279fb64089abc73c03247fb8191082ee42a9671
gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize errors (#105399)https://github.com/lpyu001/cpython/commit/ffd26545509b706437ca38bd6db6108c1d0e2326
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
ffd2654https://github.com/lpyu001/cpython/commit/ffd26545509b706437ca38bd6db6108c1d0e2326
https://github.com/lpyu001/cpython/blob/ffd26545509b706437ca38bd6db6108c1d0e2326/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/ffd26545509b706437ca38bd6db6108c1d0e2326
gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (#105364)https://github.com/lpyu001/cpython/commit/c0a6ed39343b6dc355607fbff108c515e6c103bf
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
c0a6ed3https://github.com/lpyu001/cpython/commit/c0a6ed39343b6dc355607fbff108c515e6c103bf
https://github.com/lpyu001/cpython/blob/c0a6ed39343b6dc355607fbff108c515e6c103bf/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/c0a6ed39343b6dc355607fbff108c515e6c103bf
gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)https://github.com/lpyu001/cpython/commit/70f315c2d6de87b0514ce16cc00a91a5b60a6098
https://github.com/lysnikolaou
lysnikolaouhttps://github.com/lpyu001/cpython/commits?author=lysnikolaou
70f315chttps://github.com/lpyu001/cpython/commit/70f315c2d6de87b0514ce16cc00a91a5b60a6098
https://github.com/lpyu001/cpython/blob/70f315c2d6de87b0514ce16cc00a91a5b60a6098/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/70f315c2d6de87b0514ce16cc00a91a5b60a6098
gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (#105070)https://github.com/lpyu001/cpython/commit/9216e69a87d16d871625721ed5a8aa302511f367
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
9216e69https://github.com/lpyu001/cpython/commit/9216e69a87d16d871625721ed5a8aa302511f367
https://github.com/lpyu001/cpython/blob/9216e69a87d16d871625721ed5a8aa302511f367/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/9216e69a87d16d871625721ed5a8aa302511f367
gh-105017: Include CRLF lines in strings and column numbers (#105030)https://github.com/lpyu001/cpython/commit/96fff35325e519cc76ffacf22e57e4c393d4446f
mgmacias95https://github.com/lpyu001/cpython/commits?author=mgmacias95
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
96fff35https://github.com/lpyu001/cpython/commit/96fff35325e519cc76ffacf22e57e4c393d4446f
https://github.com/lpyu001/cpython/blob/96fff35325e519cc76ffacf22e57e4c393d4446f/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/96fff35325e519cc76ffacf22e57e4c393d4446f
gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenizer (#104980)https://github.com/lpyu001/cpython/commit/46b52e6e2bda51d0b89a64ee36ce2d305a7409f3
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
46b52e6https://github.com/lpyu001/cpython/commit/46b52e6e2bda51d0b89a64ee36ce2d305a7409f3
https://github.com/lpyu001/cpython/blob/46b52e6e2bda51d0b89a64ee36ce2d305a7409f3/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/46b52e6e2bda51d0b89a64ee36ce2d305a7409f3
gh-104972: Ensure that line attributes in tokens in the tokenize module are correct (#104975)https://github.com/lpyu001/cpython/commit/3fdb55c48291a459fb1e33edb5140ec0383222df
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
3fdb55chttps://github.com/lpyu001/cpython/commit/3fdb55c48291a459fb1e33edb5140ec0383222df
https://github.com/lpyu001/cpython/blob/3fdb55c48291a459fb1e33edb5140ec0383222df/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/3fdb55c48291a459fb1e33edb5140ec0383222df
gh-104825: Remove implicit newline in the line attribute in tokens emitted in the tokenize module (#104846)https://github.com/lpyu001/cpython/commit/c8cf9b42eb2bfbd4c3e708ec28d32430248a1d7a
https://github.com/pablogsal
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
c8cf9b4https://github.com/lpyu001/cpython/commit/c8cf9b42eb2bfbd4c3e708ec28d32430248a1d7a
https://github.com/lpyu001/cpython/blob/c8cf9b42eb2bfbd4c3e708ec28d32430248a1d7a/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/c8cf9b42eb2bfbd4c3e708ec28d32430248a1d7a
gh-104741: Add line number attribute to indentation error exception (#104743)https://github.com/lpyu001/cpython/commit/729b252241966f464cc46e176fb854dbcc5296cb
https://github.com/mgmacias95
mgmacias95https://github.com/lpyu001/cpython/commits?author=mgmacias95
729b252https://github.com/lpyu001/cpython/commit/729b252241966f464cc46e176fb854dbcc5296cb
https://github.com/lpyu001/cpython/blob/729b252241966f464cc46e176fb854dbcc5296cb/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/729b252241966f464cc46e176fb854dbcc5296cb
gh-102856: Tokenize performance improvement (#104731)https://github.com/lpyu001/cpython/commit/8817886ae571f5b5ce4e2e6cfd2458622d0efac1
https://github.com/mgmacias95
mgmacias95https://github.com/lpyu001/cpython/commits?author=mgmacias95
8817886https://github.com/lpyu001/cpython/commit/8817886ae571f5b5ce4e2e6cfd2458622d0efac1
https://github.com/lpyu001/cpython/blob/8817886ae571f5b5ce4e2e6cfd2458622d0efac1/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/8817886ae571f5b5ce4e2e6cfd2458622d0efac1
gh-102856: Python tokenizer implementation for PEP 701 (#104323)https://github.com/lpyu001/cpython/commit/6715f91edcf6f379f666e18f57b8a0dcb724bf79
mgmacias95https://github.com/lpyu001/cpython/commits?author=mgmacias95
pablogsalhttps://github.com/lpyu001/cpython/commits?author=pablogsal
6715f91https://github.com/lpyu001/cpython/commit/6715f91edcf6f379f666e18f57b8a0dcb724bf79
https://github.com/lpyu001/cpython/blob/6715f91edcf6f379f666e18f57b8a0dcb724bf79/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/6715f91edcf6f379f666e18f57b8a0dcb724bf79
gh-99113: Add Py_MOD_PER_INTERPRETER_GIL_SUPPORTED (gh-104205)https://github.com/lpyu001/cpython/commit/a9c6e0618f26270e2591b3d99ffeef55eea02a33
https://github.com/ericsnowcurrently
ericsnowcurrentlyhttps://github.com/lpyu001/cpython/commits?author=ericsnowcurrently
a9c6e06https://github.com/lpyu001/cpython/commit/a9c6e0618f26270e2591b3d99ffeef55eea02a33
https://github.com/lpyu001/cpython/blob/a9c6e0618f26270e2591b3d99ffeef55eea02a33/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/a9c6e0618f26270e2591b3d99ffeef55eea02a33
gh-102856: Initial implementation of PEP 701 (#102855)https://github.com/lpyu001/cpython/commit/1ef61cf71a218c71860ff6aecf0fd51edb8b65dc
1ef61cfhttps://github.com/lpyu001/cpython/commit/1ef61cf71a218c71860ff6aecf0fd51edb8b65dc
https://github.com/lpyu001/cpython/blob/1ef61cf71a218c71860ff6aecf0fd51edb8b65dc/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/1ef61cf71a218c71860ff6aecf0fd51edb8b65dc
gh-97973: Return all necessary information from the tokenizer (GH-97984)https://github.com/lpyu001/cpython/commit/cbf0afd8a1474d68310331af9218606959d4cc22
https://github.com/lysnikolaou
lysnikolaouhttps://github.com/lpyu001/cpython/commits?author=lysnikolaou
cbf0afdhttps://github.com/lpyu001/cpython/commit/cbf0afd8a1474d68310331af9218606959d4cc22
https://github.com/lpyu001/cpython/blob/cbf0afd8a1474d68310331af9218606959d4cc22/Python/Python-tokenize.c
https://github.com/lpyu001/cpython/tree/cbf0afd8a1474d68310331af9218606959d4cc22
Nexthttps://github.com/lpyu001/cpython/commits/string_parser/Python/Python-tokenize.c?after=a77ca26996837d132f91903bd52fe861dcb5f8d5+34
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.