René's URL Explorer Experiment


Title: gh-125008: Fix `tokenize.untokenize` roundtrip for `\n{{` by tomasr8 · Pull Request #125013 · python/cpython · GitHub

Open Graph Title: gh-125008: Fix `tokenize.untokenize` roundtrip for `\n{{` by tomasr8 · Pull Request #125013 · python/cpython

X Title: gh-125008: Fix `tokenize.untokenize` roundtrip for `\n{{` by tomasr8 · Pull Request #125013 · python/cpython

Description: The Python programming language. Contribute to python/cpython development by creating an account on GitHub.

Open Graph Description: I'm not sure if this is the best way to fix this issue so I'm open to alternatives :) Issue: Tokenize does not roundtrip {{ after \n #125008

X Description: I'm not sure if this is the best way to fix this issue so I'm open to alternatives :) Issue: Tokenize does not roundtrip {{ after \n #125008

Opengraph URL: https://github.com/python/cpython/pull/125013

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:d4b86b01-a15e-bf5a-97c9-043f1d4fd516
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idE3CE:DD1C:2A64B80:39D7009:6B005436
html-safe-nonce7917cbb39b1edc493884f9e7c4803ac5d2f0714ae6f40b8b84ac474671169ef4
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFM0NFOkREMUM6MkE2NEI4MDozOUQ3MDA5OjZCMDA1NDM2IiwidmlzaXRvcl9pZCI6Ijg0NDM5Nzc0MzE2ODUwMjY4NzAiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacd9654e52b0cfcedb5f2a10604032dbe9be2daa54616d1553e03233997f0748fb
hovercard-subject-tagpull_request:2109181216
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/python/cpython/125013/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/dc56edbefbb851508e833341e3ce6ba1d50c8f6c1a1a9b18ddf1b6a246c4e8bd/python/cpython/pull/125013
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/dc56edbefbb851508e833341e3ce6ba1d50c8f6c1a1a9b18ddf1b6a246c4e8bd/python/cpython/pull/125013
og:image:altI'm not sure if this is the best way to fix this issue so I'm open to alternatives :) Issue: Tokenize does not roundtrip {{ after \n #125008
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernametomasr8
hostnamegithub.com
expected-hostnamegithub.com
Nonef420f4996e6b1ff1ccd6d7683f8134f4b5f0f8a50124c210dbfe7490e5644abb
turbo-cache-controlno-cache
go-importgithub.com/python/cpython git https://github.com/python/cpython.git
octolytics-dimension-user_id1525981
octolytics-dimension-user_loginpython
octolytics-dimension-repository_id81598961
octolytics-dimension-repository_nwopython/cpython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id81598961
octolytics-dimension-repository_network_root_nwopython/cpython
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release26e00df917aba0f128135dc073ea0c5e33a70d40
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/python/cpython/pull/125013#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fpull%2F125013
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fpull%2F125013
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=python%2Fcpython
Reloadhttps://github.com/python/cpython/pull/125013
Reloadhttps://github.com/python/cpython/pull/125013
Reloadhttps://github.com/python/cpython/pull/125013
pythonhttps://github.com/python
cpythonhttps://github.com/python/cpython
Codehttps://github.com/python/cpython
Issues5k+ (5k+)https://github.com/python/cpython/issues
Pull requests2.4k (2.4k)https://github.com/python/cpython/pulls
Actionshttps://github.com/python/cpython/actions
Projectshttps://github.com/python/cpython/projects
Security and qualityhttps://github.com/python/cpython/security
Insightshttps://github.com/python/cpython/insights
https://github.com/python/cpython
pablogsalhttps://github.com/pablogsal
python:mainhttps://github.com/python/cpython/tree/main
tomasr8:untokenizehttps://github.com/tomasr8/cpython/tree/untokenize
Conversationhttps://github.com/python/cpython/pull/125013
Commits4 (4)https://github.com/python/cpython/pull/125013/commits
Checkshttps://github.com/python/cpython/pull/125013/checks
Files changedhttps://github.com/python/cpython/pull/125013/files
gh-125008: Fix tokenize.untokenize roundtrip for \n{{https://github.com/python/cpython/pull/125013#top
pablogsalhttps://github.com/pablogsal
python:mainhttps://github.com/python/cpython/tree/main
tomasr8:untokenizehttps://github.com/tomasr8/cpython/tree/untokenize
https://github.com/tomasr8
tomasr8https://github.com/tomasr8
Oct 5, 2024https://github.com/python/cpython/pull/125013#issue-2568341124
Please reload this pagehttps://github.com/python/cpython/pull/125013
Tokenize does not roundtrip {{ after \n #125008https://github.com/python/cpython/issues/125008
Please reload this pagehttps://github.com/python/cpython/pull/125013
tomasr8https://github.com/tomasr8
October 5, 2024 23:50https://github.com/python/cpython/pull/125013#commits-pushed-91c20f5
https://github.com/tomasr8
Fix tokenizer roundtrip with escape charactershttps://github.com/python/cpython/pull/125013/commits/91c20f5a298ea50318e95c1d06686b766d7ee0c6
91c20f5https://github.com/python/cpython/pull/125013/commits/91c20f5a298ea50318e95c1d06686b766d7ee0c6
https://github.com/tomasr8
Add news entryhttps://github.com/python/cpython/pull/125013/commits/b2b5f17f55cd222991632c76fc0509d962952cd6
b2b5f17https://github.com/python/cpython/pull/125013/commits/b2b5f17f55cd222991632c76fc0509d962952cd6
https://github.com/tomasr8
tomasr8https://github.com/tomasr8
lysnikolaouhttps://github.com/lysnikolaou
pablogsalhttps://github.com/pablogsal
code ownershttps://github.com/python/cpython/blob/16cd6cc86b3ba20074ae3eefb61aeb24ee1544f7/.github/CODEOWNERS#L153
October 5, 2024 21:58https://github.com/python/cpython/pull/125013#event-14529073665
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
Oct 5, 2024 https://github.com/python/cpython/pull/125013#ref-issue-2568237292
Tokenize does not roundtrip {{ after \n #125008 https://github.com/python/cpython/issues/125008
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
awaiting review https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22awaiting%20review%22
Oct 5, 2024https://github.com/python/cpython/pull/125013#event-14529073736
https://github.com/wyattscarpenter
wyattscarpenterhttps://github.com/wyattscarpenter
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395362184
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/pablogsal
pablogsalhttps://github.com/pablogsal
Oct 6, 2024 https://github.com/python/cpython/pull/125013#pullrequestreview-2350495199
View reviewed changes https://github.com/python/cpython/pull/125013/files/b2b5f17f55cd222991632c76fc0509d962952cd6
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
awaiting merge https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22awaiting%20merge%22
awaiting review https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22awaiting%20review%22
Oct 6, 2024https://github.com/python/cpython/pull/125013#event-14530148384
https://github.com/pablogsal
pablogsalhttps://github.com/pablogsal
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395373255
@tomasr8https://github.com/tomasr8
@wyattscarpenterhttps://github.com/wyattscarpenter
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/pablogsal
pablogsalhttps://github.com/pablogsal
awaiting review https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22awaiting%20review%22
needs backport to 3.12 https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22needs%20backport%20to%203.12%22
needs backport to 3.13 https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22needs%20backport%20to%203.13%22
awaiting merge https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22awaiting%20merge%22
Oct 6, 2024https://github.com/python/cpython/pull/125013#event-14530151660
https://github.com/pablogsal
pablogsalhttps://github.com/pablogsal
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395373402
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/tomasr8
Add tests with raw stringshttps://github.com/python/cpython/pull/125013/commits/10ed775089190b757064a384385e7b79345c8571
10ed775https://github.com/python/cpython/pull/125013/commits/10ed775089190b757064a384385e7b79345c8571
https://github.com/tomasr8
tomasr8https://github.com/tomasr8
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395389370
@wyattscarpenterhttps://github.com/wyattscarpenter
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/wyattscarpenter
wyattscarpenterhttps://github.com/wyattscarpenter
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395392145
Please reload this pagehttps://github.com/python/cpython/pull/125013
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/tomasr8
Add tests for backslasheshttps://github.com/python/cpython/pull/125013/commits/633264e7ab32dbcb8b27eace45322c7f47cde984
633264ehttps://github.com/python/cpython/pull/125013/commits/633264e7ab32dbcb8b27eace45322c7f47cde984
https://github.com/tomasr8
tomasr8https://github.com/tomasr8
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395402192
Please reload this pagehttps://github.com/python/cpython/pull/125013
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/pablogsal
pablogsalhttps://github.com/pablogsal
db23b8bhttps://github.com/python/cpython/commit/db23b8bb13863fcd88ff91bc22398f8e0312039e
Oct 6, 2024https://github.com/python/cpython/pull/125013#event-14530576395
https://github.com/apps/miss-islington-app
miss-islington-apphttps://github.com/apps/miss-islington-app
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395437309
@tomasr8https://github.com/tomasr8
@pablogsalhttps://github.com/pablogsal
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
awaiting review https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22awaiting%20review%22
Oct 6, 2024https://github.com/python/cpython/pull/125013#event-14530576495
miss-islingtonhttps://github.com/miss-islington
Oct 6, 2024 https://github.com/python/cpython/pull/125013#ref-commit-9b7c8af
https://github.com/tomasr8
https://github.com/miss-islington
pythongh-125008https://github.com/python/cpython/issues/125008
: Fixhttps://github.com/miss-islington/cpython/commit/9b7c8af6ec1c5548fa8bd13791a1f1a70d8f17e0
tokenize.untokenizehttps://github.com/miss-islington/cpython/commit/9b7c8af6ec1c5548fa8bd13791a1f1a70d8f17e0
roundtrip forhttps://github.com/miss-islington/cpython/commit/9b7c8af6ec1c5548fa8bd13791a1f1a70d8f17e0
\n{{https://github.com/miss-islington/cpython/commit/9b7c8af6ec1c5548fa8bd13791a1f1a70d8f17e0
(https://github.com/miss-islington/cpython/commit/9b7c8af6ec1c5548fa8bd13791a1f1a70d8f17e0
pyth…https://github.com/python/cpython/pull/125013
9b7c8afhttps://github.com/miss-islington/cpython/commit/9b7c8af6ec1c5548fa8bd13791a1f1a70d8f17e0
…onGH-125013https://github.com/python/cpython/pull/125013
db23b8bhttps://github.com/miss-islington/cpython/commit/db23b8bb13863fcd88ff91bc22398f8e0312039e
https://github.com/pablogsal
pablogsalhttps://github.com/pablogsal
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395437364
Please reload this pagehttps://github.com/python/cpython/pull/125013
miss-islingtonhttps://github.com/miss-islington
Oct 6, 2024 https://github.com/python/cpython/pull/125013#ref-commit-acc2968
https://github.com/tomasr8
https://github.com/miss-islington
pythongh-125008https://github.com/python/cpython/issues/125008
: Fixhttps://github.com/miss-islington/cpython/commit/acc2968085efe35a3eabfdf01ca5e21a5f82c14b
tokenize.untokenizehttps://github.com/miss-islington/cpython/commit/acc2968085efe35a3eabfdf01ca5e21a5f82c14b
roundtrip forhttps://github.com/miss-islington/cpython/commit/acc2968085efe35a3eabfdf01ca5e21a5f82c14b
\n{{https://github.com/miss-islington/cpython/commit/acc2968085efe35a3eabfdf01ca5e21a5f82c14b
(https://github.com/miss-islington/cpython/commit/acc2968085efe35a3eabfdf01ca5e21a5f82c14b
pyth…https://github.com/python/cpython/pull/125013
acc2968https://github.com/miss-islington/cpython/commit/acc2968085efe35a3eabfdf01ca5e21a5f82c14b
…onGH-125013https://github.com/python/cpython/pull/125013
db23b8bhttps://github.com/miss-islington/cpython/commit/db23b8bb13863fcd88ff91bc22398f8e0312039e
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395437402
GH-125020https://github.com/python/cpython/pull/125020
3.13 branchhttps://github.com/python/cpython/tree/3.13
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
needs backport to 3.13 https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22needs%20backport%20to%203.13%22
Oct 6, 2024https://github.com/python/cpython/pull/125013#event-14530577153
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
Oct 6, 2024https://github.com/python/cpython/pull/125013#issuecomment-2395437433
GH-125021https://github.com/python/cpython/pull/125021
3.12 branchhttps://github.com/python/cpython/tree/3.12
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/apps/bedevere-app
bedevere-apphttps://github.com/apps/bedevere-app
needs backport to 3.12 https://github.com/python/cpython/issues?q=state%3Aopen%20label%3A%22needs%20backport%20to%203.12%22
Oct 6, 2024https://github.com/python/cpython/pull/125013#event-14530577368
pablogsalhttps://github.com/pablogsal
Oct 6, 2024 https://github.com/python/cpython/pull/125013#ref-commit-db4b382
https://github.com/miss-islington
[3.12]https://github.com/python/cpython/commit/db4b382b1faad575a0f630d71462c610661235ea
gh-125008https://github.com/python/cpython/issues/125008
: Fixhttps://github.com/python/cpython/commit/db4b382b1faad575a0f630d71462c610661235ea
tokenize.untokenizehttps://github.com/python/cpython/commit/db4b382b1faad575a0f630d71462c610661235ea
roundtrip forhttps://github.com/python/cpython/commit/db4b382b1faad575a0f630d71462c610661235ea
\n{{https://github.com/python/cpython/commit/db4b382b1faad575a0f630d71462c610661235ea
(https://github.com/python/cpython/commit/db4b382b1faad575a0f630d71462c610661235ea
GH-…https://github.com/python/cpython/pull/125013
db4b382https://github.com/python/cpython/commit/db4b382b1faad575a0f630d71462c610661235ea
…125013https://github.com/python/cpython/pull/125013
#125021https://github.com/python/cpython/pull/125021
pablogsalhttps://github.com/pablogsal
Oct 6, 2024 https://github.com/python/cpython/pull/125013#ref-commit-b30da22
https://github.com/miss-islington
[3.13]https://github.com/python/cpython/commit/b30da225cfe86f22d0d838af2c15908277191608
gh-125008https://github.com/python/cpython/issues/125008
: Fixhttps://github.com/python/cpython/commit/b30da225cfe86f22d0d838af2c15908277191608
tokenize.untokenizehttps://github.com/python/cpython/commit/b30da225cfe86f22d0d838af2c15908277191608
roundtrip forhttps://github.com/python/cpython/commit/b30da225cfe86f22d0d838af2c15908277191608
\n{{https://github.com/python/cpython/commit/b30da225cfe86f22d0d838af2c15908277191608
(https://github.com/python/cpython/commit/b30da225cfe86f22d0d838af2c15908277191608
GH-…https://github.com/python/cpython/pull/125013
b30da22https://github.com/python/cpython/commit/b30da225cfe86f22d0d838af2c15908277191608
…125013https://github.com/python/cpython/pull/125013
#125020https://github.com/python/cpython/pull/125020
https://github.com/tomasr8
tomasr8https://github.com/tomasr8
October 6, 2024 13:44https://github.com/python/cpython/pull/125013#event-14530635466
https://github.co/hiddenchars
https://github.com/python/cpython/pull/{{ revealButtonHref }}
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpython%2Fcpython%2Fpull%2F125013
https://github.com/pablogsal
pablogsal https://github.com/pablogsal
https://github.com/python/cpython/pull/125013/files/b2b5f17f55cd222991632c76fc0509d962952cd6
https://github.com/lysnikolaou
lysnikolaou https://github.com/lysnikolaou
Please reload this pagehttps://github.com/python/cpython/pull/125013
Please reload this pagehttps://github.com/python/cpython/pull/125013
https://github.com/tomasr8
https://github.com/wyattscarpenter
https://github.com/pablogsal
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.