Title: Infinite recursion in the tokeniser when showing warnings · Issue #99891 · python/cpython · GitHub
Open Graph Title: Infinite recursion in the tokeniser when showing warnings · Issue #99891 · python/cpython
X Title: Infinite recursion in the tokeniser when showing warnings · Issue #99891 · python/cpython
Description: Turns out that showing warnings in the tokenizer is quite tricky because in the process of showing the warning we need to fetch the encoding which needs to tokenize the first two lines and if the warning is there that leads to an infinit...
Open Graph Description: Turns out that showing warnings in the tokenizer is quite tricky because in the process of showing the warning we need to fetch the encoding which needs to tokenize the first two lines and if the w...
X Description: Turns out that showing warnings in the tokenizer is quite tricky because in the process of showing the warning we need to fetch the encoding which needs to tokenize the first two lines and if the w...
Opengraph URL: https://github.com/python/cpython/issues/99891
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Infinite recursion in the tokeniser when showing warnings","articleBody":"Turns out that showing warnings in the tokenizer is quite tricky because in the process of showing the warning we need to fetch the encoding which needs to tokenize the first two lines and if the warning is there that leads to an infinite loop. Check for instance with a file contaning:\r\n\r\n```\r\n0b1and x\r\n```\r\n\r\nNotice that this only happens when tokenizing files.\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-99893\n* gh-99896\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/pablogsal","@type":"Person","name":"pablogsal"},"datePublished":"2022-11-30T10:58:23.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/99891/cpython/issues/99891"}| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:fe7daaf3-7cbc-fd2d-fefb-0227a86e8693 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | D5AE:206DE9:A03C1E:E08D00:696A30AA |
| html-safe-nonce | f4c793f26db4ea920b1f1875f3f02c3a16185da27650c724dd4d591e72de72f5 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJENUFFOjIwNkRFOTpBMDNDMUU6RTA4RDAwOjY5NkEzMEFBIiwidmlzaXRvcl9pZCI6IjU0MjIyNzEwNjYyMTE0OTYxMDYiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 525b7be71905c130e6367ecb4379c2dec979ecf9b445cad01518e7f5f0040fca |
| hovercard-subject-tag | issue:1469439152 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/python/cpython/99891/issue_layout |
| twitter:image | https://opengraph.githubassets.com/f15f06d3b3612450e6ccbb31405ac7d9c0b416bffc94d08548b91bec45fa5148/python/cpython/issues/99891 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/f15f06d3b3612450e6ccbb31405ac7d9c0b416bffc94d08548b91bec45fa5148/python/cpython/issues/99891 |
| og:image:alt | Turns out that showing warnings in the tokenizer is quite tricky because in the process of showing the warning we need to fetch the encoding which needs to tokenize the first two lines and if the w... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | pablogsal |
| hostname | github.com |
| expected-hostname | github.com |
| None | ade130928b3890d20ecf9c887468a17e88d5c9a740ea2a85c2c2162e7c58e623 |
| turbo-cache-control | no-preview |
| go-import | github.com/python/cpython git https://github.com/python/cpython.git |
| octolytics-dimension-user_id | 1525981 |
| octolytics-dimension-user_login | python |
| octolytics-dimension-repository_id | 81598961 |
| octolytics-dimension-repository_nwo | python/cpython |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 81598961 |
| octolytics-dimension-repository_network_root_nwo | python/cpython |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | c00842167ca2e5b13e8171812965d503e925ece6 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width