Title: tokenize module should have a unicode API · Issue #56695 · python/cpython · GitHub
Open Graph Title: tokenize module should have a unicode API · Issue #56695 · python/cpython
X Title: tokenize module should have a unicode API · Issue #56695 · python/cpython
Description: BPO 12486 Nosy @warsaw, @terryjreedy, @mdickinson, @vstinner, @ssbr, @tpn, @merwok, @voidspace, @meadori, @ericsnowcurrently, @takluyver, @akheron, @vadmium, @serhiy-storchaka, @willingc, @Carreau PRs #6957 Files tokenize_str.difftokeniz...
Open Graph Description: BPO 12486 Nosy @warsaw, @terryjreedy, @mdickinson, @vstinner, @ssbr, @tpn, @merwok, @voidspace, @meadori, @ericsnowcurrently, @takluyver, @akheron, @vadmium, @serhiy-storchaka, @willingc, @Carreau ...
X Description: BPO 12486 Nosy @warsaw, @terryjreedy, @mdickinson, @vstinner, @ssbr, @tpn, @merwok, @voidspace, @meadori, @ericsnowcurrently, @takluyver, @akheron, @vadmium, @serhiy-storchaka, @willingc, @Carreau ...
Opengraph URL: https://github.com/python/cpython/issues/56695
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"tokenize module should have a unicode API","articleBody":"BPO | [12486](https://bugs.python.org/issue12486)\n--- | :---\nNosy | @warsaw, @terryjreedy, @mdickinson, @vstinner, @ssbr, @tpn, @merwok, @voidspace, @meadori, @ericsnowcurrently, @takluyver, @akheron, @vadmium, @serhiy-storchaka, @willingc, @Carreau\nPRs | \u003cli\u003epython/cpython#6957\u003c/li\u003e\nFiles | \u003cli\u003e[tokenize_str.diff](https://bugs.python.org/file27587/tokenize_str.diff \"Uploaded as text/plain at 2012-10-15.20:48:43 by @serhiy-storchaka\")\u003c/li\u003e\u003cli\u003e[tokenize_str_2.diff](https://bugs.python.org/file40679/tokenize_str_2.diff \"Uploaded as text/plain at 2015-10-05.06:04:44 by @serhiy-storchaka\")\u003c/li\u003e\n\n\u003csup\u003e*Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.*\u003c/sup\u003e\n\n\u003cdetails\u003e\u003csummary\u003eShow more details\u003c/summary\u003e\u003cp\u003e\n\nGitHub fields:\n```python\nassignee = None\nclosed_at = \u003cDate 2018-06-05.17:30:56.930\u003e\ncreated_at = \u003cDate 2011-07-04.03:58:16.983\u003e\nlabels = ['3.8', 'type-feature', 'library']\ntitle = 'tokenize module should have a unicode API'\nupdated_at = \u003cDate 2018-06-05.17:51:27.955\u003e\nuser = 'https://github.com/ssbr'\n```\n\nbugs.python.org fields:\n```python\nactivity = \u003cDate 2018-06-05.17:51:27.955\u003e\nactor = 'takluyver'\nassignee = 'none'\nclosed = True\nclosed_date = \u003cDate 2018-06-05.17:30:56.930\u003e\ncloser = 'willingc'\ncomponents = ['Library (Lib)']\ncreation = \u003cDate 2011-07-04.03:58:16.983\u003e\ncreator = 'Devin Jeanpierre'\ndependencies = []\nfiles = ['27587', '40679']\nhgrepos = []\nissue_num = 12486\nkeywords = ['patch']\nmessage_count = 19.0\nmessages = ['139733', '140050', '140055', '173001', '178473', '252300', '252305', '252309', '313591', '316982', '317004', '317010', '317011', '317018', '317020', '317021', '317912', '318775', '318778']\nnosy_count = 16.0\nnosy_names = ['barry', 'terry.reedy', 'mark.dickinson', 'vstinner', 'Devin Jeanpierre', 'trent', 'eric.araujo', 'michael.foord', 'meador.inge', 'eric.snow', 'takluyver', 'petri.lehtinen', 'martin.panter', 'serhiy.storchaka', 'willingc', 'mbussonn']\npr_nums = ['6957']\npriority = 'normal'\nresolution = 'fixed'\nstage = 'resolved'\nstatus = 'closed'\nsuperseder = None\ntype = 'enhancement'\nurl = 'https://bugs.python.org/issue12486'\nversions = ['Python 3.8']\n```\n\n\u003c/p\u003e\u003c/details\u003e\n","author":{"url":"https://github.com/ssbr","@type":"Person","name":"ssbr"},"datePublished":"2011-07-04T03:58:17.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":19},"url":"https://github.com/56695/cpython/issues/56695"}
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:b7c0d9e7-8c8f-e2cc-3256-a7b8d150d088 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | C798:383777:77B03E8:A84DA08:6A501D81 |
| html-safe-nonce | 6e5e33a7e317076c84f3c1e22982e0691b073e18913af42bfcfaf0c2660669a9 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDNzk4OjM4Mzc3Nzo3N0IwM0U4OkE4NERBMDg6NkE1MDFEODEiLCJ2aXNpdG9yX2lkIjoiNzUwMTcwMjI5NzQ1MTI0MDgzMyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 3208482d059fdbdd8e6d8a1b21b154eba5e55b6aca978fbd9c2ea219a73a8b7f |
| hovercard-subject-tag | issue:1198870926 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/python/cpython/56695/issue_layout |
| twitter:image | https://opengraph.githubassets.com/07c40c95c4460ca25140b080e5630227093926e950acb4a6cd795bb3c77c8bc4/python/cpython/issues/56695 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/07c40c95c4460ca25140b080e5630227093926e950acb4a6cd795bb3c77c8bc4/python/cpython/issues/56695 |
| og:image:alt | BPO 12486 Nosy @warsaw, @terryjreedy, @mdickinson, @vstinner, @ssbr, @tpn, @merwok, @voidspace, @meadori, @ericsnowcurrently, @takluyver, @akheron, @vadmium, @serhiy-storchaka, @willingc, @Carreau ... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | ssbr |
| hostname | github.com |
| expected-hostname | github.com |
| None | 14f013003d3992e8746116a6f2f55cd2fdaccd329ee0423392831ae051ecb535 |
| turbo-cache-control | no-preview |
| go-import | github.com/python/cpython git https://github.com/python/cpython.git |
| octolytics-dimension-user_id | 1525981 |
| octolytics-dimension-user_login | python |
| octolytics-dimension-repository_id | 81598961 |
| octolytics-dimension-repository_nwo | python/cpython |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 81598961 |
| octolytics-dimension-repository_network_root_nwo | python/cpython |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 26ee7c1a62943cf19a6fcc1d1ac93ac83465c885 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width