René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"euc_kr char '0x3164' decode('ksx1001') cause UnicodeDecodeError ","articleBody":"\u003c!--\r\n  If you're new to Python and you're not sure whether what you're experiencing is a bug, the CPython issue tracker is not\r\n  the right place to seek help. Consider the following options instead:\r\n\r\n  - reading the Python tutorial: https://docs.python.org/3/tutorial/\r\n  - posting in the \"Users\" category on discuss.python.org: https://discuss.python.org/c/users/7\r\n  - emailing the Python-list mailing list: https://mail.python.org/mailman/listinfo/python-list\r\n  - searching our issue tracker (https://github.com/python/cpython/issues) to see if\r\n    your problem has already been reported\r\n--\u003e\r\n\r\n# Bug report\r\n\r\nchar  '0x3164'  can be `encode('ksx1001')`, but can not `decode('ksx1001')`\r\n\r\n```python\r\n\r\ndef main():\r\n    code_point = 0x3164\r\n    c = chr(code_point)\r\n    raw = c.encode('ksx1001')\r\n    c2 = raw.decode('ksx1001')  # \u003c--- this cause error \r\n    print(f'{c} {c2}')\r\n\r\nif __name__ == '__main__':\r\n    main()\r\n```\r\n\r\n```\r\nTraceback (most recent call last):\r\n  File \"/Users/takwolf/Develop/FontDev/fusion-pixel-font/build.py\", line 11, in \u003cmodule\u003e\r\n    main()\r\n  File \"/Users/takwolf/Develop/FontDev/fusion-pixel-font/build.py\", line 6, in main\r\n    c2 = raw.decode('ksx1001')\r\n         ^^^^^^^^^^^^^^^^^^^^^\r\nUnicodeDecodeError: 'euc_kr' codec can't decode bytes in position 0-1: incomplete multibyte sequence\r\n\r\n```\r\n\r\nThe char is `Hangul Compatibility Jamo -\u003e Hangul Filler`\r\n\r\nhttps://unicode-table.com/en/3164/\r\n\r\n\u003cimg width=\"676\" alt=\"image\" src=\"https://user-images.githubusercontent.com/6064962/218377969-f6a6dc6e-3464-448a-ae2d-89dea00a8efc.png\"\u003e\r\n\r\nThe following code is get the zone in ks-x-1001:\r\n\r\n```python\r\ndef main():\r\n    code_point = 0x3164\r\n    c = chr(code_point)\r\n    raw = c.encode('ksx1001')\r\n    block_offset = 0xA0\r\n    zone_1 = raw[0] - block_offset\r\n    zone_2 = raw[1] - block_offset\r\n    print(f'{zone_1} {zone_2}')\r\n\r\n\r\nif __name__ == '__main__':\r\n    main()\r\n\r\n```\r\n\r\n```\r\nzone_1 = 4 \r\nzone_2 = 52\r\n```\r\n\r\nhttps://en.wikipedia.org/wiki/KS_X_1001#Hangul_Filler\r\n\u003cimg width=\"737\" alt=\"image\" src=\"https://user-images.githubusercontent.com/6064962/218380463-1cee6580-9dcf-4804-91f1-fb5ed59ee5e1.png\"\u003e\r\n\r\n![image](https://user-images.githubusercontent.com/6064962/218378373-a8971d85-fd62-4ccf-aae4-9023aaf3b267.png)\r\n\r\n\r\nother chars in ksx1001 encode an decode is ok, but only this.\r\n\r\n\r\n# Your environment\r\n\r\n\u003c!-- Include as many relevant details as possible about the environment you experienced the bug in --\u003e\r\n\r\n- CPython versions tested on: Python 3.11.1\r\n- Operating system and architecture:  macOS 13.0\r\n\r\n\u003c!--\r\nYou can freely edit this text. Remove any lines you believe are unnecessary.\r\n--\u003e\r\n\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-102417\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/TakWolf","@type":"Person","name":"TakWolf"},"datePublished":"2023-02-13T05:32:03.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":14},"url":"https://github.com/101863/cpython/issues/101863"}