René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Issues with Shift_JIS and EUC-JP in email","articleBody":"# Bug report\n\nThe following example:\n\n```py\nfrom email.message import EmailMessage\nfrom email.contentmanager import raw_data_manager\n\nm = EmailMessage()\ncontent = \"\\u65e5\\u672c\\u8a9e\\n\"\nraw_data_manager.set_content(m, content, charset='shift_jis')\nprint(m)\n```\n\nfails with exception\n\n```pytb\nTraceback (most recent call last):\n  File \"\u003cpython-input-0\u003e\", line 7, in \u003cmodule\u003e\n    print(m)\n    ~~~~~^^^\n  File \"/home/serhiy/py/cpython/Lib/email/message.py\", line 1015, in __str__\n    return self.as_string(policy=self.policy.clone(utf8=True))\n           ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/message.py\", line 1012, in as_string\n    return super().as_string(unixfrom, maxheaderlen, policy)\n           ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/message.py\", line 194, in as_string\n    g.flatten(self, unixfrom=unixfrom)\n    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/generator.py\", line 118, in flatten\n    self._write(msg)\n    ~~~~~~~~~~~^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/generator.py\", line 183, in _write\n    self._dispatch(msg)\n    ~~~~~~~~~~~~~~^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/generator.py\", line 220, in _dispatch\n    meth(msg)\n    ~~~~^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/generator.py\", line 258, in _handle_text\n    msg.set_payload(msg._payload, charset)\n    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/message.py\", line 361, in set_payload\n    self.set_charset(charset)\n    ~~~~~~~~~~~~~~~~^^^^^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/message.py\", line 392, in set_charset\n    self._payload = charset.body_encode(self._payload)\n                    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^\n  File \"/home/serhiy/py/cpython/Lib/email/charset.py\", line 441, in body_encode\n    string = string.encode(self.output_charset).decode('ascii')\n             ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^\nUnicodeEncodeError: 'iso2022_jp' codec can't encode character '\\udc93' in position 0: illegal multibyte sequence\nencoding with 'iso-2022-jp' codec failed\n```\n\nThe same for euc-jp. \"shift_jis\" and \"euc-jp\" are two charsets in `email.charset.CHARSETS` for which the output charset is overridden.\n\nThis fails in Python from 3.11 to main. It worked in Python 3.10 and older.\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-151120\n* gh-151541\n* gh-152952\n* gh-152953\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/serhiy-storchaka","@type":"Person","name":"serhiy-storchaka"},"datePublished":"2026-06-02T09:10:44.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":8},"url":"https://github.com/150771/cpython/issues/150771"}