Title: asyncio subprocess stdout occasionally lost (3.11.0 → 3.11.1 regression) · Issue #100133 · python/cpython · GitHub
Open Graph Title: asyncio subprocess stdout occasionally lost (3.11.0 → 3.11.1 regression) · Issue #100133 · python/cpython
X Title: asyncio subprocess stdout occasionally lost (3.11.0 → 3.11.1 regression) · Issue #100133 · python/cpython
Description: Bug report So, I've updated python from 3.11.0 to 3.11.1 and one of my utilities which runs a lot of external processes with asyncio.create_subprocess_exec started failing in different places in weird ways. It turned out that with some p...
Open Graph Description: Bug report So, I've updated python from 3.11.0 to 3.11.1 and one of my utilities which runs a lot of external processes with asyncio.create_subprocess_exec started failing in different places in we...
X Description: Bug report So, I've updated python from 3.11.0 to 3.11.1 and one of my utilities which runs a lot of external processes with asyncio.create_subprocess_exec started failing in different places i...
Opengraph URL: https://github.com/python/cpython/issues/100133
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"asyncio subprocess stdout occasionally lost (3.11.0 → 3.11.1 regression)","articleBody":"\u003c!--\r\n If you're new to Python and you're not sure whether what you're experiencing is a bug, the CPython issue tracker is not\r\n the right place to seek help. Consider the following options instead:\r\n\r\n - reading the Python tutorial: https://docs.python.org/3/tutorial/\r\n - posting in the \"Users\" category on discuss.python.org: https://discuss.python.org/c/users/7\r\n - emailing the Python-list mailing list: https://mail.python.org/mailman/listinfo/python-list\r\n - searching our issue tracker (https://github.com/python/cpython/issues) to see if\r\n your problem has already been reported\r\n--\u003e\r\n\r\n# Bug report\r\n\r\nSo, I've updated python from 3.11.0 to 3.11.1 and one of my utilities which runs a lot of external processes with `asyncio.create_subprocess_exec` started failing in different places in weird ways. It turned out that with some probability `asyncio.subprocess.Process.communicate()` would now return an empty stdout. Here's a repro:\r\n\r\n```\r\nimport asyncio\r\n\r\nasync def main():\r\n attempt = 1\r\n while True:\r\n proc = await asyncio.create_subprocess_exec('/bin/echo', 'test', stdout=asyncio.subprocess.PIPE, stderr=asyncio.subprocess.PIPE)\r\n\r\n stdout, stderr = await proc.communicate()\r\n\r\n text = stdout.decode('utf-8').strip()\r\n\r\n if text != 'test':\r\n raise RuntimeError(f'FAIL on attempt {attempt}: output=\"{text}\"')\r\n\r\n attempt += 1\r\n\r\nasyncio.run(main())\r\n```\r\n\r\nYou may have to wait somewhat for the problem to reproduce, but for me it fails in under 15 seconds more or less reliably. Possible output:\r\n```\r\nRuntimeError: FAIL on attempt 3823: output=\"\"\r\n```\r\n\r\n# Your environment\r\n\r\n\u003c!-- Include as many relevant details as possible about the environment you experienced the bug in --\u003e\r\n\r\n- CPython versions tested on: 3.11.1\r\n- Operating system and architecture: FreeBSD 13.1 amd64\r\n\r\n\u003c!--\r\nYou can freely edit this text. Remove any lines you believe are unnecessary.\r\n--\u003e\r\n\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-100154\n* gh-100398\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/AMDmi3","@type":"Person","name":"AMDmi3"},"datePublished":"2022-12-09T11:48:20.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":7},"url":"https://github.com/100133/cpython/issues/100133"}
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:377fcc90-57d8-1fbc-68c6-1ef47a285978 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | 9882:1327C8:1B0F0D0:25F29B5:696901CA |
| html-safe-nonce | a36c55e377289d2bed28422174a53e6321d9ed09ea78aca5c891b48b4a3c429a |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5ODgyOjEzMjdDODoxQjBGMEQwOjI1RjI5QjU6Njk2OTAxQ0EiLCJ2aXNpdG9yX2lkIjoiMjM2MzkwMDIxODUyMDk2MTQ4MiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | ff1ef4b7ecb6ef31b4f209dacdedc58072d2d612c2fdfab8fc84cf3aa0b6777d |
| hovercard-subject-tag | issue:1486618398 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/python/cpython/100133/issue_layout |
| twitter:image | https://opengraph.githubassets.com/41df8c8e51c5be23f7b07511dc6fb6d47e5268d325edb7a14d4e52049e1a7b09/python/cpython/issues/100133 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/41df8c8e51c5be23f7b07511dc6fb6d47e5268d325edb7a14d4e52049e1a7b09/python/cpython/issues/100133 |
| og:image:alt | Bug report So, I've updated python from 3.11.0 to 3.11.1 and one of my utilities which runs a lot of external processes with asyncio.create_subprocess_exec started failing in different places in we... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | AMDmi3 |
| hostname | github.com |
| expected-hostname | github.com |
| None | e6156bd4ef9f2dc8dadf4c49a8f7ed8532186388cef72eda3ccb9f0ab3b8cfca |
| turbo-cache-control | no-preview |
| go-import | github.com/python/cpython git https://github.com/python/cpython.git |
| octolytics-dimension-user_id | 1525981 |
| octolytics-dimension-user_login | python |
| octolytics-dimension-repository_id | 81598961 |
| octolytics-dimension-repository_nwo | python/cpython |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 81598961 |
| octolytics-dimension-repository_network_root_nwo | python/cpython |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | fd1938215b152e2c6a29cf56fec07fd9f91f1203 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width