René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"test_concurrent_futures: test_deadlock failed with timeout on ARM Raspbian 3.x","articleBody":"Example:\r\n\r\n```\r\nFAIL: test_crash_during_func_exec_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolForkserverExecutorDeadlockTest.test_crash_during_func_exec_on_worker)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 128, in _check_crash\r\n    res.result(timeout=self.TIMEOUT)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/_base.py\", line 458, in result\r\n    raise TimeoutError()\r\nTimeoutError\r\n```\r\n\r\nbuild: https://buildbot.python.org/all/#/builders/424/builds/4978\r\n\r\n* FAIL: test_crash_during_func_exec_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolForkserverExecutorDeadlockTest.test_crash_during_func_exec_on_worker)\r\n* FAIL: test_crash_during_result_pickle_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolForkserverExecutorDeadlockTest.test_crash_during_result_pickle_on_worker)\r\n* FAIL: test_crash_at_task_unpickle (test.test_concurrent_futures.test_deadlock.ProcessPoolSpawnExecutorDeadlockTest.test_crash_at_task_unpickle)\r\n* FAIL: test_crash_during_func_exec_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolSpawnExecutorDeadlockTest.test_crash_during_func_exec_on_worker)\r\n* FAIL: test_crash_during_result_pickle_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolSpawnExecutorDeadlockTest.test_crash_during_result_pickle_on_worker)\r\n\r\nThese tests passed when re-run in verbose mode in a fresh process.\r\n\r\nIt's just a timeout issue because the machine was too busy.\r\n\r\nFull logs:\r\n\r\n\u003cdetails\u003e\r\n\r\n```\r\n======================================================================\r\nFAIL: test_crash_during_func_exec_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolForkserverExecutorDeadlockTest.test_crash_during_func_exec_on_worker)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 128, in _check_crash\r\n    res.result(timeout=self.TIMEOUT)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/_base.py\", line 458, in result\r\n    raise TimeoutError()\r\nTimeoutError\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 154, in test_crash_during_func_exec_on_worker\r\n    self._check_crash(BrokenProcessPool, _crash)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132, in _check_crash\r\n    self._fail_on_deadlock(executor)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 109, in _fail_on_deadlock\r\n    self.fail(f\"Executor deadlock:\\n\\n{tb}\")\r\nAssertionError: Executor deadlock:\r\n\r\nThread 0xf5deb440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 341 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/queues.py\", line 231 in _feed\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 996 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nThread 0xf53ff440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/selectors.py\", line 398 in select\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 1136 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 414 in wait_result_broken_or_wakeup\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 341 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nCurrent thread 0xf79af040 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 100 in _fail_on_deadlock\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132 in _check_crash\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 154 in test_crash_during_func_exec_on_worker\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 589 in _callTestMethod\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 634 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 690 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/runner.py\", line 240 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1152 in _run_suite\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1279 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 36 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 92 in test_func\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 48 in regrtest_runner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 95 in _load_run_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 138 in _runtest_env_changed_exc\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 223 in _runtest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 266 in run_single_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 82 in worker_process\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 105 in main\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 109 in \u003cmodule\u003e\r\n  File \"\u003cfrozen runpy\u003e\", line 88 in _run_code\r\n  File \"\u003cfrozen runpy\u003e\", line 198 in _run_module_as_main\r\n\r\n\r\n======================================================================\r\nFAIL: test_crash_during_result_pickle_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolForkserverExecutorDeadlockTest.test_crash_during_result_pickle_on_worker)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 128, in _check_crash\r\n    res.result(timeout=self.TIMEOUT)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/_base.py\", line 458, in result\r\n    raise TimeoutError()\r\nTimeoutError\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 167, in test_crash_during_result_pickle_on_worker\r\n    self._check_crash(BrokenProcessPool, _return_instance, CrashAtPickle)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132, in _check_crash\r\n    self._fail_on_deadlock(executor)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 109, in _fail_on_deadlock\r\n    self.fail(f\"Executor deadlock:\\n\\n{tb}\")\r\nAssertionError: Executor deadlock:\r\n\r\nThread 0xf5deb440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 341 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/queues.py\", line 231 in _feed\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 996 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nThread 0xf53ff440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/selectors.py\", line 398 in select\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 1136 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 414 in wait_result_broken_or_wakeup\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 341 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nCurrent thread 0xf79af040 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 100 in _fail_on_deadlock\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132 in _check_crash\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 167 in test_crash_during_result_pickle_on_worker\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 589 in _callTestMethod\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 634 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 690 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/runner.py\", line 240 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1152 in _run_suite\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1279 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 36 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 92 in test_func\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 48 in regrtest_runner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 95 in _load_run_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 138 in _runtest_env_changed_exc\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 223 in _runtest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 266 in run_single_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 82 in worker_process\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 105 in main\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 109 in \u003cmodule\u003e\r\n  File \"\u003cfrozen runpy\u003e\", line 88 in _run_code\r\n  File \"\u003cfrozen runpy\u003e\", line 198 in _run_module_as_main\r\n\r\n\r\n======================================================================\r\nFAIL: test_crash_at_task_unpickle (test.test_concurrent_futures.test_deadlock.ProcessPoolSpawnExecutorDeadlockTest.test_crash_at_task_unpickle)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 128, in _check_crash\r\n    res.result(timeout=self.TIMEOUT)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/_base.py\", line 458, in result\r\n    raise TimeoutError()\r\nTimeoutError\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 150, in test_crash_at_task_unpickle\r\n    self._check_crash(BrokenProcessPool, id, CrashAtUnpickle())\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132, in _check_crash\r\n    self._fail_on_deadlock(executor)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 109, in _fail_on_deadlock\r\n    self.fail(f\"Executor deadlock:\\n\\n{tb}\")\r\nAssertionError: Executor deadlock:\r\n\r\nThread 0xf5deb440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 341 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/queues.py\", line 231 in _feed\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 996 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nThread 0xf53ff440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/selectors.py\", line 398 in select\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 1136 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 414 in wait_result_broken_or_wakeup\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 341 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nCurrent thread 0xf79af040 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 100 in _fail_on_deadlock\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132 in _check_crash\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 150 in test_crash_at_task_unpickle\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 589 in _callTestMethod\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 634 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 690 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/runner.py\", line 240 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1152 in _run_suite\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1279 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 36 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 92 in test_func\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 48 in regrtest_runner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 95 in _load_run_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 138 in _runtest_env_changed_exc\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 223 in _runtest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 266 in run_single_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 82 in worker_process\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 105 in main\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 109 in \u003cmodule\u003e\r\n  File \"\u003cfrozen runpy\u003e\", line 88 in _run_code\r\n  File \"\u003cfrozen runpy\u003e\", line 198 in _run_module_as_main\r\n\r\n\r\nStderr:\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/queues.py\", line 250, in _feed\r\n    send_bytes(obj)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 185, in send_bytes\r\n    self._check_closed()\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 138, in _check_closed\r\n    raise OSError(\"handle is closed\")\r\nOSError: handle is closed\r\n\r\n======================================================================\r\nFAIL: test_crash_during_func_exec_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolSpawnExecutorDeadlockTest.test_crash_during_func_exec_on_worker)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 128, in _check_crash\r\n    res.result(timeout=self.TIMEOUT)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/_base.py\", line 458, in result\r\n    raise TimeoutError()\r\nTimeoutError\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 154, in test_crash_during_func_exec_on_worker\r\n    self._check_crash(BrokenProcessPool, _crash)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132, in _check_crash\r\n    self._fail_on_deadlock(executor)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 109, in _fail_on_deadlock\r\n    self.fail(f\"Executor deadlock:\\n\\n{tb}\")\r\nAssertionError: Executor deadlock:\r\n\r\nThread 0xf5deb440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 341 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/queues.py\", line 231 in _feed\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 996 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nThread 0xf53ff440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/selectors.py\", line 398 in select\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 1136 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 414 in wait_result_broken_or_wakeup\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 341 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nCurrent thread 0xf79af040 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 100 in _fail_on_deadlock\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132 in _check_crash\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 154 in test_crash_during_func_exec_on_worker\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 589 in _callTestMethod\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 634 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 690 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/runner.py\", line 240 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1152 in _run_suite\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1279 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 36 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 92 in test_func\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 48 in regrtest_runner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 95 in _load_run_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 138 in _runtest_env_changed_exc\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 223 in _runtest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 266 in run_single_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 82 in worker_process\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 105 in main\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 109 in \u003cmodule\u003e\r\n  File \"\u003cfrozen runpy\u003e\", line 88 in _run_code\r\n  File \"\u003cfrozen runpy\u003e\", line 198 in _run_module_as_main\r\n\r\n\r\nStderr:\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/queues.py\", line 250, in _feed\r\n    send_bytes(obj)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 185, in send_bytes\r\n    self._check_closed()\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 138, in _check_closed\r\n    raise OSError(\"handle is closed\")\r\nOSError: handle is closed\r\n\r\n======================================================================\r\nFAIL: test_crash_during_result_pickle_on_worker (test.test_concurrent_futures.test_deadlock.ProcessPoolSpawnExecutorDeadlockTest.test_crash_during_result_pickle_on_worker)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 128, in _check_crash\r\n    res.result(timeout=self.TIMEOUT)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/_base.py\", line 458, in result\r\n    raise TimeoutError()\r\nTimeoutError\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 167, in test_crash_during_result_pickle_on_worker\r\n    self._check_crash(BrokenProcessPool, _return_instance, CrashAtPickle)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132, in _check_crash\r\n    self._fail_on_deadlock(executor)\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 109, in _fail_on_deadlock\r\n    self.fail(f\"Executor deadlock:\\n\\n{tb}\")\r\nAssertionError: Executor deadlock:\r\n\r\nThread 0xf5deb440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 341 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/queues.py\", line 231 in _feed\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 996 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nThread 0xf53ff440 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/selectors.py\", line 398 in select\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/multiprocessing/connection.py\", line 1136 in wait\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 414 in wait_result_broken_or_wakeup\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/concurrent/futures/process.py\", line 341 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1059 in _bootstrap_inner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/threading.py\", line 1016 in _bootstrap\r\n\r\nCurrent thread 0xf79af040 (most recent call first):\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 100 in _fail_on_deadlock\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 132 in _check_crash\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/test_concurrent_futures/test_deadlock.py\", line 167 in test_crash_during_result_pickle_on_worker\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 589 in _callTestMethod\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 634 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/case.py\", line 690 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 122 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/suite.py\", line 84 in __call__\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/unittest/runner.py\", line 240 in run\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1152 in _run_suite\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/support/__init__.py\", line 1279 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 36 in run_unittest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 92 in test_func\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 48 in regrtest_runner\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 95 in _load_run_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 138 in _runtest_env_changed_exc\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 223 in _runtest\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/single.py\", line 266 in run_single_test\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 82 in worker_process\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 105 in main\r\n  File \"/var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/Lib/test/libregrtest/worker.py\", line 109 in \u003cmodule\u003e\r\n  File \"\u003cfrozen runpy\u003e\", line 88 in _run_code\r\n  File \"\u003cfrozen runpy\u003e\", line 198 in _run_module_as_main\r\n\r\n\r\n----------------------------------------------------------------------\r\nRan 45 tests in 491.342s\r\n\r\nFAILED (failures=5)\r\n```\r\n\r\n\u003c/details\u003e\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-109703\n* gh-109705\n* gh-109708\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/vstinner","@type":"Person","name":"vstinner"},"datePublished":"2023-09-22T00:28:32.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/109702/cpython/issues/109702"}