René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"test.support.os_helper.rmdir(): PermissionError: [WinError 32] The process cannot access the file because it is being used by another process","articleBody":"On Windows, it's common that a test fails at exit when trying to remove a temporary directory created by a test. Usually, it's because the test spawns a child process in this directory and the test tries to remove the temporary directory before the child process completes.\r\n\r\nFor example, temp_dir() of test.support.os_helper creates a temporary directory and then deletes it with rmtree(path) of test.support.os_helper: this function is different than shutil.rmtree(), it tries again on error with a timeout of 1.0 second.\r\n\r\nBut sometimes, the function fails with the error \"PermissionError: [WinError 32] The process cannot access the file because it is being used by another process\" on the os.rmdir() step.\r\n\r\nIf os.rmdir() fails with PermissionError, it would be nice to try again later.\r\n\r\nNotes:\r\n\r\n* I'm not sure why there is a fixed timeout of 1.0 second. I would prefer to use SHORT_TIMEOUT, or even LONG_TIMEOUT, of test.support.\r\n* _force_run() should use test.support.sleeping_retry()\r\n\r\n```\r\nTraceback (most recent call last):\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\os_helper.py\", line 483, in temp_dir\r\n    yield path\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\os_helper.py\", line 536, in temp_cwd\r\n    yield cwd_dir\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\libregrtest\\main.py\", line 701, in main\r\n    self._main(tests, kwargs)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\libregrtest\\main.py\", line 722, in _main\r\n    run_tests_worker(self.ns, self.worker_test_name)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\libregrtest\\runtest_mp.py\", line 101, in run_tests_worker\r\n    sys.exit(0)\r\nSystemExit: 0\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\__init__.py\", line 203, in _force_run\r\n    return func(*args)\r\n           ^^^^^^^^^^^\r\nPermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'D:\\\\a\\\\cpython\\\\cpython\\\\build\\\\test_python_4372�\\\\test_python_worker_1096�'\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\runpy.py\", line 198, in _run_module_as_main\r\n    return _run_code(code, main_globals, None,\r\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\runpy.py\", line 88, in _run_code\r\n    exec(code, run_globals)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\regrtest.py\", line 47, in \u003cmodule\u003e\r\n    _main()\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\regrtest.py\", line 43, in _main\r\n    main()\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\libregrtest\\main.py\", line 763, in main\r\n    Regrtest().main(tests=tests, **kwargs)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\libregrtest\\main.py\", line 695, in main\r\n    with os_helper.temp_cwd(test_cwd, quiet=True):\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\contextlib.py\", line 155, in __exit__\r\n    self.gen.throw(value)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\os_helper.py\", line 534, in temp_cwd\r\n    with temp_dir(path=name, quiet=quiet) as temp_path:\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\contextlib.py\", line 155, in __exit__\r\n    self.gen.throw(value)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\os_helper.py\", line 488, in temp_dir\r\n    rmtree(path)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\os_helper.py\", line 445, in rmtree\r\n    _rmtree(path)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\os_helper.py\", line 389, in _rmtree\r\n    _waitfor(lambda p: _force_run(p, os.rmdir, p), path)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\os_helper.py\", line 333, in _waitfor\r\n    func(pathname)\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\os_helper.py\", line 389, in \u003clambda\u003e\r\n    _waitfor(lambda p: _force_run(p, os.rmdir, p), path)\r\n                       ^^^^^^^^^^^^^^^^^^^^^^^^^^\r\n  File \"D:\\a\\cpython\\cpython\\Lib\\test\\support\\__init__.py\", line 214, in _force_run\r\n    return func(*args)\r\n           ^^^^^^^^^^^\r\nPermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'D:\\\\a\\\\cpython\\\\cpython\\\\build\\\\test_python_4372�\r\n```\r\n\r\n\u003c!-- gh-linked-prs --\u003e\r\n### Linked PRs\r\n- gh-99464\r\n- gh-99504\r\n\r\n\u003c!-- /gh-linked-prs --\u003e\r\n","author":{"url":"https://github.com/vstinner","@type":"Person","name":"vstinner"},"datePublished":"2022-10-12T15:17:28.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":4},"url":"https://github.com/98219/cpython/issues/98219"}