René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Doc tests action takes too long","articleBody":"## Issue\r\n\r\nUsually doctest's action's \"Run documentation doctest\"[^1] job takes around 12 minutes[^2] to execute. Most of this time is taken by the internal framework doctest.py[^3]. The cause of the issue is GC regression in Python 3.13.\r\n\r\n## Potential Solution\r\nFix #124567 \r\n\r\n## Additional Improvements\r\n### Improve doctest performance\r\nSince the tests are not interconnected (between different doc files), they can be easily parallelized. I suggest using `ProcessPoolExecutor` that will be suitable to \"bypass\" GIL (assuming that tasks are CPU-bound). Github runners have 4 cores available[^4], so, potentially, it can speed up execution by up to 4 times.\r\n\r\n@AlexWaygood @erlend-aasland \r\n\r\n[^1]: https://github.com/python/cpython/blob/7ac933e2609b2ef9b08ccf9c815b682b0e1ede2a/.github/workflows/reusable-docs.yml#L108\r\n[^2]: https://github.com/python/cpython/actions/runs/8922903843/job/24506021604\r\n[^3]: https://github.com/python/cpython/blob/main/Lib/doctest.py\r\n[^4]: https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners/about-github-hosted-runners#standard-github-hosted-runners-for-public-repositories","author":{"url":"https://github.com/Privat33r-dev","@type":"Person","name":"Privat33r-dev"},"datePublished":"2024-05-10T10:56:16.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":26},"url":"https://github.com/118891/cpython/issues/118891"}