René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Some tests consume too much memory","articleBody":"Several years ago, all tests, except bigmem tests could be ran sequentially with just 650 MB of memory. There were issues with some buldbots (e.g. AIX) which small RAM, because excess memory consumption not always caused a quick test failure, but could cause swapping and failing tests at timeout 2 hours later. So all tests with high memory consumption were decorated with `bigmemtest`.\n\nNow, some tests need more than 1 GB of memory, or even more than 2 GB. Not all buildbots have such much.\n\nThe main culprit is running too many threads. Every thread needs 35, 70 or even 90 MB, depending on test.\n\nThere are two possible solutions:\n\n1. Decrease the number of threads. Some tests can perform their function with fewer threads, but this must be decided individually so as not to make the test useless.\n2. Decorate the test with `bigmemtest`. This will skip it on most buildbots.\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-133456\n* gh-133458\n* gh-133663\n* gh-133664\n* gh-134575\n* gh-134589\n* gh-135046\n* gh-135047\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/serhiy-storchaka","@type":"Person","name":"serhiy-storchaka"},"datePublished":"2025-05-05T16:42:08.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/133454/cpython/issues/133454"}