René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Numerous refleaks on main","articleBody":"https://buildbot.python.org/all/#/release_status shows that the refleak buildbots are failing on current main. Example output on https://buildbot.python.org/all/#/builders/75/builds/745/steps/5/logs/warnings__111_.\r\n\r\nFailing tests:\r\n\r\n\u003cdetails\u003e\r\n\r\n```\r\ntest_functools leaked [1, 1, 2] references, sum=4\r\ntest_warnings leaked [4, 4, 4] references, sum=12\r\ntest_ipaddress leaked [6, 6, 6] references, sum=18\r\ntest_zoneinfo leaked [7, 6, 11] references, sum=24\r\nFAIL: test_flock (__main__.FNTLEINTRTest.test_flock)\r\ntest_random leaked [1, 2, 4] references, sum=7\r\ntest_statistics leaked [175, 174, 175] references, sum=524\r\ntest_dataclasses leaked [3, 3, 2] references, sum=8\r\ntest_argparse leaked [69, 70, 76] references, sum=215\r\n/home/dje/cpython-buildarea/3.x.edelsohn-rhel8-z.refleak/build/Lib/test/support/__init__.py:743: ResourceWarning: unclosed \u003csocket.socket [closed] fd=3, family=2, type=1, proto=6\u003e\r\nResourceWarning: Enable tracemalloc to get the object allocation traceback\r\n./home/dje/cpython-buildarea/3.x.edelsohn-rhel8-z.refleak/build/Lib/test/support/__init__.py:743: ResourceWarning: unclosed \u003csocket.socket [closed] fd=3, family=2, type=1, proto=6\u003e\r\nResourceWarning: Enable tracemalloc to get the object allocation traceback\r\n./home/dje/cpython-buildarea/3.x.edelsohn-rhel8-z.refleak/build/Lib/test/support/__init__.py:743: ResourceWarning: unclosed \u003csocket.socket [closed] fd=3, family=2, type=1, proto=6\u003e\r\nResourceWarning: Enable tracemalloc to get the object allocation traceback\r\n./home/dje/cpython-buildarea/3.x.edelsohn-rhel8-z.refleak/build/Lib/test/support/__init__.py:743: ResourceWarning: unclosed \u003csocket.socket [closed] fd=3, family=2, type=1, proto=6\u003e\r\nResourceWarning: Enable tracemalloc to get the object allocation traceback\r\n./home/dje/cpython-buildarea/3.x.edelsohn-rhel8-z.refleak/build/Lib/test/support/__init__.py:743: ResourceWarning: unclosed \u003csocket.socket [closed] fd=3, family=2, type=1, proto=6\u003e\r\nResourceWarning: Enable tracemalloc to get the object allocation traceback\r\n./home/dje/cpython-buildarea/3.x.edelsohn-rhel8-z.refleak/build/Lib/test/support/__init__.py:743: ResourceWarning: unclosed \u003csocket.socket [closed] fd=3, family=2, type=1, proto=6\u003e\r\nResourceWarning: Enable tracemalloc to get the object allocation traceback\r\ntest_tarfile leaked [17, 17, 16] references, sum=50\r\ntest_typing leaked [95, 121, 95] references, sum=311\r\ntest_typing leaked [1, 14, 1] memory blocks, sum=16\r\ntest_lib2to3 leaked [5, 8, 6] references, sum=19\r\ntest_shutil leaked [2, 2, 2] references, sum=6\r\ntest_unittest leaked [8, 12, 15] references, sum=35\r\ntest_logging leaked [3, 2, 1] references, sum=6\r\ntest__xxsubinterpreters leaked [46, 45, 45] references, sum=136\r\ntest_mailbox leaked [2, 3, 2] references, sum=7\r\ntest_socket leaked [24, 23, 23] references, sum=70\r\ntest_htmlparser leaked [2, 2, 2] references, sum=6\r\ntest_regrtest leaked [9, 12, 8] references, sum=29\r\ntest_datetime leaked [11, 11, 11] references, sum=33\r\ntest_nntplib leaked [1, 3, 2] references, sum=6\r\ntest_ftplib leaked [10, 13, 9] references, sum=32\r\ntest_interpreters leaked [54, 54, 54] references, sum=162\r\ntest_zipfile leaked [3, 4, 4] references, sum=11\r\ntest_sys_settrace leaked [6, 6, 6] references, sum=18\r\ntest_descr leaked [3, 65, 67] references, sum=135\r\ntest_compile leaked [7, 7, 7] references, sum=21\r\ntest_bytes leaked [2, 2, 2] references, sum=6\r\ntest_ast leaked [9, 9, 9] references, sum=27\r\ntest_poplib leaked [3, 3, 2] references, sum=8\r\ntest_types leaked [8, 50, 43] references, sum=101\r\ntest_concurrent_futures leaked [11, 12, 11] references, sum=34\r\ntest_genericalias leaked [2, 2, 3] references, sum=7\r\ntest_math leaked [32, 31, 33] references, sum=96\r\ntest_numeric_tower leaked [2, 1, 2] references, sum=5\r\ntest_capi leaked [99, 99, 99] references, sum=297\r\ntest_import leaked [170, 171, 168] references, sum=509\r\ntest_import leaked [71, 71, 70] memory blocks, sum=212\r\n.test test_monitoring failed -- multiple errors occurred; run in verbose mode for details\r\ntest_selectors leaked [5, 6, 4] references, sum=15\r\ntest_email leaked [27, 26, 25] references, sum=78\r\ntest_subprocess leaked [1, 1, 1] references, sum=3\r\ntest_struct leaked [1, 1, 1] references, sum=3\r\ntest_weakref leaked [1, 1, 1] references, sum=3\r\ntest_imaplib leaked [2, 2, 1] references, sum=5\r\n0:45:54 load avg: 0.13 Re-running failed tests in verbose mode\r\n0:45:54 load avg: 0.13 Re-running test_functools in verbose mode\r\ntest_functools leaked [1, 1, 2] references, sum=4\r\n0:45:55 load avg: 0.13 Re-running test_warnings in verbose mode\r\ntest_warnings leaked [4, 4, 4] references, sum=12\r\n0:45:59 load avg: 0.20 Re-running test_ipaddress in verbose mode\r\ntest_ipaddress leaked [6, 6, 6] references, sum=18\r\n0:46:00 load avg: 0.20 Re-running test_zoneinfo in verbose mode\r\ntest_zoneinfo leaked [7, 6, 11] references, sum=24\r\n```\r\n\r\n\u003c/details\u003e\r\n\r\nI saw similar leaks triggering the refleak buildbots on #103866 and #103764, before I realized the issue was probably on main.\r\n\r\nBased on @sunmy2019's work in https://github.com/python/cpython/pull/103764#issuecomment-1522831646, we're likely leaking references to the `object.__setattr__` wrapper descriptor.\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-103882\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/JelleZijlstra","@type":"Person","name":"JelleZijlstra"},"datePublished":"2023-04-26T13:03:34.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":16},"url":"https://github.com/103879/cpython/issues/103879"}