René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Generator finalization is slower in 3.11 vs 3.10","articleBody":"I found that the Python 3.11.1 implementation of all() is 30% slower compared to Python 3.10.9.\r\n\r\nany() also seems to be around 4% slower on my device\r\n\r\n# Environment\r\n- CPython versions tested on: Python 3.10.9 and Python 3.11.1\r\n- Operating system and architecture: Windows 10 22H2 (Build 19045) 64 bit\r\n\r\n# Code to test all():\r\n```python \r\nimport timeit\r\nfrom functools import partial\r\nimport platform\r\n\r\n\r\ndef find_by_keys(\r\n    keys: list[str],\r\n    table: list[dict[str, str | int]],\r\n    match_data: dict[str, str | int],\r\n) -\u003e dict[str, str | int] | None:\r\n    for item in table:\r\n        if all(item[k] == match_data[k] for k in keys):\r\n            return item\r\n    return None\r\n\r\n\r\ndef main():\r\n    keys: list[str] = [\"id\", \"key_1\", \"key_2\"]\r\n    table: list[dict[str, str | int]] = [\r\n        {\r\n            \"id\": i,\r\n            \"key_1\": \"val_1\",\r\n            \"key_2\": \"val_2\",\r\n        }\r\n        for i in range(1, 5001)\r\n    ]\r\n    match_data: dict[str, str | int] = {\r\n        \"id\": 3000,\r\n        \"key_1\": \"val_1\",\r\n        \"key_2\": \"val_2\",\r\n    }\r\n\r\n    timeit_output = timeit.repeat(\r\n        partial(find_by_keys, keys, table, match_data), repeat=10000, number=1\r\n    )\r\n\r\n    average_time = sum(timeit_output) / len(timeit_output)\r\n    best_time = min(timeit_output)\r\n    tps_output = 1 / average_time\r\n\r\n    print(f\"Python version = {platform.python_version()}\")\r\n    print(f\"Average time = {average_time}\")\r\n    print(f\"Best time = {best_time}\")\r\n    print(f\"Average transactions per second = {tps_output}\")\r\n\r\n\r\nif __name__ == \"__main__\":\r\n    main()\r\n\r\n```\r\n \r\n# Results for all()\r\n\r\nConsole output using Python 3.10.9:\r\n```\r\nPython version = 3.10.9\r\nAverage time = 0.0008256170657486655\r\nBest time = 0.0007106999401003122\r\nAverage transactions per second = 1211.2152733824669\r\n```\r\n\r\nConsole output using Python 3.11.1:\r\n```\r\nPython version = 3.11.1\r\nAverage time = 0.0011819988898839802\r\nBest time = 0.001033599954098463\r\nAverage transactions per second = 846.0244832363215\r\n```\r\n\r\n\r\n# Code to test any():\r\n```python \r\nimport timeit\r\nfrom functools import partial\r\nimport platform\r\n\r\n\r\ndef find_by_keys(\r\n    keys: list[str],\r\n    table: list[dict[str, str | int]],\r\n    match_data: dict[str, str | int],\r\n) -\u003e dict[str, str | int] | None:\r\n    for item in table:\r\n        if any(item[k] == match_data[k] for k in keys):\r\n            return item\r\n    return None\r\n\r\n\r\ndef main():\r\n    keys: list[str] = [\"id\", \"key_1\", \"key_2\"]\r\n    table: list[dict[str, str | int]] = [\r\n        {\r\n            \"id\": i,\r\n            \"key_1\": \"foo_1\",\r\n            \"key_2\": \"foo_2\",\r\n        }\r\n        for i in range(1, 5001)\r\n    ]\r\n    match_data: dict[str, str | int] = {\r\n        \"id\": 3000,\r\n        \"key_1\": \"val_1\",\r\n        \"key_2\": \"val_2\",\r\n    }\r\n\r\n    timeit_output = timeit.repeat(\r\n        partial(find_by_keys, keys, table, match_data), repeat=10000, number=1\r\n    )\r\n\r\n    average_time = sum(timeit_output) / len(timeit_output)\r\n    best_time = min(timeit_output)\r\n    tps_output = 1 / average_time\r\n\r\n    print(f\"Python version = {platform.python_version()}\")\r\n    print(f\"Average time = {average_time}\")\r\n    print(f\"Best time = {best_time}\")\r\n    print(f\"Average transactions per second = {tps_output}\")\r\n\r\n\r\nif __name__ == \"__main__\":\r\n    main()\r\n\r\n```\r\n \r\n# Results for any()\r\n\r\nConsole output using Python 3.10.9:\r\n```\r\nPython version = 3.10.9\r\nAverage time = 0.0009300541202770546\r\nBest time = 0.00090230000205338\r\nAverage transactions per second = 1075.206246817238\r\n```\r\n\r\nConsole output using Python 3.11.1:\r\n```\r\nPython version = 3.11.1\r\nAverage time = 0.0009645268900785595\r\nBest time = 0.000930099980905652\r\nAverage transactions per second = 1036.7777303943815\r\n```\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-101011\n* gh-101013\n* gh-101316\n* gh-111069\n* gh-115818\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/Onlooker2186","@type":"Person","name":"Onlooker2186"},"datePublished":"2023-01-05T00:02:06.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":31},"url":"https://github.com/100762/cpython/issues/100762"}