René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Why do we have two counters for function versions?","articleBody":"In the interpreter state there are two separate counters that are used to generate unique versions for code and function objects. Both counters share the following properties:\r\n- The counter is an unsigned 32-bit int initialized to `1`\r\n- When a new version is needed, the current value of the counter is used, and unless the counter is zero, the counter is incremented\r\n- When the counter overflows to `0`, it remains zero, and no new versions can be allocated (in this case the specializer will just give up -- hopefully this never happens in real code, creating four billion code objects is just hard to imagine)\r\n\r\nThere are two ways that a **function object** obtains a version:\r\n- The usual path is when a function object is created by the `MAKE_FUNCTION` bytecode. In this case it gets the version from the code object. (See below.)\r\n- When an assignment is made to `func.__code__` or a few other attributes, the function version is reset, and if the specializer later needs a function version, a new version number is taken from `interp-\u003efunc_state.next_version` by `_PyFunction_GetVersionForCurrentState()`. \r\n\r\nCode objects obtain a version when they are created from `interp-\u003enext_func_version`.\r\n\r\nI believe there's a scenario where two unrelated function objects could end up with the same version:\r\n- one function is created with a version derived from its code object, i.e. from `interp-\u003enext_func_version`;\r\n- the other has had its `__code__` attribute modified, and then obtains a fresh version from  `interp-\u003efunc_state.next_version`, which somehow has the same value as the other counter had -- this should be possible because the counters are managed independently.\r\n\r\nI looked a bit into the history, and it looks like in 3.11 there was only a static global `next_func_version` in funcobject.c, which was used by `_PyFunction_GetVersionForCurrentState()`. In 3.12 the current structure exists, except `next_func_version` is still a static global (`func_state` however is an interpreter member). It seems that this was introduced by gh-98525 (commit: https://github.com/python/cpython/commit/fb713b21833a17cba8022af0fa4c486512157d4b). Was it intentional to use two separate counters? If so, what was the rationale? (If it had to do with deepfreeze, that rationale is now gone, as we no longer use it.)\r\n\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-116918\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/gvanrossum","@type":"Person","name":"gvanrossum"},"datePublished":"2024-03-16T21:11:32.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/116916/cpython/issues/116916"}