René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Switching between the JIT and interpreter is too slow.","articleBody":"A key part of the original design thesis for the JIT was that it was OK to jit small sections of code, provided that the cost of entering and exiting jjitted code was small enough.\nIdeally, entering (and exiting) jitted code should cost no more than 2 or 3 instruction dispatches in the interpreter.\n\nAt the moment, we are nowhere near that.\n\nTo achieve that low overhead, we need transfers to perform minimal memory accesses and use reasonably easily predictable branches.\n\n### What we have now \n#### ENTER_EXECUTOR\n\nThis is where code enters the jit. Currently this does an eval-breaker check (to avoid needing to perform an escaping call in the jit) then increfs the executor, to keep it alive, calls the shim frame, which then calls the actual jitted code.\n\n#### _EXIT_TRACE\n\nThis is where jitted code transfers control back to the interpreter or to other jitted code.\nThis uop contains complex logic to determine whether the exit is \"hot\", calls the jit compiler or jumps to other jitted code. Even in the case where jitted code already exists, it still needs to check for validity, before making a doubly dependent load to find the jitted code: `exit-\u003eexecutor-\u003ejitted_code`.\n\n### What we want:\n\nFirst of all, the interpreter and jit need to use the same calling convention. We can do this by using the tailcalling interpreter and TOS caching, such that the jitted code and interpreter functions take the same parameters.\n\nWe also want to refactor the executor or calling conventions, to save an indirection. ie. `exit-\u003ejit` rather than `exit-\u003eexecutor-\u003ejit`.\n\n#### ENTER_EXECUTOR\n\nWith the same calling convention, there should be no need for a shim frame. \nSo, apart from the eval-breaker check, `ENTER_EXECUTOR` only needs to find the executor and make the tailcall `executor-\u003ejit(...)`.\n\n#### _EXIT_TRACE\n\nBy handling cold exits and invalid executors in stubs, `_EXIT_TRACE` can avoid complex control flow and tailcall directly into the exit: `exit-\u003ejit(...)`.\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-136411\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/markshannon","@type":"Person","name":"markshannon"},"datePublished":"2025-07-08T08:57:02.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/136410/cpython/issues/136410"}