René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Tail calling interpreter for MSVC","articleBody":"# Feature or enhancement\n\n### Proposal:\n\nWe should get tail calling interpreter support for MSVC.\nThe latest up-to-date figures for the tail calling interpreter are:\n* 1-3% pyperformance faster on Ubuntu x64\n* 4-5% pyperformance faster on macOS AArch64\n* The last benchmarks for the tail calling interpreter on Windows MSVC reported a [17% speedup on pyperformance](https://github.com/mdboom/msvc-tailcall-analysis).\n\nOn Windows, the performance isn't easy to measure because `pyperf system tune` doesn't work on there. However, on a best-effort quiet system and some benchmarks from pyperformance on my system, these are my results:\n\n```\nMean +- std dev: [spectralnorm_tc_no] 146 ms +- 1 ms -\u003e [spectralnorm_tc] 98.3 ms +- 1.1 ms: 1.48x faster\nMean +- std dev: [nbody_tc_no] 145 ms +- 2 ms -\u003e [nbody_tc] 107 ms +- 2 ms: 1.35x faster\nMean +- std dev: [bm_django_template_tc_no] 26.9 ms +- 0.5 ms -\u003e [bm_django_template_tc] 22.8 ms +- 0.4 ms: 1.18x faster\nMean +- std dev: [xdsl_tc_no] 64.2 ms +- 1.6 ms -\u003e [xdsl_tc] 56.1 ms +- 1.5 ms: 1.14x faster\n```\nNote that I had to apply a 2-line patch to fix xDSL for Python 3.15.\n\nNbody and spectralnorm are toy shootout benchmarks. xDSL is a [new benchmark](https://github.com/python/pyperformance/blob/main/pyperformance/data-files/benchmarks/bm_xdsl/run_benchmark.py) added that is a MLIR DSL library with written almost entirely in pure Python. I consider it a pure-Python large library not too far off from mypy (though it's obviously smaller). 14% faster for xDSL is massive. It's roughly half of the [speedup we got in 3.11 with the specializing interpreter](https://github.com/EdmundGoodman/masters-project-report/tree/0f55308d74e9634de79ea32582bad0212693508d), and that was thousands of lines of code. This change in contrast will be just one PR. [Django templating](https://github.com/python/pyperformance/tree/main/pyperformance/data-files/benchmarks/bm_django_template) shows a big speedup too -- 18% faster.\n\nThis could not have been possible without help from the MSVC team. Specifically, I'd like to give a shoutout to Hulon Jenkins and the MSVC team in the patch notes when I land this.\n\nI've discussed this during the Wednesday CHIPS meetings, and there was no opposition to the new set of changes required to get this working. The changes are minimal and mostly just involve adding correct `restrict` and scoping to things to tell MSVC a local variable doesn't escape. This should also benefit GCC and Clang in some fashion.\n\nWe require working CI before this is merged, so I am now waiting on GitHub actions or some other CI to get this working.\n\nVery special shoutout as well to @chris-eibl who has been helping me with this on Windows.\n\nSome other benefits: the TC on MSVC actually correctly \"resets\" the inlining heuristic on MSVC. This means eventually we can get rid of all the macros and ugly hacks we have to make the current interpreter faster on MSVC once we distribute the builds with tail calling. Example of a hack where we use macros over static inlines on MSVC just because of the interpreter loop breaking the inliniing heuristics of MSVC https://github.com/python/cpython/issues/121263\n\n#### Possibility of a compiler bug this time\n\nI doubt it, as MSVC has no computed goto, so it can't have the same bug as Clang that we bumped into the previous time.\n\n#### Where are the perf gains coming from?\n\nIt's mainly the better inlining that we get from the tail calling interpreter, and elimination of double jumps vs the switch-case interpreter.\n\n### Has this already been discussed elsewhere?\n\nNo response given\n\n### Links to previous discussion of this feature:\n\n_No response_\n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-139962\n* gh-143068\n* gh-143087\n* gh-143242\n* gh-146391\n* gh-146570\n* gh-148035\n* gh-148036\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/Fidget-Spinner","@type":"Person","name":"Fidget-Spinner"},"datePublished":"2025-10-10T19:36:02.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/139922/cpython/issues/139922"}