René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"expose API for writing perf map files","articleBody":"https://github.com/python/cpython/pull/96123 added support for CPython to write `/tmp/perf-\u003cpid\u003e.map` files, associating instruction address ranges with a human-readable frame name for the Linux `perf` profiler.\r\n\r\nTwo external Python JIT compilers, [Cinder](https://github.com/facebookincubator/cinder/blob/cinder/3.10/Jit/perf_jitdump.cpp#L177-L185) and [Pyston](https://github.com/pyston/pyston/blob/dee48edd457518cf3d2cb93648f9cffe8aad6bce/Python/aot_ceval_jit.c#L5782-L5796), both also independently write to perf map files.\r\n\r\nSince perf map files are one-per-process, multiple separate libraries trying to write perf map entries independently can lead to file corruption from simultaneous writes.\r\n\r\nIt's unlikely for both Cinder and Pyston JITs to be used in the same process, but it's quite reasonable to use one of these JITs along with CPython's native perf trampoline support.\r\n\r\nIn order for this to be safe, CPython should expose a thread-safe API for writing perf map entries that all these clients can use.\r\n\r\n(We've backported the 3.12 perf trampolines feature to Cinder 3.10 and experimented with using it, and we've seen this write corruption problem occur in practice; it's not just a theoretical risk we identified.)\r\n\r\ncc @pablogsal , @kmod \n\n\u003c!-- gh-linked-prs --\u003e\n### Linked PRs\n* gh-103546\n* gh-104811\n* gh-104823\n\u003c!-- /gh-linked-prs --\u003e\n","author":{"url":"https://github.com/carljm","@type":"Person","name":"carljm"},"datePublished":"2023-04-05T23:07:38.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":18},"url":"https://github.com/103295/cpython/issues/103295"}