René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Add streaming to `profiling.sampling`","articleBody":"# Feature or enhancement\n\n### Proposal:\n\nRight now, `profiling.sampling` has roughly two modes: live with the TUI, and snapshot-at-the-end (except binary? but see the note below.) There's nothing that streams the data continously as it comes. This would be ideal for long-running headless profiling.\n\nThis one is less defined than #145411, so there are more open questions:\n\n* Should it stream raw or agreggate data?  What should be the window?\n* What should be the format? Unfortunately, from what I checked the current binary format is not really well-suited for streaming, as it saves the dictionaries only on finalize.\n* What should be the transport layers for streaming?\n* What should be the types of messages?\n* What should be the configuration flags?\n* How the backpressure should be handled? Should it drop the oldest? All the oldest?\n\nMy hunch is:\n\n- support both raw and aggregate and assume that aggregate is just a different message type.\n- start with something simple as JSONL\n- I have mixed feelings about the transport layer. The stdout sounds great on paper but it's a mixed-use channel right now and there's a question around blocking by slower consumers. Maybe for debugging? Unix socket is good but not perfectly portable\n- as for backpressure, I would just drop the oldest by default, but only the `raw`, `agg` and `heartbeat` messages.\n\nFor starters:\n\n* `--stream unix:/tmp/tachyon-stream.sock` or `--stream file:/tmp/tachyon-stream.sock` (later: `--stream tcp:127.0.0.1:1234`)\n* `--stream-types meta|str_def|frame_def|raw|agg:5s|loss|heartbeat|end|error` (comma separated; note the `agg:5s` here; we it could be extended to `heartbeat:1s` etc. in the future)\n* `--stream-format jsonl`\n\nThen, in the next phases we could think of `--stream-drop-policy` etc.\n\n### Has this already been discussed elsewhere?\n\nNo response given\n\n### Links to previous discussion of this feature:\n\n_No response_","author":{"url":"https://github.com/maurycy","@type":"Person","name":"maurycy"},"datePublished":"2026-03-03T11:25:46.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":6},"url":"https://github.com/145464/cpython/issues/145464"}