René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Benchmark stdlib compression code","articleBody":"At PyConUS, I was chatting with @gpshead about adding compression benchmarks. While a lot of the \"heavy lifting\" of compression happens in the libraries CPython binds (zlib, liblzma, etc.), the handling of output buffers in CPython has a significant impact in performance, and is something we don't have a lot of visibility into the performance of.\n\nOne of the better known cross-algorithm compression benchmarks I'm aware of is [lzbench](https://github.com/inikep/lzbench), which tests compression performance of the [Silesia compression corpus](http://sun.aei.polsl.pl/~sdeor/index.php?page=silesia) across many algorithms. I figure running compression benchmarks at varied settings on Silesia would provide a good starting point for benchmarking the output buffer and other binding code.\n\n","author":{"url":"https://github.com/emmatyping","@type":"Person","name":"emmatyping"},"datePublished":"2025-05-22T21:48:46.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":5},"url":"https://github.com/392/pyperformance/issues/392"}