René's URL Explorer Experiment


Title: common: share the zlib stream engine by youknowone · Pull Request #8631 · RustPython/RustPython · GitHub

Open Graph Title: common: share the zlib stream engine by youknowone · Pull Request #8631 · RustPython/RustPython

X Title: common: share the zlib stream engine by youknowone · Pull Request #8631 · RustPython/RustPython

Description: Closes #xxxx One of checkbox below must be checked. I did not use AI to write the code of this patch. This PR follows our AI policy Summary Move the VM-independent zlib stream engine into the feature-gated rustpython-common::compression::zlib module and make the RustPython stdlib zlib module consume that shared engine. This removes the stdlib dependency on flate2, keeps zlib-rs as the pure-Rust backend, and provides exact stream-copy support needed by compressobj.copy(), decompressobj.copy(), copy.copy(), and copy.deepcopy(). It also enables the existing Z_BLOCK and wbits=0 test coverage. The common layer owns only byte buffers, stream state, and plain Rust errors. Python objects, exception mapping, and cached unused_data / unconsumed_tail identities remain in the stdlib adapter. Validation cargo test -p rustpython-common --features zlib compression::zlib cargo run --release -- -m test -v test_zlib (76 run, 4 skipped) cargo clippy -p rustpython-common -p rustpython-stdlib --all-targets -- -D warnings cargo test --workspace --exclude rustpython_wasm --exclude rustpython-venvlauncher --exclude rustpython-capi (cd crates/capi && cargo test) Windows GNU cross-check for rustpython-common --features zlib WASI release build with freeze-stdlib,stdlib AI disclosure Implementation, refactoring, and test iteration were assisted by Codex (GPT-5). The resulting code was reviewed through the native, Windows cross-build, WASI, Python-suite, workspace, C-API, and clippy checks listed above. Summary by CodeRabbit New Features Added shared zlib compression and decompression support. Added shared LZMA compression and decompression support on supported platforms. Added streaming compression and decompression, format detection, dictionary handling, checksums, and filter configuration. Bug Fixes Improved handling of incomplete input, unused data, end-of-file conditions, and compression errors. Improved gzip, raw-stream, flush-mode, and incremental-processing behavior. Corrected LZMA “alone” format handling and validation of compression options.

Open Graph Description: Closes #xxxx One of checkbox below must be checked. I did not use AI to write the code of this patch. This PR follows our AI policy Summary Move the VM-independent zlib stream engine into the ...

X Description: Closes #xxxx One of checkbox below must be checked. I did not use AI to write the code of this patch. This PR follows our AI policy Summary Move the VM-independent zlib stream engine into the ...

Opengraph URL: https://github.com/RustPython/RustPython/pull/8631

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:3f795d34-7023-c9b9-adb4-b7ba5dacaaeb
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idE5A2:B53AF:356053C:470E0B2:6B020386
html-safe-noncef8c03c8602d954258ef4e7f7520596f9f031591c2fbee02baa33be2bb75f8e1e
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFNUEyOkI1M0FGOjM1NjA1M0M6NDcwRTBCMjo2QjAyMDM4NiIsInZpc2l0b3JfaWQiOiIxNTQ1MDU4MjM4NjE3MzYzMjYiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac1c923c8c7dff81119f37916b4352252dc965e30e0d0390753734eea93842550f
hovercard-subject-tagpull_request:4404511353
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/RustPython/RustPython/pull/8631/files
twitter:imagehttps://avatars.githubusercontent.com/u/69878?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/69878?s=400&v=4
og:image:altCloses #xxxx One of checkbox below must be checked. I did not use AI to write the code of this patch. This PR follows our AI policy Summary Move the VM-independent zlib stream engine into the ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/RustPython/RustPython git https://github.com/RustPython/RustPython.git
octolytics-dimension-user_id39710557
octolytics-dimension-user_loginRustPython
octolytics-dimension-repository_id135201145
octolytics-dimension-repository_nwoRustPython/RustPython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id135201145
octolytics-dimension-repository_network_root_nwoRustPython/RustPython
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/RustPython/RustPython/pull/8631/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FRustPython%2FRustPython%2Fpull%2F8631%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FRustPython%2FRustPython%2Fpull%2F8631%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=RustPython%2FRustPython
Reloadhttps://github.com/RustPython/RustPython/pull/8631/files
Reloadhttps://github.com/RustPython/RustPython/pull/8631/files
Reloadhttps://github.com/RustPython/RustPython/pull/8631/files
RustPythonhttps://github.com/RustPython
RustPythonhttps://github.com/RustPython/RustPython
Codehttps://github.com/RustPython/RustPython
Issues195 (195)https://github.com/RustPython/RustPython/issues
Pull requests133 (133)https://github.com/RustPython/RustPython/pulls
Discussionshttps://github.com/RustPython/RustPython/discussions
Actionshttps://github.com/RustPython/RustPython/actions
Projectshttps://github.com/RustPython/RustPython/projects
Wikihttps://github.com/RustPython/RustPython/wiki
Security and qualityhttps://github.com/RustPython/RustPython/security
Insightshttps://github.com/RustPython/RustPython/insights
Sign up for GitHub https://github.com/signup?return_to=%2FRustPython%2FRustPython%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2FRustPython%2FRustPython%2Fissues%2Fnew%2Fchoose
youknowonehttps://github.com/youknowone
RustPython:mainhttps://github.com/RustPython/RustPython/tree/main
youknowone:common-compression-engineshttps://github.com/youknowone/RustPython/tree/common-compression-engines
Conversation 23 https://github.com/RustPython/RustPython/pull/8631
Commits 3 https://github.com/RustPython/RustPython/pull/8631/commits
Checks 29 https://github.com/RustPython/RustPython/pull/8631/checks
Files changed https://github.com/RustPython/RustPython/pull/8631/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/8631/files
common: share the zlib stream engine https://github.com/RustPython/RustPython/pull/8631/files#top
Show all changes 3 commits https://github.com/RustPython/RustPython/pull/8631/files
c3dff8f common: share the zlib stream engine youknowone Aug 31, 2026 https://github.com/RustPython/RustPython/pull/8631/commits/c3dff8fb171779fe58d13c893c530b2ba46fe109
360bfca common: share the lzma stream engine youknowone Aug 31, 2026 https://github.com/RustPython/RustPython/pull/8631/commits/360bfca30153315cecc15ee4d6d7340ece287575
ced5f4b common: address compression engine reviews youknowone Sep 1, 2026 https://github.com/RustPython/RustPython/pull/8631/commits/ced5f4b77091a2d12902db4538ac6e2f76eaae9a
Clear filters https://github.com/RustPython/RustPython/pull/8631/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/8631/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/8631/files
Cargo.lock https://github.com/RustPython/RustPython/pull/8631/files#diff-13ee4b2252c9e516a0547f2891aa2105c3ca71c6d7a1e682c69be97998dfc87e
Cargo.toml https://github.com/RustPython/RustPython/pull/8631/files#diff-2e9d962a08321605940b5a657135052fbcef87b5e360662bb527c96d9a615542
test_zlib.py https://github.com/RustPython/RustPython/pull/8631/files#diff-029a0ce1b89a517af9cd486ab867641e1c90e4ac089dded48ee1b65e604b64aa
Cargo.toml https://github.com/RustPython/RustPython/pull/8631/files#diff-67449309128bb90a86efa4567e238536ea0f347ae18098f8dbcd747de5b7b4ca
lzma.rs https://github.com/RustPython/RustPython/pull/8631/files#diff-83341d9b777a346e4c3fb79c3c2cb0165ca319852150f8bc3842aa4469b1f102
mod.rs https://github.com/RustPython/RustPython/pull/8631/files#diff-f2d3c2ab43fccf4482a1f36427b611c4f7df39bc55f8cbaeaa1cc63e6f3e4fd8
zlib.rs https://github.com/RustPython/RustPython/pull/8631/files#diff-5e4c07ee6dfbb37b2ec32a74d3404f6974cce0ac99fee9978c773c323bc12df4
lib.rs https://github.com/RustPython/RustPython/pull/8631/files#diff-84e11d13acaf28044921bb5a427cfbf511c70a0b3881949137ba4093df58e266
Cargo.toml https://github.com/RustPython/RustPython/pull/8631/files#diff-206ca536c8a0e972ae8dd6a3c7f1b87f2cf39bc248bc1ea0735ef140ab4b290c
compression.rs https://github.com/RustPython/RustPython/pull/8631/files#diff-fb0ac6165d435493262f9815232030893481fcfdd2830c7efca99301d5c53acb
lzma.rs https://github.com/RustPython/RustPython/pull/8631/files#diff-a6ce94ca49cec269e515f26f28731b5be2cf4b61942a9063906f23b16d9ef171
zlib.rs https://github.com/RustPython/RustPython/pull/8631/files#diff-f8e286f43f29e69c955b74f0c3d004275afcd1792367df0125fda136fb258c92
Cargo.toml https://github.com/RustPython/RustPython/pull/8631/files#diff-5b743c71dfc992501e49511ae0f681b46af76bac40bec59caf09667b4dd2b12c
Cargo.lockhttps://github.com/RustPython/RustPython/pull/8631/files#diff-13ee4b2252c9e516a0547f2891aa2105c3ca71c6d7a1e682c69be97998dfc87e
View file https://github.com/youknowone/RustPython/blob/ced5f4b77091a2d12902db4538ac6e2f76eaae9a/Cargo.lock
Open in desktop https://desktop.github.com
how customized files appear on GitHubhttps://docs.github.com/github/administering-a-repository/customizing-how-changed-files-appear-on-github
Please reload this pagehttps://github.com/RustPython/RustPython/pull/8631/files
Cargo.tomlhttps://github.com/RustPython/RustPython/pull/8631/files#diff-2e9d962a08321605940b5a657135052fbcef87b5e360662bb527c96d9a615542
View file https://github.com/youknowone/RustPython/blob/ced5f4b77091a2d12902db4538ac6e2f76eaae9a/Cargo.toml
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/8631/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/8631/files#diff-2e9d962a08321605940b5a657135052fbcef87b5e360662bb527c96d9a615542
https://github.com/RustPython/RustPython/pull/8631/files#diff-2e9d962a08321605940b5a657135052fbcef87b5e360662bb527c96d9a615542
https://github.com/RustPython/RustPython/pull/8631/files#diff-2e9d962a08321605940b5a657135052fbcef87b5e360662bb527c96d9a615542
Lib/test/test_zlib.pyhttps://github.com/RustPython/RustPython/pull/8631/files#diff-029a0ce1b89a517af9cd486ab867641e1c90e4ac089dded48ee1b65e604b64aa
View file https://github.com/youknowone/RustPython/blob/ced5f4b77091a2d12902db4538ac6e2f76eaae9a/Lib/test/test_zlib.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/8631/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/8631/files#diff-029a0ce1b89a517af9cd486ab867641e1c90e4ac089dded48ee1b65e604b64aa
https://github.com/RustPython/RustPython/pull/8631/files#diff-029a0ce1b89a517af9cd486ab867641e1c90e4ac089dded48ee1b65e604b64aa
https://github.com/RustPython/RustPython/pull/8631/files#diff-029a0ce1b89a517af9cd486ab867641e1c90e4ac089dded48ee1b65e604b64aa
https://github.com/RustPython/RustPython/pull/8631/files#diff-029a0ce1b89a517af9cd486ab867641e1c90e4ac089dded48ee1b65e604b64aa
crates/common/Cargo.tomlhttps://github.com/RustPython/RustPython/pull/8631/files#diff-67449309128bb90a86efa4567e238536ea0f347ae18098f8dbcd747de5b7b4ca
View file https://github.com/youknowone/RustPython/blob/ced5f4b77091a2d12902db4538ac6e2f76eaae9a/crates/common/Cargo.toml
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/8631/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/8631/files#diff-67449309128bb90a86efa4567e238536ea0f347ae18098f8dbcd747de5b7b4ca
https://github.com/RustPython/RustPython/pull/8631/files#diff-67449309128bb90a86efa4567e238536ea0f347ae18098f8dbcd747de5b7b4ca
Please reload this pagehttps://github.com/RustPython/RustPython/pull/8631/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/8631/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.