René's URL Explorer Experiment


Title: Preserve native trailing command-line argument bytes by youknowdot · Pull Request #9494 · RustPython/RustPython · GitHub

Open Graph Title: Preserve native trailing command-line argument bytes by youknowdot · Pull Request #9494 · RustPython/RustPython

X Title: Preserve native trailing command-line argument bytes by youknowdot · Pull Request #9494 · RustPython/RustPython

Description: Summary Preserve native trailing command-line arguments as OsString instead of rejecting them during CLI UTF-8 conversion. Decode sys.argv and sys.orig_argv through the existing filesystem-decoding path; use args_os() for original arguments and program-name initialization. Adapt startup error reporting and the syslog default identifier to the retained native strings. Restore only CmdLineTest.test_invalid_utf8_arg through scripts/update_lib migrate, retaining every other failure marker and the explicit RUSTPYTHONPATH adapter. No test assertion or payload changes. Based on main 8051c05ae4e100bf35eeb32044d3456d2546dc75, after #9492 landed. No dependency or Cargo.lock changes. Public Rust API change Settings.argv changes from Vec to Vec and Paths.program_name from String to OsString. Embedders assigning these public fields must convert their values (for example with .into() or OsString::from). This is not a source-compatible field-type change. Scope and limits This fixes native-byte transport for trailing arguments and original-argument construction under RustPython's existing filesystem-decoding policy. It does not implement complete locale-dependent decoding, non-Unicode script/module selectors, invalid -c diagnostics, or invalid argv[0] compatibility. Those behaviors are not claimed by this PR. The undecodable-code expected-failure marker remains. Validation cargo fmt --all -- --check and git diff --check passed. cargo check and strict cargo clippy -- -D warnings passed for --bin rustpython --no-default-features --features threading,stdlib,stdio,importlib,host_env,doc,ucd_3_2_0 with the unchanged lockfile. Fresh CLI build passed with the same features; the actual VM compiler command used opt-level 3. Fresh bounded observations compared the exact two canonical test_invalid_utf8_arg payloads under C.UTF-8/default, C locale, -X utf8, and -X utf8=0: eight candidate and eight pinned CPython 3.15.0 processes. Every process exited successfully without stderr; os.fsencode(sys.argv[1]) and os.fsencode(sys.orig_argv[-1]) matched the original bytes and the reference. Input manifests remained unchanged and all owned process groups exited. The canonical test method's AST, including its remaining platform decorator, matches CPython commit d220409a13b77de7a6c30abe16ea90db01528edc. The observations directly ran the bounded payload observer with -B -S; they did not execute the original subprocess unittest harness, the entire test_cmd_line module, the full workspace/CAPI suites, or Windows/macOS runtime tests. The reference was built with test extension modules disabled. CI remains the next cross-platform check, not proof of untested compatibility. AI-assisted implementation and validation; commit disclosure included.

Open Graph Description: Summary Preserve native trailing command-line arguments as OsString instead of rejecting them during CLI UTF-8 conversion. Decode sys.argv and sys.orig_argv through the existing filesystem-decodin...

X Description: Summary Preserve native trailing command-line arguments as OsString instead of rejecting them during CLI UTF-8 conversion. Decode sys.argv and sys.orig_argv through the existing filesystem-decodin...

Opengraph URL: https://github.com/RustPython/RustPython/pull/9494

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:c54e5195-1bf0-9768-3133-059a487037c5
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idD550:38C5CF:3ECA323:4F9B8B5:6B01F3BA
html-safe-nonce0adad2d4ef21d5ecd99386eb914133f33fd936b79137e1af79a76fc06207f913
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJENTUwOjM4QzVDRjozRUNBMzIzOjRGOUI4QjU6NkIwMUYzQkEiLCJ2aXNpdG9yX2lkIjoiMzI4NDc4MjE1NTAyODM2MjE3MCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac17bc452bd186a6136043efac35ddeeb5b770c4c9947ff022440cecf80296ee28
hovercard-subject-tagpull_request:5096246277
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/RustPython/RustPython/pull/9494/files
twitter:imagehttps://avatars.githubusercontent.com/u/336763669?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/336763669?s=400&v=4
og:image:altSummary Preserve native trailing command-line arguments as OsString instead of rejecting them during CLI UTF-8 conversion. Decode sys.argv and sys.orig_argv through the existing filesystem-decodin...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/RustPython/RustPython git https://github.com/RustPython/RustPython.git
octolytics-dimension-user_id39710557
octolytics-dimension-user_loginRustPython
octolytics-dimension-repository_id135201145
octolytics-dimension-repository_nwoRustPython/RustPython
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id135201145
octolytics-dimension-repository_network_root_nwoRustPython/RustPython
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release423dbb54c5e7bfecc838eb387c1435eb3d0e760d
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/RustPython/RustPython/pull/9494/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FRustPython%2FRustPython%2Fpull%2F9494%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FRustPython%2FRustPython%2Fpull%2F9494%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=RustPython%2FRustPython
Reloadhttps://github.com/RustPython/RustPython/pull/9494/files
Reloadhttps://github.com/RustPython/RustPython/pull/9494/files
Reloadhttps://github.com/RustPython/RustPython/pull/9494/files
RustPythonhttps://github.com/RustPython
RustPythonhttps://github.com/RustPython/RustPython
Codehttps://github.com/RustPython/RustPython
Issues195 (195)https://github.com/RustPython/RustPython/issues
Pull requests133 (133)https://github.com/RustPython/RustPython/pulls
Discussionshttps://github.com/RustPython/RustPython/discussions
Actionshttps://github.com/RustPython/RustPython/actions
Projectshttps://github.com/RustPython/RustPython/projects
Wikihttps://github.com/RustPython/RustPython/wiki
Security and qualityhttps://github.com/RustPython/RustPython/security
Insightshttps://github.com/RustPython/RustPython/insights
Sign up for GitHub https://github.com/signup?return_to=%2FRustPython%2FRustPython%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2FRustPython%2FRustPython%2Fissues%2Fnew%2Fchoose
youknowonehttps://github.com/youknowone
RustPython:mainhttps://github.com/RustPython/RustPython/tree/main
youknowdot:python315-lossless-argv-20261031https://github.com/youknowdot/RustPython/tree/python315-lossless-argv-20261031
Conversation 4 https://github.com/RustPython/RustPython/pull/9494
Commits 1 https://github.com/RustPython/RustPython/pull/9494/commits
Checks 28 https://github.com/RustPython/RustPython/pull/9494/checks
Files changed https://github.com/RustPython/RustPython/pull/9494/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9494/files
Preserve native trailing command-line argument bytes https://github.com/RustPython/RustPython/pull/9494/files#top
Show all changes 1 commit https://github.com/RustPython/RustPython/pull/9494/files
51c3a30 Preserve native trailing command-line argument bytes codex Oct 31, 2026 https://github.com/RustPython/RustPython/pull/9494/commits/51c3a30bc99b8c05309e7c06e8b6e73b59759d39
Clear filters https://github.com/RustPython/RustPython/pull/9494/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9494/files
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9494/files
test_cmd_line.py https://github.com/RustPython/RustPython/pull/9494/files#diff-128fff16ea63b541718887f5c714e0c1a357414fe1146b4893ef699e8853e3b0
syslog.rs https://github.com/RustPython/RustPython/pull/9494/files#diff-c081d66088a808b2525fc0878b36ba7cd68960319d505605b43b1142842f0651
getpath.rs https://github.com/RustPython/RustPython/pull/9494/files#diff-a989d7c28653c96005b223a9c49dba9525f8a2045f58541f25a41bd4848a9988
sys.rs https://github.com/RustPython/RustPython/pull/9494/files#diff-e7f7c10b81f88d7af77af76257284e18e72ed9da63ff63675a9e9cb31c8d262d
setting.rs https://github.com/RustPython/RustPython/pull/9494/files#diff-9fc754581ca0739d7d6441cd6c1ce8bdd83220b0e7f71517c33aaffb622390f5
lib.rs https://github.com/RustPython/RustPython/pull/9494/files#diff-b1a35a68f14e696205874893c07fd24fdb88882b47c23cc0e0c80a30c7d53759
settings.rs https://github.com/RustPython/RustPython/pull/9494/files#diff-4f91d834bba4a3a432715f3ccf4ebc7c10d7ecfb974f1e78f56108dd80581a53
Lib/test/test_cmd_line.pyhttps://github.com/RustPython/RustPython/pull/9494/files#diff-128fff16ea63b541718887f5c714e0c1a357414fe1146b4893ef699e8853e3b0
View file https://github.com/youknowdot/RustPython/blob/51c3a30bc99b8c05309e7c06e8b6e73b59759d39/Lib/test/test_cmd_line.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9494/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9494/files#diff-128fff16ea63b541718887f5c714e0c1a357414fe1146b4893ef699e8853e3b0
https://github.com/RustPython/RustPython/pull/9494/files#diff-128fff16ea63b541718887f5c714e0c1a357414fe1146b4893ef699e8853e3b0
crates/stdlib/src/syslog.rshttps://github.com/RustPython/RustPython/pull/9494/files#diff-c081d66088a808b2525fc0878b36ba7cd68960319d505605b43b1142842f0651
View file https://github.com/youknowdot/RustPython/blob/51c3a30bc99b8c05309e7c06e8b6e73b59759d39/crates/stdlib/src/syslog.rs
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9494/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9494/files#diff-c081d66088a808b2525fc0878b36ba7cd68960319d505605b43b1142842f0651
https://github.com/RustPython/RustPython/pull/9494/files#diff-c081d66088a808b2525fc0878b36ba7cd68960319d505605b43b1142842f0651
crates/vm/src/getpath.rshttps://github.com/RustPython/RustPython/pull/9494/files#diff-a989d7c28653c96005b223a9c49dba9525f8a2045f58541f25a41bd4848a9988
View file https://github.com/youknowdot/RustPython/blob/51c3a30bc99b8c05309e7c06e8b6e73b59759d39/crates/vm/src/getpath.rs
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9494/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9494/files#diff-a989d7c28653c96005b223a9c49dba9525f8a2045f58541f25a41bd4848a9988
https://github.com/RustPython/RustPython/pull/9494/files#diff-a989d7c28653c96005b223a9c49dba9525f8a2045f58541f25a41bd4848a9988
https://github.com/RustPython/RustPython/pull/9494/files#diff-a989d7c28653c96005b223a9c49dba9525f8a2045f58541f25a41bd4848a9988
https://github.com/RustPython/RustPython/pull/9494/files#diff-a989d7c28653c96005b223a9c49dba9525f8a2045f58541f25a41bd4848a9988
https://github.com/RustPython/RustPython/pull/9494/files#diff-a989d7c28653c96005b223a9c49dba9525f8a2045f58541f25a41bd4848a9988
crates/vm/src/stdlib/sys.rshttps://github.com/RustPython/RustPython/pull/9494/files#diff-e7f7c10b81f88d7af77af76257284e18e72ed9da63ff63675a9e9cb31c8d262d
View file https://github.com/youknowdot/RustPython/blob/51c3a30bc99b8c05309e7c06e8b6e73b59759d39/crates/vm/src/stdlib/sys.rs
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9494/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9494/files#diff-e7f7c10b81f88d7af77af76257284e18e72ed9da63ff63675a9e9cb31c8d262d
https://github.com/RustPython/RustPython/pull/9494/files#diff-e7f7c10b81f88d7af77af76257284e18e72ed9da63ff63675a9e9cb31c8d262d
https://github.com/RustPython/RustPython/pull/9494/files#diff-e7f7c10b81f88d7af77af76257284e18e72ed9da63ff63675a9e9cb31c8d262d
https://github.com/RustPython/RustPython/pull/9494/files#diff-e7f7c10b81f88d7af77af76257284e18e72ed9da63ff63675a9e9cb31c8d262d
crates/vm/src/vm/setting.rshttps://github.com/RustPython/RustPython/pull/9494/files#diff-9fc754581ca0739d7d6441cd6c1ce8bdd83220b0e7f71517c33aaffb622390f5
View file https://github.com/youknowdot/RustPython/blob/51c3a30bc99b8c05309e7c06e8b6e73b59759d39/crates/vm/src/vm/setting.rs
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9494/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9494/files#diff-9fc754581ca0739d7d6441cd6c1ce8bdd83220b0e7f71517c33aaffb622390f5
https://github.com/RustPython/RustPython/pull/9494/files#diff-9fc754581ca0739d7d6441cd6c1ce8bdd83220b0e7f71517c33aaffb622390f5
https://github.com/RustPython/RustPython/pull/9494/files#diff-9fc754581ca0739d7d6441cd6c1ce8bdd83220b0e7f71517c33aaffb622390f5
https://github.com/RustPython/RustPython/pull/9494/files#diff-9fc754581ca0739d7d6441cd6c1ce8bdd83220b0e7f71517c33aaffb622390f5
src/lib.rshttps://github.com/RustPython/RustPython/pull/9494/files#diff-b1a35a68f14e696205874893c07fd24fdb88882b47c23cc0e0c80a30c7d53759
View file https://github.com/youknowdot/RustPython/blob/51c3a30bc99b8c05309e7c06e8b6e73b59759d39/src/lib.rs
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9494/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9494/files#diff-b1a35a68f14e696205874893c07fd24fdb88882b47c23cc0e0c80a30c7d53759
https://github.com/RustPython/RustPython/pull/9494/files#diff-b1a35a68f14e696205874893c07fd24fdb88882b47c23cc0e0c80a30c7d53759
src/settings.rshttps://github.com/RustPython/RustPython/pull/9494/files#diff-4f91d834bba4a3a432715f3ccf4ebc7c10d7ecfb974f1e78f56108dd80581a53
View file https://github.com/youknowdot/RustPython/blob/51c3a30bc99b8c05309e7c06e8b6e73b59759d39/src/settings.rs
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/RustPython/RustPython/pull/9494/{{ revealButtonHref }}
https://github.com/RustPython/RustPython/pull/9494/files#diff-4f91d834bba4a3a432715f3ccf4ebc7c10d7ecfb974f1e78f56108dd80581a53
https://github.com/RustPython/RustPython/pull/9494/files#diff-4f91d834bba4a3a432715f3ccf4ebc7c10d7ecfb974f1e78f56108dd80581a53
https://github.com/RustPython/RustPython/pull/9494/files#diff-4f91d834bba4a3a432715f3ccf4ebc7c10d7ecfb974f1e78f56108dd80581a53
https://github.com/RustPython/RustPython/pull/9494/files#diff-4f91d834bba4a3a432715f3ccf4ebc7c10d7ecfb974f1e78f56108dd80581a53
https://github.com/RustPython/RustPython/pull/9494/files#diff-4f91d834bba4a3a432715f3ccf4ebc7c10d7ecfb974f1e78f56108dd80581a53
https://github.com/RustPython/RustPython/pull/9494/files#diff-4f91d834bba4a3a432715f3ccf4ebc7c10d7ecfb974f1e78f56108dd80581a53
Please reload this pagehttps://github.com/RustPython/RustPython/pull/9494/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.