René's URL Explorer Experiment


Title: Data passed through a pipe will be parsed differently in PowerShell 5.1 vs current release · Issue #17523 · PowerShell/PowerShell · GitHub

Open Graph Title: Data passed through a pipe will be parsed differently in PowerShell 5.1 vs current release · Issue #17523 · PowerShell/PowerShell

X Title: Data passed through a pipe will be parsed differently in PowerShell 5.1 vs current release · Issue #17523 · PowerShell/PowerShell

Description: Prerequisites Write a descriptive title. Make sure you are able to repro it on the latest released version Search the existing issues. Refer to the FAQ. Refer to Differences between Windows PowerShell 5.1 and PowerShell. Steps to reprodu...

Open Graph Description: Prerequisites Write a descriptive title. Make sure you are able to repro it on the latest released version Search the existing issues. Refer to the FAQ. Refer to Differences between Windows PowerSh...

X Description: Prerequisites Write a descriptive title. Make sure you are able to repro it on the latest released version Search the existing issues. Refer to the FAQ. Refer to Differences between Windows PowerSh...

Opengraph URL: https://github.com/PowerShell/PowerShell/issues/17523

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Data passed through a pipe will be parsed differently in PowerShell 5.1 vs current release","articleBody":"### Prerequisites\n\n- [X] Write a descriptive title.\n- [X] Make sure you are able to repro it on the [latest released version](https://github.com/PowerShell/PowerShell/releases)\n- [X] Search the existing issues.\n- [X] Refer to the [FAQ](https://github.com/PowerShell/PowerShell/blob/master/docs/FAQ.md).\n- [X] Refer to [Differences between Windows PowerShell 5.1 and PowerShell](https://docs.microsoft.com/powershell/scripting/whats-new/differences-from-windows-powershell).\n\n### Steps to reproduce\n\nWhen outputting UTF-8 from a native application PowerShell pipes fail to parse the data correctly even if a BOM is present. \r\nIn contrast this works in PowerShell 5.1 - that's why I'm reporting this as a bug.\r\n\r\nThe following python script will produce UTF-8 encoded output with a BOM.\r\n\r\n```python\r\n#!/usr/bin/env python3\r\nimport sys\r\nsys.stdout.buffer.write(\"äöüß αβγδ\\n\".encode(\"utf_8_sig\"))\r\n```\r\n\r\nPowershell 5.1 is able to recognise the output is UTF-8 encoded if the BOM is present. PowerShell 7.2.4 does not. \r\n\r\nNote that both shells were started with the `-noprofile` option to ensure default configuration.\n\n### Expected behavior\n\n```console\nPS> python .\\test.py | echo\r\näöüß αβγδ\n```\n\n\n### Actual behavior\n\n```console\nPS > python .\\test.py | echo\r\n´╗┐├ñ├Â├╝├ƒ ╬▒╬▓╬│╬┤\n```\n\n\n### Error details\n\n_No response_\n\n### Environment data\n\n```powershell\nPS> $PSVersionTable\r\n\r\nName                           Value\r\n----                           -----\r\nPSVersion                      7.2.4\r\nPSEdition                      Core\r\nGitCommitId                    7.2.4\r\nOS                             Microsoft Windows 10.0.19044\r\nPlatform                       Win32NT\r\nPSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}\r\nPSRemotingProtocolVersion      2.3\r\nSerializationVersion           1.1.0.1\r\nWSManStackVersion              3.0\n```\n\n\n### Visuals\n\n_No response_","author":{"url":"https://github.com/lclutz","@type":"Person","name":"lclutz"},"datePublished":"2022-06-13T12:25:48Z","url":"https://github.com/PowerShell/PowerShell/issues/17523"}

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:9b26ae32-8177-f27d-7560-0af2b466336f
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-idB9EC:36041B:13DBC5:1AE5F6:6AFD4CC7
html-safe-nonceb2dd8371255952163cfb0467a18bd6baefbd4c6955892606a9a142a75fad1bdd
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCOUVDOjM2MDQxQjoxM0RCQzU6MUFFNUY2OjZBRkQ0Q0M3IiwidmlzaXRvcl9pZCI6IjgzNTE5ODMxMzIwMzQ4MTMxMjciLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacb825ce03d40cc05520a8da6eb25dfa125a0a8dc0935cdf15b6aafa7ce4a511ac
hovercard-subject-tagissue:1269361710
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/PowerShell/PowerShell/17523/issue_layout
twitter:imagehttps://opengraph.githubassets.com/7406a91d58c1cf1d7da1d640cbf251722f10a48ceb32f99d9aedbc71c09afb14/PowerShell/PowerShell/issues/17523
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/7406a91d58c1cf1d7da1d640cbf251722f10a48ceb32f99d9aedbc71c09afb14/PowerShell/PowerShell/issues/17523
og:image:altPrerequisites Write a descriptive title. Make sure you are able to repro it on the latest released version Search the existing issues. Refer to the FAQ. Refer to Differences between Windows PowerSh...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamelclutz
hostnamegithub.com
expected-hostnamegithub.com
None66653c2e55a6fff2930be1bdf07ee4f8aa137e3956d056c822563be6f878755e
turbo-cache-controlno-preview
go-importgithub.com/PowerShell/PowerShell git https://github.com/PowerShell/PowerShell.git
octolytics-dimension-user_id11524380
octolytics-dimension-user_loginPowerShell
octolytics-dimension-repository_id49609581
octolytics-dimension-repository_nwoPowerShell/PowerShell
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id49609581
octolytics-dimension-repository_network_root_nwoPowerShell/PowerShell
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releaseb6f01f7cb9f35f8c09949773241a3d49dd04b340
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-nameissues

Links:

Skip to contenthttps://github.com/PowerShell/PowerShell/issues/17523#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FPowerShell%2FPowerShell%2Fissues%2F17523
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2FPowerShell%2FPowerShell%2Fissues%2F17523
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=PowerShell%2FPowerShell
Reloadhttps://github.com/PowerShell/PowerShell/issues/17523
Reloadhttps://github.com/PowerShell/PowerShell/issues/17523
Reloadhttps://github.com/PowerShell/PowerShell/issues/17523
PowerShellhttps://github.com/PowerShell
PowerShellhttps://github.com/PowerShell/PowerShell
Codehttps://github.com/PowerShell/PowerShell
Issues1.3k (1.3k)https://github.com/PowerShell/PowerShell/issues
Pull requests365 (365)https://github.com/PowerShell/PowerShell/pulls
Discussionshttps://github.com/PowerShell/PowerShell/discussions
Actionshttps://github.com/PowerShell/PowerShell/actions
Projectshttps://github.com/PowerShell/PowerShell/projects
Security and quality3 (3)https://github.com/PowerShell/PowerShell/security
Insightshttps://github.com/PowerShell/PowerShell/insights
https://github.com/PowerShell/PowerShell
New issuehttps://github.com/login?return_to=https://github.com/PowerShell/PowerShell/issues/17523
New issuehttps://github.com/login?return_to=https://github.com/PowerShell/PowerShell/issues/17523
Data passed through a pipe will be parsed differently in PowerShell 5.1 vs current releasehttps://github.com/PowerShell/PowerShell/issues/17523#top
https://github.com/daxian-dbw
Needs-TriageThe issue is new and needs to be triaged by a work group.https://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22Needs-Triage%22
Resolution-No ActivityIssue has had no activity for 6 months or morehttps://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22Resolution-No%20Activity%22
WG-Enginecore PowerShell engine, interpreter, and runtimehttps://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22WG-Engine%22
https://github.com/lclutz
Lorenz (lclutz)https://github.com/lclutz
on Jun 13, 2022https://github.com/PowerShell/PowerShell/issues/17523#issue-1269361710
latest released versionhttps://github.com/PowerShell/PowerShell/releases
FAQhttps://github.com/PowerShell/PowerShell/blob/master/docs/FAQ.md
Differences between Windows PowerShell 5.1 and PowerShellhttps://docs.microsoft.com/powershell/scripting/whats-new/differences-from-windows-powershell
Lorenz (lclutz)https://github.com/lclutz
Needs-TriageThe issue is new and needs to be triaged by a work group.https://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22Needs-Triage%22
on Jun 13, 2022https://github.com/PowerShell/PowerShell/issues/17523#event-6795664607
https://github.com/jborean93
Jordan Borean (jborean93)https://github.com/jborean93
on Jun 13, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1154271811
System.Diagnostics.Processhttps://docs.microsoft.com/en-us/dotnet/api/system.diagnostics.process?view=net-6.0
https://github.com/lclutz
Lorenz (lclutz)https://github.com/lclutz
on Jun 13, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1154427697
https://github.com/jborean93
Jordan Borean (jborean93)https://github.com/jborean93
on Jun 13, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1154432441
https://github.com/kasini3000
kasini3000https://github.com/kasini3000
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1154668228
Lorenz (lclutz)https://github.com/lclutz
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#event-6804183705
https://github.com/lclutz
Lorenz (lclutz)https://github.com/lclutz
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1155169533
kasini3000https://github.com/kasini3000
https://github.com/SeeminglyScience
Patrick Meinecke (SeeminglyScience)https://github.com/SeeminglyScience
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1155321235
Differences between Windows PowerShell 5.1 and PowerShell 7.xhttps://docs.microsoft.com/en-us/powershell/scripting/whats-new/differences-from-windows-powershell?view=powershell-7.2#change-outputencoding-to-use-utf-8-nobom-encoding-rather-than-ascii
https://github.com/lclutz
Lorenz (lclutz)https://github.com/lclutz
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1155397048
https://github.com/SeeminglyScience
Patrick Meinecke (SeeminglyScience)https://github.com/SeeminglyScience
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1155404757
https://github.com/munezerocity
munezero ibrahim (munezerocity)https://github.com/munezerocity
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1155486066
https://github.com/jborean93
Jordan Borean (jborean93)https://github.com/jborean93
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1155596240
https://github.com/lclutz
Lorenz (lclutz)https://github.com/lclutz
on Jun 14, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1155618999
https://github.com/kasini3000
kasini3000https://github.com/kasini3000
on Jun 15, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1156442386
https://github.com/lclutz
Lorenz (lclutz)https://github.com/lclutz
on Jun 15, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1156951405
https://github.com/iSazonov
Ilya (iSazonov)https://github.com/iSazonov
on Jun 16, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1157555467
System.Diagnostics.Processhttps://docs.microsoft.com/en-us/dotnet/api/system.diagnostics.process?view=net-6.0
AsyncStreamReaderhttps://source.dot.net/System.Diagnostics.Process/R/4741a36c74c58421.html
https://github.com/SeeminglyScience
Patrick Meinecke (SeeminglyScience)https://github.com/SeeminglyScience
on Jun 16, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1157779769
#10824https://github.com/PowerShell/PowerShell/pull/10824
Paul Higinbotham (PaulHigin)https://github.com/PaulHigin
WG-Enginecore PowerShell engine, interpreter, and runtimehttps://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22WG-Engine%22
on Jun 20, 2022https://github.com/PowerShell/PowerShell/issues/17523#event-6840974589
James Truher (JamesWTruher)https://github.com/JamesWTruher
Dongbo Wang (daxian-dbw)https://github.com/daxian-dbw
on Jul 7, 2022https://github.com/PowerShell/PowerShell/issues/17523#event-6955286091
https://github.com/daxian-dbw
Dongbo Wang (daxian-dbw)https://github.com/daxian-dbw
on Aug 3, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1204544554
big changehttps://github.com/PowerShell/PowerShell/pull/2450
https://github.com/iSazonov
Ilya (iSazonov)https://github.com/iSazonov
on Aug 4, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1204754332
#1908https://github.com/PowerShell/PowerShell/issues/1908
https://github.com/AE1020
AE1020https://github.com/AE1020
on Aug 4, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1205700211
https://stackoverflow.com/a/2223926https://stackoverflow.com/a/2223926
Illegal in JSONhttps://jimmybogard.com/the-curious-case-of-the-json-bom/
https://camo.githubusercontent.com/aeb19ac101480369de19891df079dcdc760086ebe52cb08bd98183bfd18396e9/68747470733a2f2f63646e2e737374617469632e6e65742f53697465732f737461636b6f766572666c6f772f496d672f6170706c652d746f7563682d69636f6e40322e706e673f763d373364373961383962646564
What's the difference between UTF-8 and UTF-8 without BOM?https://stackoverflow.com/questions/2223882/whats-the-difference-between-utf-8-and-utf-8-without-bom
https://github.com/kasini3000
kasini3000https://github.com/kasini3000
on Aug 5, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1206046392
Dongbo Wang (@daxian-dbw)https://github.com/daxian-dbw
AE1020https://github.com/AE1020
https://github.com/jborean93
Jordan Borean (jborean93)https://github.com/jborean93
on Aug 5, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1206049688
https://github.com/AE1020
AE1020https://github.com/AE1020
on Aug 5, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1206170455
kasini3000https://github.com/kasini3000
https://github.com/ding-dang-do
ding-dang-dohttps://github.com/ding-dang-do
on Oct 31, 2022https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1296786913
Jordan Borean (@jborean93)https://github.com/jborean93
https://github.com/apps/microsoft-github-policy-service
microsoft-github-policy-servicehttps://github.com/apps/microsoft-github-policy-service
on Nov 15, 2023https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1811660625
Microsoft GitHub Policy Servicehttps://aka.ms/1es-gitops
microsoft-github-policy-servicehttps://github.com/apps/microsoft-github-policy-service
Resolution-No ActivityIssue has had no activity for 6 months or morehttps://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22Resolution-No%20Activity%22
on Nov 15, 2023https://github.com/PowerShell/PowerShell/issues/17523#event-10961860827
https://github.com/apps/microsoft-github-policy-service
microsoft-github-policy-servicehttps://github.com/apps/microsoft-github-policy-service
on Nov 22, 2023https://github.com/PowerShell/PowerShell/issues/17523#issuecomment-1822552181
Microsoft GitHub Policy Servicehttps://aka.ms/1es-gitops
microsoft-github-policy-servicehttps://github.com/apps/microsoft-github-policy-service
completedhttps://github.com/PowerShell/PowerShell/issues?q=is%3Aissue%20state%3Aclosed%20archived%3Afalse%20reason%3Acompleted
on Nov 22, 2023https://github.com/PowerShell/PowerShell/issues/17523#event-11035012632
Sign up for freehttps://github.com/signup?return_to=https://github.com/PowerShell/PowerShell/issues/17523
Sign in to commenthttps://github.com/login?return_to=https://github.com/PowerShell/PowerShell/issues/17523
Dongbo Wang (daxian-dbw)https://github.com/daxian-dbw
Needs-TriageThe issue is new and needs to be triaged by a work group.https://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22Needs-Triage%22
Resolution-No ActivityIssue has had no activity for 6 months or morehttps://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22Resolution-No%20Activity%22
WG-Enginecore PowerShell engine, interpreter, and runtimehttps://github.com/PowerShell/PowerShell/issues?q=state%3Aopen%20label%3A%22WG-Engine%22
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.