René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Using Invoke-WebRequest POST to upload a file is broken","articleBody":"### Prerequisites\r\n\r\n- [X] Write a descriptive title.\r\n- [X] Make sure you are able to repro it on the [latest released version](https://github.com/PowerShell/PowerShell/releases)\r\n- [X] Search the existing issues.\r\n- [X] Refer to the [FAQ](https://github.com/PowerShell/PowerShell/blob/master/docs/FAQ.md).\r\n- [X] Refer to [Differences between Windows PowerShell 5.1 and PowerShell](https://learn.microsoft.com/powershell/scripting/whats-new/differences-from-windows-powershell).\r\n\r\n### Steps to reproduce\r\n\r\nI have a PowerShell module that uploads a zip file of API documentation to a CGI-based website that has been working untouched since 2019.  Unfortunately, when I upgraded our build nodes to 7.4.2, it broke the upload to this website.  This might be hard to reproduce because I don't know how much of the behavior depends on the CGI website.\r\n\r\n1. Construct the IWR args and call it like so:\r\n\r\n```pwsh\r\n$uri = \"https://api.is.acme.com/cgi-bin/org/of_apps/apiManager/apiManager.cgi\"\r\n\r\n$form = [ordered]@{\r\n    USERNAME = $UserName\r\n    API_KEY = $ApiKey\r\n    APPLICATION_NAME = $AppName\r\n    APPLICATION_VERSION = $Version\r\n    APPLICATION_VERSION_ALIAS = $VersionAlias\r\n    DELETE_EXISTING_VERSION = $AllowClobber ? \"true\" : \"false\"\r\n    ROBOT = \"true\"\r\n    UPLOADED_FILE = Get-Item $Path # this is a zip file\r\n}\r\n\r\nInvoke-WebRequest -Uri $uri -Method POST -Form $form -SkipCertificateCheck\r\n```\r\nThis silently fails (returns a 200 status code). The file does not get uploaded.  When I capture this with Fiddler, this is what I see for the request headers:\r\n\u003cimg width=\"772\" alt=\"image\" src=\"https://github.com/PowerShell/PowerShell/assets/103770981/358a06d1-bd21-47a4-a4e5-e14976791aaa\"\u003e\r\n\r\nWhat is up with the uploaded filename being specified TWICE?  And what's with that second funky filename value `utf-8''Klm...`?  **I suspect this might be the problem.**   It's also interesting that curl quotes the field names e.g. `\"UPLOADED_FILE\"` whereas 7.4.2 does not.  Ditto for the filename value.\r\n\r\nNow if I try this with CURL (on Windows) - surprise, it works. :🤦‍♂️\r\n```pwsh\r\ncurl --insecure -F USERNAME=$username -F API_KEY=$apiDocsKey -F APPLICATION_NAME=\"KAL License Management Client API - Cplusplus\" -F APPLICATION_VERSION=7.4.0-develop -F APPLICATION_VERSION_ALIAS=LATEST-develop -F UPLOADED_FILE=@C:\\Temp\\KlmCppReference.zip -F ROBOT=true https://api.is.keysight.com/cgi-bin/org/of_apps/apiManager/apiManager.cgi -x 127.0.0.1:8888\r\n```\r\nThis results in these headers:\r\n![image](https://github.com/PowerShell/PowerShell/assets/103770981/cbd47dd1-1f83-48f8-9588-67af10cffde6)\r\n\r\n\r\n### Expected behavior\r\n\r\n```console\r\nI expect that using `$form[\"UPLOADED_FILE\"] = Get-Item $zipPath` should continue to work and produce the correct multi-part form data - particularly the filename.\r\n```\r\n\r\n\r\n### Actual behavior\r\n\r\n```console\r\nThe CGI website does not accept the uploaded file ... unless I use `curl`.\r\n```\r\n\r\n\r\n### Error details\r\n\r\n```console\r\nThere is no error from Invoke-WebRequest. Even the HTTP status code is 200 in both failed \u0026 working cases.  The difference is that when it fails, I get the home HTML as the raw content.  When it works I get the somewhat cryptic content:\r\n\r\n1\r\n1\r\n0\r\n\r\n🤷‍♂️ I didn't write this CGI website.\r\n```\r\n\r\n\r\n### Environment data\r\n\r\n```powershell\r\nName                           Value\r\n----                           -----\r\nPSVersion                      7.4.2\r\nPSEdition                      Core\r\nGitCommitId                    7.4.2\r\nOS                             Microsoft Windows 10.0.22631\r\nPlatform                       Win32NT\r\nPSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}\r\nPSRemotingProtocolVersion      2.3\r\nSerializationVersion           1.1.0.1\r\nWSManStackVersion              3.0\r\n```\r\n\r\n\r\n### Visuals\r\n\r\nBad PowerShell POST request headers:\r\n\u003cimg width=\"772\" alt=\"image\" src=\"https://github.com/PowerShell/PowerShell/assets/103770981/799fa3e0-21d4-4be7-8ff5-1caea8677cf0\"\u003e\r\n\r\nWorking curl POST request headers:\r\n![image](https://github.com/PowerShell/PowerShell/assets/103770981/0172d199-554a-4306-bc2c-d1aad4dd142d)\r\n","author":{"url":"https://github.com/rkeithhill-keysight","@type":"Person","name":"rkeithhill-keysight"},"datePublished":"2024-05-25T00:05:17.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":35},"url":"https://github.com/23843/PowerShell/issues/23843"}