René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"fetch('https://www.php.net') using official nodejs binaries results in 503 - but 200 on other binaries, in browser, curl, etc.","articleBody":"### Node.js Version\n\nv22.12.0\n\n### NPM Version\n\n10.9.0\n\n### Operating System\n\nLinux amezin-laptop.home.arpa 6.12.4-zen1-1-zen #1 ZEN SMP PREEMPT_DYNAMIC Mon, 09 Dec 2024 14:30:31 +0000 x86_64 GNU/Linux\n\n### Subsystem\n\nhttps\n\n### Description\n\n1. Download https://nodejs.org/dist/v22.12.0/node-v22.12.0-linux-x64.tar.xz and unpack\r\n2. Run bin/node\r\n3. `await fetch('https://www.php.net')`\r\n\r\nResult:\r\n```\r\nResponse {\r\n  status: 503,\r\n  statusText: 'Service Temporarily Unavailable',\r\n  headers: Headers {\r\n    server: 'myracloud',\r\n    date: 'Mon, 16 Dec 2024 07:43:14 GMT',\r\n    'content-type': 'text/html',\r\n    'transfer-encoding': 'chunked',\r\n    connection: 'keep-alive',\r\n    'cache-control': 'no-cache, no-store, max-age=0',\r\n    'x-content-type-options': 'nosniff',\r\n    'x-xss-protection': '1; mode=block',\r\n    'x-frame-options': 'SAMEORIGIN'\r\n  },\r\n  body: ReadableStream { locked: false, state: 'readable', supportsBYOB: true },\r\n  bodyUsed: false,\r\n  ok: false,\r\n  redirected: false,\r\n  type: 'basic',\r\n  url: 'https://www.php.net/'\r\n}\r\n```\r\n\r\nWhen I do the same `await fetch('https://www.php.net')` in `nodejs-lts-iron-20.18.1-1`, or `nodejs-23.4.0-1`, provided by Arch Linux, I get:\r\n\r\n```\r\nResponse {\r\n  status: 200,\r\n  statusText: 'OK',\r\n  headers: Headers {\r\n    server: 'myracloud',\r\n    date: 'Mon, 16 Dec 2024 07:43:56 GMT',\r\n    'content-type': 'text/html; charset=utf-8',\r\n    'transfer-encoding': 'chunked',\r\n    connection: 'keep-alive',\r\n    'last-modified': 'Mon, 16 Dec 2024 07:30:09 GMT',\r\n    'content-language': 'en',\r\n    'permissions-policy': 'interest-cohort=()',\r\n    'x-frame-options': 'SAMEORIGIN',\r\n    'set-cookie': 'LAST_NEWS=1734335036; expires=Tue, 16 Dec 2025 07:43:56 GMT; Max-Age=31536000; path=/; domain=.php.net',\r\n    link: '\u003chttps://www.php.net/index>; rel=shorturl',\r\n    'content-encoding': 'gzip',\r\n    vary: 'accept-encoding',\r\n    expires: 'Mon, 16 Dec 2024 07:43:56 GMT',\r\n    'cache-control': 'max-age=0'\r\n  },\r\n  body: ReadableStream { locked: false, state: 'readable', supportsBYOB: true },\r\n  bodyUsed: false,\r\n  ok: true,\r\n  redirected: false,\r\n  type: 'basic',\r\n  url: 'https://www.php.net/'\r\n}\r\n```\r\n\r\nAlso the page opens successfully in Firefox, curl successfully downloads it.\r\n\r\nWhy does it happen and can it be fixed?\n\n### Minimal Reproduction\n\n_No response_\n\n### Output\n\n_No response_\n\n### Before You Submit\n\n- [X] I have looked for issues that already exist before submitting this\n- [X] My issue follows the guidelines in the README file, and follows the 'How to ask a good question' guide at https://stackoverflow.com/help/how-to-ask","author":{"url":"https://github.com/amezin","@type":"Person","name":"amezin"},"datePublished":"2024-12-16T07:58:15Z","url":"https://github.com/nodejs/help/issues/4516"}