René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"TextDecoder: ERR_ENCODING_INVALID_ENCODED_DATA on very long array buffer","articleBody":"### Version\r\n\r\nv18.14.1\r\n\r\n### Platform\r\n\r\nLinux 5.19.0-38-generic #39~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Fri Mar 17 21:16:15 UTC 2 x86_64 x86_64 x86_64 GNU/Linux\r\n\r\n### Subsystem\r\n\r\n_No response_\r\n\r\n### What steps will reproduce the bug?\r\n\r\nWhen I try to decode a long utf-16le encoded buffer, ERR_ENCODING_INVALID_ENCODED_DATA is thrown instead of ERR_STRING_TOO_LONG.\r\n```js\r\nnew TextDecoder(\"utf-16le\").decode(new Uint16Array(2**27).fill(48))\r\n// Uncaught TypeError: The encoded data was not valid for encoding utf-16le\r\n//     at TextDecoder.decode (node:internal/encoding:448:14) {\r\n//   code: 'ERR_ENCODING_INVALID_ENCODED_DATA'\r\n// }\r\n```\r\nThe default encoding version seems to work correctly, and throws an appropriate error\r\n```js\r\nnew TextDecoder().decode(new Uint8Array(2**29).fill(48))\r\n// Uncaught Error: Cannot create a string longer than 0x1fffffe8 characters\r\n//     at TextDecoder.decode (node:internal/encoding:433:16) {\r\n//   code: 'ERR_STRING_TOO_LONG'\r\n// }\r\n```\r\nAnother thing that I realized is that `TextDecoder()` seems to be capable of consuming an array buffer twice as long as `TextDecoder(\"utf-16le\")` without throwing error, and produce a string that's 4 times as long.\r\n\r\n### How often does it reproduce? Is there a required condition?\r\n\r\nConfirmed this bug in both normal file execution and node.js repl\r\n\r\n### What is the expected behavior? Why is that the expected behavior?\r\n\r\n`new TextDecoder(\"utf-16le\")` should be able to create a string up to 0x1fffffe8 characters.\r\nIt should throw ERR_STRING_TOO_LONG when this length is exceeded.\r\n\r\n### What do you see instead?\r\n\r\nERR_ENCODING_INVALID_ENCODED_DATA is thrown when the input Uint16Array length is 2**27\r\n```\r\nUncaught TypeError: The encoded data was not valid for encoding utf-16le\r\n    at TextDecoder.decode (node:internal/encoding:448:14) {\r\n  code: 'ERR_ENCODING_INVALID_ENCODED_DATA'\r\n}\r\n```\r\n\r\n### Additional information\r\n\r\n_No response_","author":{"url":"https://github.com/martian17","@type":"Person","name":"martian17"},"datePublished":"2023-04-20T16:10:17Z","url":"https://github.com/nodejs/node/issues/47645"}