René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Is there a proper way to send zlib partial files for unzipping?","articleBody":"I saw a bug was fixed in v5.0.0 so that zlib will throw an error when it reaches the end of a truncated input (https://github.com/nodejs/node/pull/2595). Is it possible to use zlib on partial files.\n\nI'm working on a project that needs to be able quickly read through a large package of gzipped files (20+ files with a combined size of 2-5GB). All the content I care about is in the header of each file (first 500 bytes). I had this working previously using fs.read() while passing options to only read the first 500 bytes then using zlib.gunzip() to decompress the contents before parsing the header from the binary data.\n\nThis now throws an \"unexpected end of file\" input after v5.0.0. Is there another way to accomplish this or is zlib going to throw errors for the process regardless of what I do?\n\nI've tried using streams and the chunks in the `.on('data')` event are being properly decompressed and parsed but I'm not confident the chunk size will always contain the full header and I still have to handle the error which is breaking the pipe before it gets to an \"end\" or \"close\" event.\n\n```\nvar readStream = fs.createReadStream(file.path, {start: 0, end: 500});\nvar gunzip = zlib.createGunzip();\n\nreadStream.pipe(gunzip)\n    .on('data', function(chunk) {\n        console.log(parseBinaryHeader(chunk));\n        console.log('got %d bytes of data', chunk.length);\n    })\n    .on('error', function (err) {\n        console.log(err);\n    })\n    .on('end', function() {\n        console.log('end');\n    });\n```\n","author":{"url":"https://github.com/constellates","@type":"Person","name":"constellates"},"datePublished":"2015-11-25T22:38:07.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":11},"url":"https://github.com/4030/node/issues/4030"}