René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Make gcloud.storage use a streaming HTTP library for downloads","articleBody":"Right now we're using `httplib2` because of `oauth2client` working really nicely with that, however `httplib2` doesn't support a streaming download.\n\nThis means, a `.request()` will load the entire response content into memory, which won't work at all for a big file.\n\nTo get around this, we chunk the file up using the Range HTTP header and request pieces of it until the end, however the better way to handle this is with a streaming HTTP library:\n\n``` python\nstream = \u003csend http request\u003e\nwith open('output.txt', 'wb') as output:\n  data = stream.read(CHUNK_SIZE)\n  while data:\n    output.write(data)\n    data = stream.read(CHUNK_SIZE)\n```\n\nTo make this work we need to:\n- [ ] use a library that does support streaming\n- [ ] update `oauth2client` to work with that library\n","author":{"url":"https://github.com/jgeewax","@type":"Person","name":"jgeewax"},"datePublished":"2014-02-05T17:30:49.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":2},"url":"https://github.com/11/google-cloud-python/issues/11"}