René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"subfolders for external storage","articleBody":"To avoid millions of files in one folder, break up external storage files into subfolders.\r\n\r\n1. Add subfolder scheme to the external storage configuration in `dj.config`.  The structure may be specified as a tuple, e.g. (2,2,2), which indicates three levels of subfolders, each taking the next 2 characters of the hash and leaving the rest for the filename.  The default scheme is (), i.e. no subfolders.\r\n\r\n2.  When creating a new external storage folder, create the file `djexternal.json` and save the subfolder scheme.  \r\n\r\n3. When using an existing external storage folder, find `djexternal.json` and read the subfolder scheme from it, ignoring the one specified in `dj.config`.\r\n\r\n4. Break up the hash filename according to the subfolder scheme for both reading and writing.","author":{"url":"https://github.com/dimitri-yatsenko","@type":"Person","name":"dimitri-yatsenko"},"datePublished":"2018-07-23T22:02:35.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":7},"url":"https://github.com/475/datajoint-python/issues/475"}