René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Rework shared memory","articleBody":"The current status of shared memory is a real mess, and I really need to solve it:\n\nFirst of all, you can't easily use sub-dictionaries because they're not synchronized, and you need to do something like this, which is really ugly:\n\n``` python\nmydata = shared[\"mydata\"]\nmydata[\"test\"] = \"abc\"\nshared[\"mydata\"] = mydata\n```\n\nOther than that, shared memory is directly available via the `shared` argument of any hook: this might seem convenient, but prevents adding more shared things, like a global memory (as requested in #22) and locks, which are currently implemented by adding the method at runtime.\n\nIn order to solve this problems, and allowing to create custom drivers more easily, a big rewrite of the whole thing is needed. The new API I want for it is:\n\n``` python\n# For a component's memory\nshared.memory[\"mydata\"] = shared.object(\"dict\")\nshared.memory[\"mydata\"][\"test\"] = \"yay\"\nwith shared.lock(\"hello\"):\n    pass\n\n# A custom bucket\nbucket = bot.shared.bucket(\"test\")\nbucket.memory[\"mydata\"] = \"test\n```\n\n---\n- [x] Move the functionality of `shared` into `shared.memory`\n- [ ] Use a custom proxy instead of the multiprocessing one, so it's easier to write custom drivers and the API is consistent between them\n  - [x] Add basic support for objects management\n  - [x] Add ability to export/import objects and switch drivers\n  - [x] Add ability to add memory preparers\n  - [ ] Add support for the runner driver\n- [ ] Add some sort of garbage collection\n","author":{"url":"https://github.com/emilyalbini","@type":"Person","name":"emilyalbini"},"datePublished":"2016-04-10T17:55:52Z","url":"https://github.com/python-botogram/botogram/issues/54"}