René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Integrating NDB into gcloud.datastore?","articleBody":"Had a few discussions with @GoogleCloudPlatform/cloud-datastore (particularly @pcostell) so I wanted to summarize the things we covered. This issue is to clarify the goals for Datastore support in gcloud-python, and discuss and decide on a course of action that everyone likes for how to reconcile what we have today with the other libraries out there.\n\n---\n### Current state of the world\n\nCurrently, I see two styles that people want to use when interacting with Datastore:\n1. a \"simple\" more key-value-based style (similar to Amazon's Simple DB) where you're CRUDding dictionaries and then adding some querying\n2. a more advanced ORM style where you're create models, and have some sort of schema defined in a Python file.\n\nFor the former, `gcloud.datastore` has had the goal of covering this use case. For the latter, `ndb` is the latest way (supported) way of doing this -- with others potentially existing, but `ndb` seems to be the clear leader.\n\nWe also have a unique situation where our code currently might have trouble running in App Engine -- whereas `ndb` can't run _outside_ of App Engine. The layout sort of looks like this:\n\n![current state](https://cloud.githubusercontent.com/assets/112928/5779860/4e3edeec-9d74-11e4-88aa-06ea07d878f1.png)\n### Looking forward\n\nIf our goals are ....\n1. We agree that both styles of interacting with Datastore matter (and both should exist)\n2. `gcloud.datastore` and `ndb` are our choices for each style respectively\n3. `gcloud.datastore` and `ndb` should both run in App Engine _and_ non-App Engine runtimes\n4. `gcloud.datastore` is where all the recommended Python stuff to talk to Datastore should live (it is the \"official source of truth\")\n5. People who want to write new Python libraries for Datastore can rely on code that exists in `gcloud.datastore` (and set `gcloud` as a Python dependency)\n\n... then I'd like to suggest that we....\n1. Port `ndb` over as `gcloud.datastore.ndb` (bringing with it `datastore_rpc` and `datastore_query`)\n2. Rewrite `gcloud.datastore` to run on top of `datastore_query`\n3. Rename `gcloud.datastore` to be a peer with `ndb` (using \"simple\" in this diagram, not set on that at all though).\n\nwhich makes things look like this:\n\n![future state](https://cloud.githubusercontent.com/assets/112928/5780010/39a9a664-9d75-11e4-8a31-60b44f24ed4b.png)\n\nWhat do you guys think?\n\n/cc @GoogleCloudPlatform/cloud-datastore @dhermes @tseaver @silvolu @proppy \n","author":{"url":"https://github.com/jgeewax","@type":"Person","name":"jgeewax"},"datePublished":"2015-01-16T16:52:22.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":43},"url":"https://github.com/557/google-cloud-python/issues/557"}