René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"[Discuss] Feast Enhancements","articleBody":"My team has been evaluating Feast for adoption and have identified a few improvements we'd like to contribute for our use cases. @woop suggested starting a thread for discussion to make sure they are a good fit.\r\n\r\n### Support for SPI extensions\r\nWe'd like to add extension points for our existing infrastructure for things like:\r\n* FeatureTable change detection (notifying existing data pipeline and catalog services when a feature table is created or modified)\r\n* Implementing online storage operations for our store (HBase)\r\n\r\n### Multi-tenancy support\r\nOur infrastructure is entirely multi-tenant. We authorize API calls and store data on a per-tenant basis.\r\nOn the surface, we'd need something like the following in Feast:\r\n* Ability to define an optional `TenantSpec tenant` attribute in `FeatureTableSpec` that defines the name + type of a tenant field for feature table keys (e.g., name = 'TenantId'; type = 'string')\r\n* Adding an optional `tenant` attribute to ingestion and serving APIs (+SDK methods)\r\n* Transparently adding the tenant to storage operations when the tenant attribute is set (e.g., including 'TenantId=foo' in row keys)\r\n\r\n### Direct online write support\r\nWe have use cases that would like to write to feature store directly. Adding an `ApplyOnlineFeatures` API (+SDK support) would satisfy these use cases. The API would semantically resemble the `GetOnlineFeaturesV2` API (write feature table values for specific entity rows).\r\n\r\n### Delete online feature support\r\nWe maintain GDPR compliance by propagating delete record signals from upstream data systems. Essentially we'd need a `DeleteOnlineFeatures` API (+SDK support) that resembles `GetOnlineFeaturesV2` and `ApplyOnlineFeatures` (delete feature table values for specific entity rows).\r\n\r\nIf these seem like reasonable enhancements to Feast we can file individual issues and PRs to contribute these incrementally.","author":{"url":"https://github.com/aaraujo-sfdc","@type":"Person","name":"aaraujo-sfdc"},"datePublished":"2021-02-24T14:26:10.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":5},"url":"https://github.com/6/feast-java-old/issues/6"}