René's URL Explorer Experiment


Title: TTL for entities in the Online stores other Than Redis · Issue #1988 · feast-dev/feast · GitHub

Open Graph Title: TTL for entities in the Online stores other Than Redis · Issue #1988 · feast-dev/feast

X Title: TTL for entities in the Online stores other Than Redis · Issue #1988 · feast-dev/feast

Description: Is your feature request related to a problem? Please describe. (for context: we are using the Redis online store) At the moment, once an entity is written to the Online store, it's there until it's manually cleaned up. In most of our bus...

Open Graph Description: Is your feature request related to a problem? Please describe. (for context: we are using the Redis online store) At the moment, once an entity is written to the Online store, it's there until it's...

X Description: Is your feature request related to a problem? Please describe. (for context: we are using the Redis online store) At the moment, once an entity is written to the Online store, it's there until ...

Opengraph URL: https://github.com/feast-dev/feast/issues/1988

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"TTL for entities in the Online stores other Than Redis","articleBody":"**Is your feature request related to a problem? Please describe.**\r\n(for context: we are using the Redis online store)\r\nAt the moment, once an entity is written to the Online store, it's there until it's manually cleaned up.\r\n\r\nIn most of our business cases, the Entity will have a natural expiration time (when it's no longer relevant for the use case).\r\n\r\nIt would be nice to be able to expire the entity in the online store, with some kind of TTL setting.\r\n\r\n**Describe the solution you'd like**\r\n1. in our local setup we end up expiring the key bin in Redis (combination of entity + project)\r\n```\r\ndef online_write_batch(...):\r\n  redis_key_bin = _redis_key(project, entity_key)\r\n  ...\r\n  if table.ttl:\r\n      redis_client_pipeline.expire(name=redis_key_bin, time=table.ttl)\r\n```\r\nthe issue with this is that the `ttl` param in `feature_view/table` is overloaded (initially designed for a use case in the offline store)\r\nAlso, in this type of setup and use case, the TTL should be on the entity level not `feature_view` because the Redis key bin is based on entity (feature_view ttl is designed for something else also)\r\n\r\nso the proposal:\r\nadd `online_store_ttl` param to the Entity object\r\nexample:\r\n```\r\ndriver_entity = Entity(\r\n name=\"driver\",\r\n description=\"Driver Identifier\", \r\n value_type=ValueType.INT64, \r\n online_store_ttl=Duration(seconds=86400)\r\n)\r\n```\r\n\r\n```\r\ndef online_write_batch(...):\r\n  redis_key_bin = _redis_key(project, entity_key)\r\n  ...\r\n  if entity.online_store_ttl:\r\n      redis_client_pipeline.expire(name=redis_key_bin, time=entity.online_store_ttl)\r\n```\r\n\r\nNote: implementation details may vary a bit based on the Online store type","author":{"url":"https://github.com/vas28r13","@type":"Person","name":"vas28r13"},"datePublished":"2021-11-01T18:18:08.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":5},"url":"https://github.com/1988/feast/issues/1988"}

route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:ac365836-0ebc-b9cb-bd09-c1636923f8e4
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-id85F8:33929D:2256778:30F1400:6978FCD3
html-safe-nonce2231ea42b075f345f04b15730aed7bc08384a0daa6b58c99bc2e71ed46426f43
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4NUY4OjMzOTI5RDoyMjU2Nzc4OjMwRjE0MDA6Njk3OEZDRDMiLCJ2aXNpdG9yX2lkIjoiNDMwOTI0NDQxNzYwMTUwMjQxOSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac9b1b3f3501eedc4e54d3e6a74f616988558302e7fc782b8ee752713d710f7d59
hovercard-subject-tagissue:1041457450
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/feast-dev/feast/1988/issue_layout
twitter:imagehttps://opengraph.githubassets.com/97c07b0fcb92d554766b6397a7a8290b1235b2d5c5adf269b0aeb84b22f95f09/feast-dev/feast/issues/1988
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/97c07b0fcb92d554766b6397a7a8290b1235b2d5c5adf269b0aeb84b22f95f09/feast-dev/feast/issues/1988
og:image:altIs your feature request related to a problem? Please describe. (for context: we are using the Redis online store) At the moment, once an entity is written to the Online store, it's there until it's...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamevas28r13
hostnamegithub.com
expected-hostnamegithub.com
None6d9b384ce19e0ac9756580c70eae9a3359939e77ff05c731561090d13085b2b7
turbo-cache-controlno-preview
go-importgithub.com/feast-dev/feast git https://github.com/feast-dev/feast.git
octolytics-dimension-user_id57027613
octolytics-dimension-user_loginfeast-dev
octolytics-dimension-repository_id161133770
octolytics-dimension-repository_nwofeast-dev/feast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id161133770
octolytics-dimension-repository_network_root_nwofeast-dev/feast
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release56ad33f6fdc0d0fb49c96b3c46ed74c55d926471
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/feast-dev/feast/issues/1988#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fissues%2F1988
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fissues%2F1988
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=feast-dev%2Ffeast
Reloadhttps://github.com/feast-dev/feast/issues/1988
Reloadhttps://github.com/feast-dev/feast/issues/1988
Reloadhttps://github.com/feast-dev/feast/issues/1988
feast-dev https://github.com/feast-dev
feasthttps://github.com/feast-dev/feast
Notifications https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Fork 1.2k https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Star 6.7k https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Code https://github.com/feast-dev/feast
Issues 181 https://github.com/feast-dev/feast/issues
Pull requests 67 https://github.com/feast-dev/feast/pulls
Discussions https://github.com/feast-dev/feast/discussions
Actions https://github.com/feast-dev/feast/actions
Security 0 https://github.com/feast-dev/feast/security
Insights https://github.com/feast-dev/feast/pulse
Code https://github.com/feast-dev/feast
Issues https://github.com/feast-dev/feast/issues
Pull requests https://github.com/feast-dev/feast/pulls
Discussions https://github.com/feast-dev/feast/discussions
Actions https://github.com/feast-dev/feast/actions
Security https://github.com/feast-dev/feast/security
Insights https://github.com/feast-dev/feast/pulse
New issuehttps://github.com/login?return_to=https://github.com/feast-dev/feast/issues/1988
New issuehttps://github.com/login?return_to=https://github.com/feast-dev/feast/issues/1988
TTL for entities in the Online stores other Than Redishttps://github.com/feast-dev/feast/issues/1988#top
https://github.com/felixwang9817
Community Contribution NeededWe want community to contributehttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22Community%20Contribution%20Needed%22
kind/featureNew feature or requesthttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22kind%2Ffeature%22
priority/p2https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22priority%2Fp2%22
wontfixThis will not be worked onhttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22wontfix%22
https://github.com/vas28r13
https://github.com/vas28r13
vas28r13https://github.com/vas28r13
on Nov 1, 2021https://github.com/feast-dev/feast/issues/1988#issue-1041457450
felixwang9817https://github.com/felixwang9817
Community Contribution NeededWe want community to contributehttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22Community%20Contribution%20Needed%22
kind/featureNew feature or requesthttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22kind%2Ffeature%22
priority/p2https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22priority%2Fp2%22
wontfixThis will not be worked onhttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22wontfix%22
Feast Roadmaphttps://github.com/orgs/feast-dev/projects/2
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.