René's URL Explorer Experiment


Title: Remove feature set update from job update cycle by zhilingc · Pull Request #711 · feast-dev/feast · GitHub

Open Graph Title: Remove feature set update from job update cycle by zhilingc · Pull Request #711 · feast-dev/feast

X Title: Remove feature set update from job update cycle by zhilingc · Pull Request #711 · feast-dev/feast

Description: What this PR does / why we need it: Removes the feature set update from the job update cycle, because job updates are long running and are write-transactional, and so can block feast core for long periods of time. Hopefully this improves the performance of the system. The responsibility of making feature set status updates is pushed to when the feature set is retrieved (either by ListFeatureSets or GetFeatureSet). Would like the dataflow tests to be fixed and run on this PR before this is merged in, ideally. Which issue(s) this PR fixes: Fixes #664 Does this PR introduce a user-facing change?:

Open Graph Description: What this PR does / why we need it: Removes the feature set update from the job update cycle, because job updates are long running and are write-transactional, and so can block feast core for long ...

X Description: What this PR does / why we need it: Removes the feature set update from the job update cycle, because job updates are long running and are write-transactional, and so can block feast core for long ...

Opengraph URL: https://github.com/feast-dev/feast/pull/711

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:fbb1da0a-67f0-f0db-2972-dc5213e9612e
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idE900:25AFF0:16B6F40:1D433D9:697FCCDF
html-safe-nonce2c1a12c3ff1903ed0a96653f547cfdef13a4c88d92373fbed52c2814126d3917
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFOTAwOjI1QUZGMDoxNkI2RjQwOjFENDMzRDk6Njk3RkNDREYiLCJ2aXNpdG9yX2lkIjoiMjkzMjU4MTUwMDg1NzYwMTI0NyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac62a279b7babf261670c0b5f3910a53d4d2fb262110dab490fa6b1f84ee7cbf29
hovercard-subject-tagpull_request:418518076
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/feast-dev/feast/pull/711/files
twitter:imagehttps://avatars.githubusercontent.com/u/15104168?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/15104168?s=400&v=4
og:image:altWhat this PR does / why we need it: Removes the feature set update from the job update cycle, because job updates are long running and are write-transactional, and so can block feast core for long ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None60279d4097367e16897439d16d6bbe4180663db828c666eeed2656988ffe59f6
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/feast-dev/feast git https://github.com/feast-dev/feast.git
octolytics-dimension-user_id57027613
octolytics-dimension-user_loginfeast-dev
octolytics-dimension-repository_id161133770
octolytics-dimension-repository_nwofeast-dev/feast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id161133770
octolytics-dimension-repository_network_root_nwofeast-dev/feast
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release7c85641c598ad130c74f7bcc27f58575cac69551
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/feast-dev/feast/pull/711/changes#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F711%2Ffiles
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F711%2Ffiles
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=feast-dev%2Ffeast
Reloadhttps://github.com/feast-dev/feast/pull/711/changes
Reloadhttps://github.com/feast-dev/feast/pull/711/changes
Reloadhttps://github.com/feast-dev/feast/pull/711/changes
feast-dev https://github.com/feast-dev
feasthttps://github.com/feast-dev/feast
Notifications https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Fork 1.2k https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Star 6.7k https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Code https://github.com/feast-dev/feast
Issues 183 https://github.com/feast-dev/feast/issues
Pull requests 69 https://github.com/feast-dev/feast/pulls
Discussions https://github.com/feast-dev/feast/discussions
Actions https://github.com/feast-dev/feast/actions
Security 0 https://github.com/feast-dev/feast/security
Insights https://github.com/feast-dev/feast/pulse
Code https://github.com/feast-dev/feast
Issues https://github.com/feast-dev/feast/issues
Pull requests https://github.com/feast-dev/feast/pulls
Discussions https://github.com/feast-dev/feast/discussions
Actions https://github.com/feast-dev/feast/actions
Security https://github.com/feast-dev/feast/security
Insights https://github.com/feast-dev/feast/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
zhilingchttps://github.com/zhilingc
feast-dev:masterhttps://github.com/feast-dev/feast/tree/master
zhilingc:jobs-no-update-fshttps://github.com/zhilingc/feast/tree/jobs-no-update-fs
Conversation 6 https://github.com/feast-dev/feast/pull/711
Commits 6 https://github.com/feast-dev/feast/pull/711/commits
Checks 0 https://github.com/feast-dev/feast/pull/711/checks
Files changed https://github.com/feast-dev/feast/pull/711/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/711/changes
Remove feature set update from job update cycle https://github.com/feast-dev/feast/pull/711/changes#top
Show all changes 6 commits https://github.com/feast-dev/feast/pull/711/files
022dbca Remove feature set update from job update cycle May 15, 2020 https://github.com/feast-dev/feast/pull/711/commits/022dbca82b4ad7a219e1a314152186455b4a8ad5
ee62603 Apply spotless May 15, 2020 https://github.com/feast-dev/feast/pull/711/commits/ee6260344e9cde104965a960b55d392a87b60d7c
e89f480 Track feature set version in job May 18, 2020 https://github.com/feast-dev/feast/pull/711/commits/e89f480426a1cc8ac5b9556f49aea17188bb95ee
e05f014 Resolve imports after rebase May 18, 2020 https://github.com/feast-dev/feast/pull/711/commits/e05f014881997fc24ae36c05bccaab8365f5792b
5e2e07e Apply spotless May 18, 2020 https://github.com/feast-dev/feast/pull/711/commits/5e2e07e3288c25ef1d9cc9ac6f7e64a5d30c8f84
c58a617 Compare between feature sets during job updates May 18, 2020 https://github.com/feast-dev/feast/pull/711/commits/c58a6174dbb4bd3eb0b93940e438b3bfa442c666
Clear filters https://github.com/feast-dev/feast/pull/711/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/711/changes
Please reload this pagehttps://github.com/feast-dev/feast/pull/711/changes
JobUpdateTask.java https://github.com/feast-dev/feast/pull/711/changes#diff-b596a79dd3947d836a7aca8203777ba20202b61059ba2779012f0507473ba13f
FeatureSet.java https://github.com/feast-dev/feast/pull/711/changes#diff-408a8e7f33c4419fc8357aeee3dae3bac5e351cd995a436b3679d4d3936540e1
Job.java https://github.com/feast-dev/feast/pull/711/changes#diff-e95558185cd29f6683ba92d36d8f88fca53ea9dcf57a23813a257a1462593144
JobCoordinatorService.java https://github.com/feast-dev/feast/pull/711/changes#diff-e00c51ab165ad0121271c6f080f7ec67812bf01ceb58b571f58d735fd6f184ba
JobService.java https://github.com/feast-dev/feast/pull/711/changes#diff-2d7c4b0863b06e44e7186367d8612e7e4b9be9841efb113841b37268f46d2023
SpecService.java https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
JobUpdateTaskTest.java https://github.com/feast-dev/feast/pull/711/changes#diff-5169333fcd0df390bca0d06c61c65bff4908348b83fde0a8d79f28473c2957f5
DataflowJobManagerTest.java https://github.com/feast-dev/feast/pull/711/changes#diff-c7d8e5e0eb8ec2ada26a93107d0e114d9bcb5c75c92f7f0b7b8b5c7e78be66e4
DirectRunnerJobManagerTest.java https://github.com/feast-dev/feast/pull/711/changes#diff-c9efecd719a116af68bf2822e9c4e931f843ffdcf2127744d620cd8c024509e8
JobCoordinatorServiceTest.java https://github.com/feast-dev/feast/pull/711/changes#diff-e6b95e0f18caa73bbda2401ec5f10d37c38454eaf36b9f0dcef328dbc3e9e671
JobServiceTest.java https://github.com/feast-dev/feast/pull/711/changes#diff-cabe7e374d3b1177eb6ead2a4b24e3319d3b26002ab3a78b66c2b9d7136d4417
SpecServiceTest.java https://github.com/feast-dev/feast/pull/711/changes#diff-3e5a2daecb252ed55f8f4aeef423a69b3a3582419250ad08856fba54c31b2704
core/src/main/java/feast/core/job/JobUpdateTask.javahttps://github.com/feast-dev/feast/pull/711/changes#diff-b596a79dd3947d836a7aca8203777ba20202b61059ba2779012f0507473ba13f
View file https://github.com/zhilingc/feast/blob/c58a6174dbb4bd3eb0b93940e438b3bfa442c666/core/src/main/java/feast/core/job/JobUpdateTask.java
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/711/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/711/changes#diff-b596a79dd3947d836a7aca8203777ba20202b61059ba2779012f0507473ba13f
https://github.com/feast-dev/feast/pull/711/changes#diff-b596a79dd3947d836a7aca8203777ba20202b61059ba2779012f0507473ba13f
https://github.com/feast-dev/feast/pull/711/changes#diff-b596a79dd3947d836a7aca8203777ba20202b61059ba2779012f0507473ba13f
https://github.com/feast-dev/feast/pull/711/changes#diff-b596a79dd3947d836a7aca8203777ba20202b61059ba2779012f0507473ba13f
core/src/main/java/feast/core/model/FeatureSet.javahttps://github.com/feast-dev/feast/pull/711/changes#diff-408a8e7f33c4419fc8357aeee3dae3bac5e351cd995a436b3679d4d3936540e1
View file https://github.com/zhilingc/feast/blob/c58a6174dbb4bd3eb0b93940e438b3bfa442c666/core/src/main/java/feast/core/model/FeatureSet.java
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/711/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/711/changes#diff-408a8e7f33c4419fc8357aeee3dae3bac5e351cd995a436b3679d4d3936540e1
https://github.com/feast-dev/feast/pull/711/changes#diff-408a8e7f33c4419fc8357aeee3dae3bac5e351cd995a436b3679d4d3936540e1
https://github.com/feast-dev/feast/pull/711/changes#diff-408a8e7f33c4419fc8357aeee3dae3bac5e351cd995a436b3679d4d3936540e1
https://github.com/feast-dev/feast/pull/711/changes#diff-408a8e7f33c4419fc8357aeee3dae3bac5e351cd995a436b3679d4d3936540e1
core/src/main/java/feast/core/model/Job.javahttps://github.com/feast-dev/feast/pull/711/changes#diff-e95558185cd29f6683ba92d36d8f88fca53ea9dcf57a23813a257a1462593144
View file https://github.com/zhilingc/feast/blob/c58a6174dbb4bd3eb0b93940e438b3bfa442c666/core/src/main/java/feast/core/model/Job.java
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/711/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/711/changes#diff-e95558185cd29f6683ba92d36d8f88fca53ea9dcf57a23813a257a1462593144
https://github.com/feast-dev/feast/pull/711/changes#diff-e95558185cd29f6683ba92d36d8f88fca53ea9dcf57a23813a257a1462593144
https://github.com/feast-dev/feast/pull/711/changes#diff-e95558185cd29f6683ba92d36d8f88fca53ea9dcf57a23813a257a1462593144
https://github.com/feast-dev/feast/pull/711/changes#diff-e95558185cd29f6683ba92d36d8f88fca53ea9dcf57a23813a257a1462593144
https://github.com/feast-dev/feast/pull/711/changes#diff-e95558185cd29f6683ba92d36d8f88fca53ea9dcf57a23813a257a1462593144
core/src/main/java/feast/core/service/JobCoordinatorService.javahttps://github.com/feast-dev/feast/pull/711/changes#diff-e00c51ab165ad0121271c6f080f7ec67812bf01ceb58b571f58d735fd6f184ba
View file https://github.com/zhilingc/feast/blob/c58a6174dbb4bd3eb0b93940e438b3bfa442c666/core/src/main/java/feast/core/service/JobCoordinatorService.java
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/711/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/711/changes#diff-e00c51ab165ad0121271c6f080f7ec67812bf01ceb58b571f58d735fd6f184ba
https://github.com/feast-dev/feast/pull/711/changes#diff-e00c51ab165ad0121271c6f080f7ec67812bf01ceb58b571f58d735fd6f184ba
https://github.com/feast-dev/feast/pull/711/changes#diff-e00c51ab165ad0121271c6f080f7ec67812bf01ceb58b571f58d735fd6f184ba
https://github.com/feast-dev/feast/pull/711/changes#diff-e00c51ab165ad0121271c6f080f7ec67812bf01ceb58b571f58d735fd6f184ba
https://github.com/feast-dev/feast/pull/711/changes#diff-e00c51ab165ad0121271c6f080f7ec67812bf01ceb58b571f58d735fd6f184ba
core/src/main/java/feast/core/service/JobService.javahttps://github.com/feast-dev/feast/pull/711/changes#diff-2d7c4b0863b06e44e7186367d8612e7e4b9be9841efb113841b37268f46d2023
View file https://github.com/zhilingc/feast/blob/c58a6174dbb4bd3eb0b93940e438b3bfa442c666/core/src/main/java/feast/core/service/JobService.java
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/711/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/711/changes#diff-2d7c4b0863b06e44e7186367d8612e7e4b9be9841efb113841b37268f46d2023
https://github.com/feast-dev/feast/pull/711/changes#diff-2d7c4b0863b06e44e7186367d8612e7e4b9be9841efb113841b37268f46d2023
https://github.com/feast-dev/feast/pull/711/changes#diff-2d7c4b0863b06e44e7186367d8612e7e4b9be9841efb113841b37268f46d2023
https://github.com/feast-dev/feast/pull/711/changes#diff-2d7c4b0863b06e44e7186367d8612e7e4b9be9841efb113841b37268f46d2023
https://github.com/feast-dev/feast/pull/711/changes#diff-2d7c4b0863b06e44e7186367d8612e7e4b9be9841efb113841b37268f46d2023
https://github.com/feast-dev/feast/pull/711/changes#diff-2d7c4b0863b06e44e7186367d8612e7e4b9be9841efb113841b37268f46d2023
core/src/main/java/feast/core/service/SpecService.javahttps://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
View file https://github.com/zhilingc/feast/blob/c58a6174dbb4bd3eb0b93940e438b3bfa442c666/core/src/main/java/feast/core/service/SpecService.java
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/711/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
https://github.com/feast-dev/feast/pull/711/changes#diff-77d410df4742593d8bc2f9b7cebc113912c9a9f9a3b832db7e30067c3184196f
Please reload this pagehttps://github.com/feast-dev/feast/pull/711/changes
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.