René's URL Explorer Experiment


Title: feat: Implement spark materialization engine by niklasvm · Pull Request #3184 · feast-dev/feast · GitHub

Open Graph Title: feat: Implement spark materialization engine by niklasvm · Pull Request #3184 · feast-dev/feast

X Title: feat: Implement spark materialization engine by niklasvm · Pull Request #3184 · feast-dev/feast

Description: What this PR does / why we need it: Implement SparkMaterializationEngine which parallelizes writing to the online store across spark executors. This introduces a spark batch engine type. How Data ...

Open Graph Description: What this PR does / why we need it: Implement SparkMaterializationEngine which parallelizes writing to the online store across spark executors. This introduces a spark batch engine type. How Data ...

X Description: What this PR does / why we need it: Implement SparkMaterializationEngine which parallelizes writing to the online store across spark executors. This introduces a spark batch engine type. How Data ...

Opengraph URL: https://github.com/feast-dev/feast/pull/3184

X: @github

direct link

Domain: github.com

route-pattern/_view_fragments/voltron/pull_requests/show/:user_id/:repository/:id/pull_request_layout(.:format)
route-controllervoltron_pull_requests_fragments
route-actionpull_request_layout
fetch-noncev2:d7f0ce01-1fdd-0c8b-6af8-0d5895c87b67
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idE5A6:7B6E4:23DB72:302075:69702A90
html-safe-nonce2f3d09344e263ed38dd917f2497e2146f9a022c9eb59f8769176c2b18e90314f
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFNUE2OjdCNkU0OjIzREI3MjozMDIwNzU6Njk3MDJBOTAiLCJ2aXNpdG9yX2lkIjoiNjA2NjAzODIwMzc2NjI4Njk5MyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacdca5391a39c38fc729bdd16988fa29bb76b035901d6ba5e656577f2119552c16
hovercard-subject-tagpull_request:1046098306
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/pull_requests_fragments/pull_request_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/voltron/pull_requests/show/feast-dev/feast/3184/pull_request_layout
twitter:imagehttps://opengraph.githubassets.com/2d407e76b7f83f0837255ff118e8ccb2f4672a842385f38b269585618c5ce42b/feast-dev/feast/pull/3184
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/2d407e76b7f83f0837255ff118e8ccb2f4672a842385f38b269585618c5ce42b/feast-dev/feast/pull/3184
og:image:altWhat this PR does / why we need it: Implement SparkMaterializationEngine which parallelizes writing to the online store across spark executors. This introduces a spark batch engine type. How Data ...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernameniklasvm
hostnamegithub.com
expected-hostnamegithub.com
None01fa379f5de85ef8e791d09724e69709ce9eb9595278316e0a921312dc88e0bc
turbo-cache-controlno-preview
go-importgithub.com/feast-dev/feast git https://github.com/feast-dev/feast.git
octolytics-dimension-user_id57027613
octolytics-dimension-user_loginfeast-dev
octolytics-dimension-repository_id161133770
octolytics-dimension-repository_nwofeast-dev/feast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id161133770
octolytics-dimension-repository_network_root_nwofeast-dev/feast
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasedda91974c069382b0dfa47b2da7e28bd061c8331
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/feast-dev/feast/pull/3184#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F3184
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F3184
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fpull_requests_fragments%2Fpull_request_layout&source=header-repo&source_repo=feast-dev%2Ffeast
Reloadhttps://github.com/feast-dev/feast/pull/3184
Reloadhttps://github.com/feast-dev/feast/pull/3184
Reloadhttps://github.com/feast-dev/feast/pull/3184
feast-dev https://github.com/feast-dev
feasthttps://github.com/feast-dev/feast
Notifications https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Fork 1.2k https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Star 6.6k https://github.com/login?return_to=%2Ffeast-dev%2Ffeast
Code https://github.com/feast-dev/feast
Issues 176 https://github.com/feast-dev/feast/issues
Pull requests 58 https://github.com/feast-dev/feast/pulls
Discussions https://github.com/feast-dev/feast/discussions
Actions https://github.com/feast-dev/feast/actions
Security Uh oh! There was an error while loading. Please reload this page. https://github.com/feast-dev/feast/security
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
Insights https://github.com/feast-dev/feast/pulse
Code https://github.com/feast-dev/feast
Issues https://github.com/feast-dev/feast/issues
Pull requests https://github.com/feast-dev/feast/pulls
Discussions https://github.com/feast-dev/feast/discussions
Actions https://github.com/feast-dev/feast/actions
Security https://github.com/feast-dev/feast/security
Insights https://github.com/feast-dev/feast/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
Jump to bottomhttps://github.com/feast-dev/feast/pull/3184#issue-comment-box
feast-ci-bothttps://github.com/feast-ci-bot
feast-dev:masterhttps://github.com/feast-dev/feast/tree/master
niklasvm:spark_materialization_enginehttps://github.com/niklasvm/feast/tree/spark_materialization_engine
feat: Implement spark materialization engine https://github.com/feast-dev/feast/pull/3184#top
feast-ci-bothttps://github.com/feast-ci-bot
feast-dev:masterhttps://github.com/feast-dev/feast/tree/master
niklasvm:spark_materialization_enginehttps://github.com/niklasvm/feast/tree/spark_materialization_engine
Conversation 14 https://github.com/feast-dev/feast/pull/3184
Commits 19 https://github.com/feast-dev/feast/pull/3184/commits
Checks 0 https://github.com/feast-dev/feast/pull/3184/checks
Files changed https://github.com/feast-dev/feast/pull/3184/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/{{ revealButtonHref }}
https://github.com/niklasvm
niklasvmhttps://github.com/niklasvm
Sep 5, 2022https://github.com/feast-dev/feast/pull/3184#issue-1361624620
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
#3167https://github.com/feast-dev/feast/issues/3167
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/niklasvm
implement spark materialization enginehttps://github.com/feast-dev/feast/pull/3184/commits/26e0b3e5783f812205803dff56a955a8cf016abc
26e0b3ehttps://github.com/feast-dev/feast/pull/3184/commits/26e0b3e5783f812205803dff56a955a8cf016abc
https://github.com/feast-ci-bot
feast-ci-bothttps://github.com/feast-ci-bot
do-not-merge/work-in-progress https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Ado-not-merge%2Fwork-in-progress
size/L https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Asize%2FL
Sep 5, 2022https://github.com/feast-dev/feast/pull/3184#event-7321171005
https://github.com/niklasvm
remove redundant codehttps://github.com/feast-dev/feast/pull/3184/commits/807e7cac5d21d58a5c5ddf1b2b51874abd758aad
807e7cahttps://github.com/feast-dev/feast/pull/3184/commits/807e7cac5d21d58a5c5ddf1b2b51874abd758aad
https://github.com/niklasvm
niklasvmhttps://github.com/niklasvm
September 5, 2022 09:32https://github.com/feast-dev/feast/pull/3184#event-7321402421
https://github.com/feast-ci-bot
feast-ci-bothttps://github.com/feast-ci-bot
do-not-merge/work-in-progress https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Ado-not-merge%2Fwork-in-progress
Sep 5, 2022https://github.com/feast-dev/feast/pull/3184#event-7321402607
https://github.com/codecov-commenter
codecov-commenterhttps://github.com/codecov-commenter
Sep 5, 2022https://github.com/feast-dev/feast/pull/3184#issuecomment-1236765348
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
Codecovhttps://codecov.io/gh/feast-dev/feast/pull/3184?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
(f828d2b)https://codecov.io/gh/feast-dev/feast/pull/3184?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
(11a0e1a)https://codecov.io/gh/feast-dev/feast/commit/11a0e1a6c63b35644d6bcc9a93a8db89cef8c1f3?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
Click herehttps://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#carryforward-flags-in-the-pull-request-comment
Impacted Fileshttps://codecov.io/gh/feast-dev/feast/pull/3184?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
sdk/python/feast/repo_config.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi9mZWFzdC9yZXBvX2NvbmZpZy5weQ==
...ration/materialization/contrib/spark/test_spark.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi90ZXN0cy9pbnRlZ3JhdGlvbi9tYXRlcmlhbGl6YXRpb24vY29udHJpYi9zcGFyay90ZXN0X3NwYXJrLnB5
...ffline_stores/contrib/spark_offline_store/spark.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi9mZWFzdC9pbmZyYS9vZmZsaW5lX3N0b3Jlcy9jb250cmliL3NwYXJrX29mZmxpbmVfc3RvcmUvc3BhcmsucHk=
...sts/integration/registration/test_universal_cli.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi90ZXN0cy9pbnRlZ3JhdGlvbi9yZWdpc3RyYXRpb24vdGVzdF91bml2ZXJzYWxfY2xpLnB5
...ts/integration/offline_store/test_offline_write.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi90ZXN0cy9pbnRlZ3JhdGlvbi9vZmZsaW5lX3N0b3JlL3Rlc3Rfb2ZmbGluZV93cml0ZS5weQ==
...fline_store/test_universal_historical_retrieval.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi90ZXN0cy9pbnRlZ3JhdGlvbi9vZmZsaW5lX3N0b3JlL3Rlc3RfdW5pdmVyc2FsX2hpc3RvcmljYWxfcmV0cmlldmFsLnB5
...ests/integration/e2e/test_python_feature_server.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi90ZXN0cy9pbnRlZ3JhdGlvbi9lMmUvdGVzdF9weXRob25fZmVhdHVyZV9zZXJ2ZXIucHk=
...dk/python/tests/integration/e2e/test_validation.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi90ZXN0cy9pbnRlZ3JhdGlvbi9lMmUvdGVzdF92YWxpZGF0aW9uLnB5
...s/integration/registration/test_universal_types.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi90ZXN0cy9pbnRlZ3JhdGlvbi9yZWdpc3RyYXRpb24vdGVzdF91bml2ZXJzYWxfdHlwZXMucHk=
sdk/python/feast/infra/online_stores/redis.pyhttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-c2RrL3B5dGhvbi9mZWFzdC9pbmZyYS9vbmxpbmVfc3RvcmVzL3JlZGlzLnB5
162 morehttps://codecov.io/gh/feast-dev/feast/pull/3184/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
how you rate ushttps://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
Share it here.https://app.codecov.io/gh/feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
☔ View full report at Codecovhttps://codecov.io/gh/feast-dev/feast/pull/3184?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
Let us know in this issuehttps://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
niklasvmhttps://github.com/niklasvm
September 5, 2022 11:35https://github.com/feast-dev/feast/pull/3184#commits-pushed-f8e70ea
https://github.com/niklasvm
make function privatehttps://github.com/feast-dev/feast/pull/3184/commits/f8e70ea784cec8c4af7fd8f9aaa15cce24ff77a9
f8e70eahttps://github.com/feast-dev/feast/pull/3184/commits/f8e70ea784cec8c4af7fd8f9aaa15cce24ff77a9
https://github.com/niklasvm
refactor serializing into a classhttps://github.com/feast-dev/feast/pull/3184/commits/b42352e7b71850b801d187879328834387dd591a
b42352ehttps://github.com/feast-dev/feast/pull/3184/commits/b42352e7b71850b801d187879328834387dd591a
https://github.com/niklasvm
niklasvmhttps://github.com/niklasvm
Sep 5, 2022 https://github.com/feast-dev/feast/pull/3184#ref-issue-1359481578
Add Spark materialization engine for parallel, distributed materialization of large datasets. #3167 https://github.com/feast-dev/feast/issues/3167
niklasvmhttps://github.com/niklasvm
September 5, 2022 21:43https://github.com/feast-dev/feast/pull/3184#commits-pushed-f609cfb
https://github.com/niklasvm
switch to using foreachPartitionhttps://github.com/feast-dev/feast/pull/3184/commits/f609cfb3a54f244eb80cdc020193cc87f27a732f
f609cfbhttps://github.com/feast-dev/feast/pull/3184/commits/f609cfb3a54f244eb80cdc020193cc87f27a732f
https://github.com/niklasvm
remove batch_size parameterhttps://github.com/feast-dev/feast/pull/3184/commits/79ea412ad1c457a16a4b6f68db74b13f14f8165f
79ea412https://github.com/feast-dev/feast/pull/3184/commits/79ea412ad1c457a16a4b6f68db74b13f14f8165f
https://github.com/kevjumba
kevjumbahttps://github.com/kevjumba
ok-to-test https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Aok-to-test
Sep 7, 2022https://github.com/feast-dev/feast/pull/3184#event-7341506448
https://github.com/kevjumba
kevjumbahttps://github.com/kevjumba
Sep 7, 2022https://github.com/feast-dev/feast/pull/3184#event-7341776198
niklasvmhttps://github.com/niklasvm
September 7, 2022 22:04https://github.com/feast-dev/feast/pull/3184#commits-pushed-937a0e3
https://github.com/niklasvm
add partitions parameterhttps://github.com/feast-dev/feast/pull/3184/commits/937a0e380a3e950c70c0d252c9819e645afc5d04
937a0e3https://github.com/feast-dev/feast/pull/3184/commits/937a0e380a3e950c70c0d252c9819e645afc5d04
https://github.com/niklasvm
lintinghttps://github.com/feast-dev/feast/pull/3184/commits/610614acbd321f3f3cc6e4d6c9b0fbda09ce5430
610614ahttps://github.com/feast-dev/feast/pull/3184/commits/610614acbd321f3f3cc6e4d6c9b0fbda09ce5430
https://github.com/niklasvm
rename spark to spark.offline and spark.enginehttps://github.com/feast-dev/feast/pull/3184/commits/84cc858b02188575eb27bf372c87dab1450033eb
84cc858https://github.com/feast-dev/feast/pull/3184/commits/84cc858b02188575eb27bf372c87dab1450033eb
https://github.com/niklasvm
fix to testhttps://github.com/feast-dev/feast/pull/3184/commits/8cc4928d764d53e7c57e5d3689200eefadd6b7f9
8cc4928https://github.com/feast-dev/feast/pull/3184/commits/8cc4928d764d53e7c57e5d3689200eefadd6b7f9
https://github.com/niklasvm
forgot to stagehttps://github.com/feast-dev/feast/pull/3184/commits/6a9663dbfe01a27d25ff9db5d78b3bd96a7a04f4
6a9663dhttps://github.com/feast-dev/feast/pull/3184/commits/6a9663dbfe01a27d25ff9db5d78b3bd96a7a04f4
https://github.com/achals
achalshttps://github.com/achals
Sep 7, 2022 https://github.com/feast-dev/feast/pull/3184#pullrequestreview-1099758433
View reviewed changes https://github.com/feast-dev/feast/pull/3184/files/6a9663dbfe01a27d25ff9db5d78b3bd96a7a04f4
sdk/python/feast/infra/offline_stores/contrib/spark_offline_store/spark.pyhttps://github.com/feast-dev/feast/pull/3184/files/6a9663dbfe01a27d25ff9db5d78b3bd96a7a04f4#diff-ef3fce408c702d00aa891015376e83ff1084907c69c95cafacf5fae657fca486
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
sdk/python/feast/infra/materialization/contrib/spark/spark_materialization_engine.pyhttps://github.com/feast-dev/feast/pull/3184/files/6a9663dbfe01a27d25ff9db5d78b3bd96a7a04f4#diff-f9c26783a568f9ac7132495d9dc3eee38527e78252d265b5870c6b2483db2209
achalshttps://github.com/achals
Sep 7, 2022https://github.com/feast-dev/feast/pull/3184#discussion_r965245876
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
niklasvmhttps://github.com/niklasvm
September 8, 2022 07:39https://github.com/feast-dev/feast/pull/3184#commits-pushed-715bb72
https://github.com/niklasvm
revert spark.offline to spark to ensure backward compatibilityhttps://github.com/feast-dev/feast/pull/3184/commits/715bb7254235e007de06206c51c57d79664c5948
715bb72https://github.com/feast-dev/feast/pull/3184/commits/715bb7254235e007de06206c51c57d79664c5948
https://github.com/niklasvm
Merge branch 'master' into spark_materialization_enginehttps://github.com/feast-dev/feast/pull/3184/commits/de1a85a6e56f37151657a71606925eab7dd8fa20
de1a85ahttps://github.com/feast-dev/feast/pull/3184/commits/de1a85a6e56f37151657a71606925eab7dd8fa20
https://github.com/niklasvm
fix importhttps://github.com/feast-dev/feast/pull/3184/commits/32b31119de5d9b351d45235497a3f5cf49be6fbb
32b3111https://github.com/feast-dev/feast/pull/3184/commits/32b31119de5d9b351d45235497a3f5cf49be6fbb
https://github.com/niklasvm
remove code from testing a large data sethttps://github.com/feast-dev/feast/pull/3184/commits/0c13af9c1da79b65fca0f9ca2da47ce96d9dd9bc
0c13af9https://github.com/feast-dev/feast/pull/3184/commits/0c13af9c1da79b65fca0f9ca2da47ce96d9dd9bc
https://github.com/niklasvm
lintinghttps://github.com/feast-dev/feast/pull/3184/commits/542705f015b5201422a65eb0e7a75a9b89e6dd51
542705fhttps://github.com/feast-dev/feast/pull/3184/commits/542705f015b5201422a65eb0e7a75a9b89e6dd51
https://github.com/niklasvm
niklasvmhttps://github.com/niklasvm
achalshttps://github.com/achals
September 8, 2022 07:00https://github.com/feast-dev/feast/pull/3184#event-7344680692
https://github.com/ckarwicki
ckarwickihttps://github.com/ckarwicki
Sep 13, 2022https://github.com/feast-dev/feast/pull/3184#issuecomment-1244760056
@niklasvmhttps://github.com/niklasvm
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/niklasvm
niklasvmhttps://github.com/niklasvm
Sep 13, 2022https://github.com/feast-dev/feast/pull/3184#issuecomment-1244892733
@niklasvmhttps://github.com/niklasvm
@ckarwickihttps://github.com/ckarwicki
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/niklasvm
test without repartitionhttps://github.com/feast-dev/feast/pull/3184/commits/262af105eab897d19f088dd662d5b205b9ac3dff
262af10https://github.com/feast-dev/feast/pull/3184/commits/262af105eab897d19f088dd662d5b205b9ac3dff
https://github.com/niklasvm
niklasvmhttps://github.com/niklasvm
kevjumbahttps://github.com/kevjumba
code ownerhttps://github.com/feast-dev/feast/blob/7bc1dff5882c53c7e25f51ddb0b730bd81091a03/CODEOWNERS#L26
September 13, 2022 04:56https://github.com/feast-dev/feast/pull/3184#event-7373020817
niklasvmhttps://github.com/niklasvm
September 13, 2022 07:06https://github.com/feast-dev/feast/pull/3184#commits-pushed-8e59da2
https://github.com/niklasvm
test alternate connection stringhttps://github.com/feast-dev/feast/pull/3184/commits/8e59da2fc1c0aca1b368a71239fd3c62ea948c69
8e59da2https://github.com/feast-dev/feast/pull/3184/commits/8e59da2fc1c0aca1b368a71239fd3c62ea948c69
https://github.com/niklasvm
use redis online creatorhttps://github.com/feast-dev/feast/pull/3184/commits/f828d2b95bc5fd0dcbd813db47857d59f960cfce
f828d2bhttps://github.com/feast-dev/feast/pull/3184/commits/f828d2b95bc5fd0dcbd813db47857d59f960cfce
https://github.com/adchia
adchiahttps://github.com/adchia
Sep 13, 2022 https://github.com/feast-dev/feast/pull/3184#pullrequestreview-1106210672
View reviewed changes https://github.com/feast-dev/feast/pull/3184/files/f828d2b95bc5fd0dcbd813db47857d59f960cfce
sdk/python/feast/infra/materialization/contrib/spark/spark_materialization_engine.pyhttps://github.com/feast-dev/feast/pull/3184/files/f828d2b95bc5fd0dcbd813db47857d59f960cfce#diff-f9c26783a568f9ac7132495d9dc3eee38527e78252d265b5870c6b2483db2209
adchiahttps://github.com/adchia
Sep 13, 2022https://github.com/feast-dev/feast/pull/3184#discussion_r969914916
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
sdk/python/feast/infra/materialization/contrib/spark/spark_materialization_engine.pyhttps://github.com/feast-dev/feast/pull/3184/files/f828d2b95bc5fd0dcbd813db47857d59f960cfce#diff-f9c26783a568f9ac7132495d9dc3eee38527e78252d265b5870c6b2483db2209
adchiahttps://github.com/adchia
Sep 13, 2022https://github.com/feast-dev/feast/pull/3184#discussion_r969916222
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/feast-ci-bot
feast-ci-bothttps://github.com/feast-ci-bot
approved https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Aapproved
Sep 13, 2022https://github.com/feast-dev/feast/pull/3184#event-7378818159
https://github.com/ckarwicki
ckarwickihttps://github.com/ckarwicki
Sep 13, 2022https://github.com/feast-dev/feast/pull/3184#issuecomment-1245953959
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
@niklasvmhttps://github.com/niklasvm
Bitnamihttps://bitnami.com/stack/spark/helm
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/hao-affirm
hao-affirmhttps://github.com/hao-affirm
Sep 14, 2022https://github.com/feast-dev/feast/pull/3184#issuecomment-1247286747
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/niklasvm
niklasvmhttps://github.com/niklasvm
Sep 15, 2022https://github.com/feast-dev/feast/pull/3184#issuecomment-1248098368
@adchiahttps://github.com/adchia
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/adchia
adchiahttps://github.com/adchia
Sep 15, 2022 https://github.com/feast-dev/feast/pull/3184#pullrequestreview-1109281235
View reviewed changes https://github.com/feast-dev/feast/pull/3184/files/f828d2b95bc5fd0dcbd813db47857d59f960cfce
adchiahttps://github.com/adchia
https://github.com/feast-dev/feast/pull/3184#pullrequestreview-1109281235
Learn morehttps://docs.github.com/articles/managing-disruptive-comments/#hiding-a-comment
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/feast-ci-bot
feast-ci-bothttps://github.com/feast-ci-bot
adchiahttps://github.com/adchia
Sep 15, 2022https://github.com/feast-dev/feast/pull/3184#event-7395456742
https://github.com/feast-ci-bot
feast-ci-bothttps://github.com/feast-ci-bot
lgtm https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Algtm
Sep 15, 2022https://github.com/feast-dev/feast/pull/3184#event-7395456862
https://github.com/feast-ci-bot
feast-ci-bothttps://github.com/feast-ci-bot
Sep 15, 2022https://github.com/feast-dev/feast/pull/3184#issuecomment-1248164981
adchiahttps://github.com/feast-dev/feast/pull/3184#pullrequestreview-1109281235
niklasvmhttps://github.com/feast-dev/feast/pull/3184
herehttps://go.k8s.io/bot-commands?repo=feast-dev%2Ffeast
herehttps://git.k8s.io/community/contributors/guide/owners.md#the-code-review-process
OWNERShttps://github.com/feast-dev/feast/blob/master/OWNERS
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/feast-ci-bot
feast-ci-bothttps://github.com/feast-ci-bot
a59c33ahttps://github.com/feast-dev/feast/commit/a59c33ac10760b4029fadd8e377eb36a2c458583
Sep 15, 2022https://github.com/feast-dev/feast/pull/3184#event-7395731468
felixwang9817https://github.com/felixwang9817
Sep 20, 2022 https://github.com/feast-dev/feast/pull/3184#ref-commit-769c318
https://github.com/feast-ci-bot
chore(release): release 0.25.0https://github.com/feast-dev/feast/commit/769c31869eb8d9bb693f8a2876cc68b8cdd16521
769c318https://github.com/feast-dev/feast/commit/769c31869eb8d9bb693f8a2876cc68b8cdd16521
v0.24.0...v0.25.0https://github.com/feast-dev/feast/compare/v0.24.0...v0.25.0
#3227https://github.com/feast-dev/feast/pull/3227
#3227https://github.com/feast-dev/feast/pull/3227
e117082https://github.com/feast-dev/feast/commit/e1170822bd3de8e1bfe803d9e2757c760fa5df2f
e117082https://github.com/feast-dev/feast/commit/e1170822bd3de8e1bfe803d9e2757c760fa5df2f
#3223https://github.com/feast-dev/feast/pull/3223
#3223https://github.com/feast-dev/feast/pull/3223
ae37b20https://github.com/feast-dev/feast/commit/ae37b2058e59a722c45324f5b43668ae4e74657d
ae37b20https://github.com/feast-dev/feast/commit/ae37b2058e59a722c45324f5b43668ae4e74657d
#3232https://github.com/feast-dev/feast/pull/3232
#3232https://github.com/feast-dev/feast/pull/3232
f020630https://github.com/feast-dev/feast/commit/f020630c0144ab366f50c29dc3c97b8501687d3b
f020630https://github.com/feast-dev/feast/commit/f020630c0144ab366f50c29dc3c97b8501687d3b
#3166https://github.com/feast-dev/feast/pull/3166
#3166https://github.com/feast-dev/feast/pull/3166
175fd25https://github.com/feast-dev/feast/commit/175fd256e0d21f6539f68708705bddf1caa3d975
175fd25https://github.com/feast-dev/feast/commit/175fd256e0d21f6539f68708705bddf1caa3d975
#3172https://github.com/feast-dev/feast/pull/3172
#3172https://github.com/feast-dev/feast/pull/3172
7c50ab5https://github.com/feast-dev/feast/commit/7c50ab510633c11646b6ff04853f3f26942ad646
7c50ab5https://github.com/feast-dev/feast/commit/7c50ab510633c11646b6ff04853f3f26942ad646
#3144https://github.com/feast-dev/feast/pull/3144
#3144https://github.com/feast-dev/feast/pull/3144
20a9dd9https://github.com/feast-dev/feast/commit/20a9dd98550ad8daf291381a771b3da798e4c1a4
#3191https://github.com/feast-dev/feast/pull/3191
#3191https://github.com/feast-dev/feast/pull/3191
de75971https://github.com/feast-dev/feast/commit/de75971e27357a8fb4a882bd7ec4212148256616
de75971https://github.com/feast-dev/feast/commit/de75971e27357a8fb4a882bd7ec4212148256616
#3154https://github.com/feast-dev/feast/pull/3154
#3154https://github.com/feast-dev/feast/pull/3154
5ddb83bhttps://github.com/feast-dev/feast/commit/5ddb83b14817f55e51e5c89014a3439ec3ef5a59
5ddb83bhttps://github.com/feast-dev/feast/commit/5ddb83b14817f55e51e5c89014a3439ec3ef5a59
#3195https://github.com/feast-dev/feast/pull/3195
#3195https://github.com/feast-dev/feast/pull/3195
cdf0fafhttps://github.com/feast-dev/feast/commit/cdf0fafa6939f67cfb13ee3e28ff16a46c2147ae
cdf0fafhttps://github.com/feast-dev/feast/commit/cdf0fafa6939f67cfb13ee3e28ff16a46c2147ae
#3204https://github.com/feast-dev/feast/pull/3204
#3204https://github.com/feast-dev/feast/pull/3204
dfdd0cahttps://github.com/feast-dev/feast/commit/dfdd0ca5fe54b638ac5a268501d67e5621ca8d89
dfdd0cahttps://github.com/feast-dev/feast/commit/dfdd0ca5fe54b638ac5a268501d67e5621ca8d89
#3217https://github.com/feast-dev/feast/pull/3217
#3217https://github.com/feast-dev/feast/pull/3217
a906018https://github.com/feast-dev/feast/commit/a9060188713e34d07fd82cf3469061fdd2220956
a906018https://github.com/feast-dev/feast/commit/a9060188713e34d07fd82cf3469061fdd2220956
#3193https://github.com/feast-dev/feast/pull/3193
#3193https://github.com/feast-dev/feast/pull/3193
189afb9https://github.com/feast-dev/feast/commit/189afb9313d071c7b6492e0e8a996e6d073a2c6c
189afb9https://github.com/feast-dev/feast/commit/189afb9313d071c7b6492e0e8a996e6d073a2c6c
#3206https://github.com/feast-dev/feast/pull/3206
#3206https://github.com/feast-dev/feast/pull/3206
7bc1dffhttps://github.com/feast-dev/feast/commit/7bc1dff5882c53c7e25f51ddb0b730bd81091a03
7bc1dffhttps://github.com/feast-dev/feast/commit/7bc1dff5882c53c7e25f51ddb0b730bd81091a03
#3175https://github.com/feast-dev/feast/pull/3175
#3175https://github.com/feast-dev/feast/pull/3175
2107ce2https://github.com/feast-dev/feast/commit/2107ce295f191eb1339c8670f963d39e66c4ccf6
2107ce2https://github.com/feast-dev/feast/commit/2107ce295f191eb1339c8670f963d39e66c4ccf6
#3219https://github.com/feast-dev/feast/pull/3219
#3219https://github.com/feast-dev/feast/pull/3219
fbc6a2chttps://github.com/feast-dev/feast/commit/fbc6a2c48303424ef08f9b206e406fc0448e5c6f
fbc6a2chttps://github.com/feast-dev/feast/commit/fbc6a2c48303424ef08f9b206e406fc0448e5c6f
#3202https://github.com/feast-dev/feast/pull/3202
#3202https://github.com/feast-dev/feast/pull/3202
43222f2https://github.com/feast-dev/feast/commit/43222f21046c54a68250350c49b4cdf819d41591
43222f2https://github.com/feast-dev/feast/commit/43222f21046c54a68250350c49b4cdf819d41591
#3148https://github.com/feast-dev/feast/pull/3148
#3148https://github.com/feast-dev/feast/pull/3148
50e8755https://github.com/feast-dev/feast/commit/50e8755d41ca2eacd41e31fc0be1202c69b61fdd
50e8755https://github.com/feast-dev/feast/commit/50e8755d41ca2eacd41e31fc0be1202c69b61fdd
#3176https://github.com/feast-dev/feast/pull/3176
#3176https://github.com/feast-dev/feast/pull/3176
39aeea3https://github.com/feast-dev/feast/commit/39aeea3fa77c3b3a789556a1e0fa22ecedcae4ea
39aeea3https://github.com/feast-dev/feast/commit/39aeea3fa77c3b3a789556a1e0fa22ecedcae4ea
#3139https://github.com/feast-dev/feast/pull/3139
#3139https://github.com/feast-dev/feast/pull/3139
a752211https://github.com/feast-dev/feast/commit/a752211e1d0d6b44901d88f435328fc355d16c20
a752211https://github.com/feast-dev/feast/commit/a752211e1d0d6b44901d88f435328fc355d16c20
#3184https://github.com/feast-dev/feast/pull/3184
#3184https://github.com/feast-dev/feast/pull/3184
a59c33ahttps://github.com/feast-dev/feast/commit/a59c33ac10760b4029fadd8e377eb36a2c458583
a59c33ahttps://github.com/feast-dev/feast/commit/a59c33ac10760b4029fadd8e377eb36a2c458583
Sign up for freehttps://github.com/join?source=comment-repo
Sign in to commenthttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F3184
https://github.com/adchia
adchia https://github.com/adchia
https://github.com/feast-dev/feast/pull/3184/files/f828d2b95bc5fd0dcbd813db47857d59f960cfce
https://github.com/achals
achals https://github.com/achals
https://github.com/kevjumba
kevjumba https://github.com/kevjumba
https://github.com/adchia
adchia https://github.com/adchia
https://github.com/kevjumba
kevjumba https://github.com/kevjumba
approved https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Aapproved
lgtm https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Algtm
ok-to-test https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Aok-to-test
size/L https://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3Asize%2FL
Add Spark materialization engine for parallel, distributed materialization of large datasets. https://github.com/feast-dev/feast/issues/3167
Please reload this pagehttps://github.com/feast-dev/feast/pull/3184
https://github.com/niklasvm
https://github.com/codecov-commenter
https://github.com/ckarwicki
https://github.com/hao-affirm
https://github.com/feast-ci-bot
https://github.com/achals
https://github.com/adchia
https://github.com/kevjumba
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.