René's URL Explorer Experiment


Title: feat: Databricks Unity Catalog Materialization by falloficaruss · Pull Request #6565 · feast-dev/feast · GitHub

Open Graph Title: feat: Databricks Unity Catalog Materialization by falloficaruss · Pull Request #6565 · feast-dev/feast

X Title: feat: Databricks Unity Catalog Materialization by falloficaruss · Pull Request #6565 · feast-dev/feast

Description: What this PR does / why we need it: The L3 PR adds UC-backed materialization — the ability to write materialized features back to Unity Catalog Delta tables during feast materialize. When feast materialize runs, the compute engine nodes (LocalOutputNode in local/nodes.py, SparkWriteNode in spark/nodes.py) now call a new write_uc_materialized_data() hook after writing to the online/offline stores. This hook: Checks if the offline store is databricks_uc with uc_registration.enabled Resolves the UC target path (catalog.schema.feature_view_name) from config or FeatureView tags Creates the UC feature table if it doesn't exist yet (via FeatureEngineeringClient.create_table) Merges the materialized data into the UC Delta table (via fe_client.write_table(mode="merge")) Which issue(s) this PR fixes: Fixes #6499 Checks I've made sure the tests are passing. My commits are signed off (git commit -s) My PR title follows conventional commits format Testing Strategy Unit tests Integration tests Manual tests Testing is not required for this change Misc

Open Graph Description: What this PR does / why we need it: The L3 PR adds UC-backed materialization — the ability to write materialized features back to Unity Catalog Delta tables during feast materialize. When feast mat...

X Description: What this PR does / why we need it: The L3 PR adds UC-backed materialization — the ability to write materialized features back to Unity Catalog Delta tables during feast materialize. When feast mat...

Opengraph URL: https://github.com/feast-dev/feast/pull/6565

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:cbcdd9e2-5b7c-d2f6-d0b5-a010bdbb9494
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-id981A:338EF9:ED810B:145DF3A:6AFE9835
html-safe-nonce3a61e63b04ee78589ff2293b7c70f7bfbb9e3f0ae6d09458e1bfff1f7bcce9bc
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5ODFBOjMzOEVGOTpFRDgxMEI6MTQ1REYzQTo2QUZFOTgzNSIsInZpc2l0b3JfaWQiOiI4NjE0Njc1NjI0MDU0NjU5MTI1IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmacd343932c29c32b51210c963bd81fcb2b14dde5c9b3980c4f9348de6e2ad6d26b
hovercard-subject-tagpull_request:3950420734
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/feast-dev/feast/pull/6565/files
twitter:imagehttps://avatars.githubusercontent.com/u/139879930?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/139879930?s=400&v=4
og:image:altWhat this PR does / why we need it: The L3 PR adds UC-backed materialization — the ability to write materialized features back to Unity Catalog Delta tables during feast materialize. When feast mat...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneb3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/feast-dev/feast git https://github.com/feast-dev/feast.git
octolytics-dimension-user_id57027613
octolytics-dimension-user_loginfeast-dev
octolytics-dimension-repository_id161133770
octolytics-dimension-repository_nwofeast-dev/feast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id161133770
octolytics-dimension-repository_network_root_nwofeast-dev/feast
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release4a10310af51a1bfffbedc4fd81cb582acf0cb0ff
ui-targetcanary-1
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/feast-dev/feast/pull/6565/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F6565%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F6565%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=feast-dev%2Ffeast
Reloadhttps://github.com/feast-dev/feast/pull/6565/files
Reloadhttps://github.com/feast-dev/feast/pull/6565/files
Reloadhttps://github.com/feast-dev/feast/pull/6565/files
feast-devhttps://github.com/feast-dev
feasthttps://github.com/feast-dev/feast
Codehttps://github.com/feast-dev/feast
Issues223 (223)https://github.com/feast-dev/feast/issues
Pull requests143 (143)https://github.com/feast-dev/feast/pulls
Discussionshttps://github.com/feast-dev/feast/discussions
Actionshttps://github.com/feast-dev/feast/actions
Security and quality1 (1)https://github.com/feast-dev/feast/security
Insightshttps://github.com/feast-dev/feast/insights
Sign up for GitHub https://github.com/signup?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
falloficarusshttps://github.com/falloficaruss
feast-dev:masterhttps://github.com/feast-dev/feast/tree/master
falloficaruss:feat/databricks-uc-materializationhttps://github.com/falloficaruss/feast/tree/feat/databricks-uc-materialization
Conversation 0 https://github.com/feast-dev/feast/pull/6565
Commits 24 https://github.com/feast-dev/feast/pull/6565/commits
Checks 1 https://github.com/feast-dev/feast/pull/6565/checks
Files changed https://github.com/feast-dev/feast/pull/6565/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/6565/files
feat: Databricks Unity Catalog Materialization https://github.com/feast-dev/feast/pull/6565/files#top
Show all changes 24 commits https://github.com/feast-dev/feast/pull/6565/files
0800f13 feat: Implement Databricks Unity Catalog offline store integration falloficaruss Jun 14, 2026 https://github.com/feast-dev/feast/pull/6565/commits/0800f135332adf57b68a7fb95ac2faee9125f77f
3a4edcd Merge branch 'master' into feat/databricks-uc-provider falloficaruss Jun 16, 2026 https://github.com/feast-dev/feast/pull/6565/commits/3a4edcdb4b692e95f0ce2d01b7cdb68908bf57b0
664107f fix: Initialize Databricks session in DatabricksUCOfflineStore valida… falloficaruss Jun 16, 2026 https://github.com/feast-dev/feast/pull/6565/commits/664107f0a27da3c2adf0aadeeacd9059c2a014d4
3b30044 fix: Fix MyPy errors by asserting SparkSession is not None falloficaruss Jun 21, 2026 https://github.com/feast-dev/feast/pull/6565/commits/3b30044732ae09ae61978002e8d8baf4939fed83
6059c9d Merge branch 'master' into feat/databricks-uc-provider falloficaruss Jun 21, 2026 https://github.com/feast-dev/feast/pull/6565/commits/6059c9d67de27b5b28c5999bc69c4486707393e9
faa0675 feat: Register FeatureViews as Unity Catalog feature tables on feast … falloficaruss Jun 27, 2026 https://github.com/feast-dev/feast/pull/6565/commits/faa0675ba46398113bc6f53956a09581719e70c5
327228c fix: Rename schema to uc_schema, add missing type mappings, add tests… falloficaruss Jun 28, 2026 https://github.com/feast-dev/feast/pull/6565/commits/327228c6f69d8f11bcdf120bdd5836f7e5a18d07
147a572 Merge branch 'master' into feat/databricks-uc-registration falloficaruss Jun 28, 2026 https://github.com/feast-dev/feast/pull/6565/commits/147a572b8438c54cb3c4104095a76cbccc451d50
3d0c8ca Merge branch 'master' into feat/databricks-uc-registration falloficaruss Jul 1, 2026 https://github.com/feast-dev/feast/pull/6565/commits/3d0c8cae054058bd217f00602d36553194a6352e
16870f3 feat: Refactor L2 to build on Iceberg REST Catalog instead of Databri… falloficaruss Jul 1, 2026 https://github.com/feast-dev/feast/pull/6565/commits/16870f37d960bb5a85df0a4ec346b9f0c3f91d01
4f41ccf feat: Implement UC-backed materialization via compute engine hooks (L3) falloficaruss Jun 28, 2026 https://github.com/feast-dev/feast/pull/6565/commits/4f41ccf39fa94ab22c6c3bff76f015239fd380fa
c2a0d27 feat: Add click-to-zoom lightbox for blog post images (#6575) franciscojavierarceo Jul 1, 2026 https://github.com/feast-dev/feast/pull/6565/commits/c2a0d271593883aa04b436e4dea59164c51e27c8
9446524 fix: configure FIPS-compliant gRPC cipher suites for offline server aniketpalu Jul 1, 2026 https://github.com/feast-dev/feast/pull/6565/commits/9446524f3379124955a4a8c72d0710b5cc0625b3
5ce0cf7 feat: Add OnlineStore for Aerospike (#6532) vkagamlyk Jul 2, 2026 https://github.com/feast-dev/feast/pull/6565/commits/5ce0cf72b0a442cb409134d306c87ff7fbe22e89
267abdf fix: add debug logging for FIPS mode detection fallback aniketpalu Jul 2, 2026 https://github.com/feast-dev/feast/pull/6565/commits/267abdfd2a6eb00a44336c71633b7ba1f71fa597
4193c0d fix: Unblock nightly UI build (#6570) franciscojavierarceo Jul 3, 2026 https://github.com/feast-dev/feast/pull/6565/commits/4193c0d81624fb542868736db5f9366a248eb381
386599e feat: Implement Iceberg REST Catalog-backed materialization (L3) falloficaruss Jul 3, 2026 https://github.com/feast-dev/feast/pull/6565/commits/386599e874d4169ca0ac79d60c71bc9448f3c2f1
d08c7c4 Merge branch 'master' into feat/databricks-uc-materialization falloficaruss Jul 3, 2026 https://github.com/feast-dev/feast/pull/6565/commits/d08c7c4600bf8b5494beb1574451497ead1070e6
b7eb48f Merge branch 'master' into feat/databricks-uc-registration falloficaruss Jul 3, 2026 https://github.com/feast-dev/feast/pull/6565/commits/b7eb48fbb236fc9250eeb82f7c6ac672c6881760
40a3de3 fix: Resolve 4 mypy errors in spark offline store, iceberg catalog, a… falloficaruss Jul 4, 2026 https://github.com/feast-dev/feast/pull/6565/commits/40a3de3bf586ab2ede49070704231adca0281dc8
ce723ff Merge remote-tracking branch 'origin/feat/databricks-uc-registration'… falloficaruss Jul 4, 2026 https://github.com/feast-dev/feast/pull/6565/commits/ce723ffe75045b3785bc955cf9cf662bae6acfca
a52ea37 fix: Eliminate TOCTOU race condition in Iceberg table registration falloficaruss Jul 4, 2026 https://github.com/feast-dev/feast/pull/6565/commits/a52ea37feae72c9150534ae2e3ddb5cff7725a8f
c70408e Merge remote-tracking branch 'origin/feat/databricks-uc-registration'… falloficaruss Jul 4, 2026 https://github.com/feast-dev/feast/pull/6565/commits/c70408e3083741876511d1b643a35b2c610df409
23d8c15 fix: Resolve materialization issues falloficaruss Jul 4, 2026 https://github.com/feast-dev/feast/pull/6565/commits/23d8c15d827cd677c4897dbd683047bf81edfdcb
Clear filters https://github.com/feast-dev/feast/pull/6565/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/6565/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/6565/files
feature_store.py https://github.com/feast-dev/feast/pull/6565/files#diff-ff4e2a65c8c29b7971edc77a61a7e970d410d77d9f173f72714d1bb49e2509a2
nodes.py https://github.com/feast-dev/feast/pull/6565/files#diff-2bd83cc19ff86d45bccb21f290302107ce03cff87ace4e600cda864645481f8d
nodes.py https://github.com/feast-dev/feast/pull/6565/files#diff-ef3c9f42859de83e0118dbc9b53b79509853421c612aa0cf630f2f894ecd3538
databricks_uc.py https://github.com/feast-dev/feast/pull/6565/files#diff-e2dbd9ed96ebec2711f48d76e89908b6b835c9b48f0c89a7e0a2e44f1e952c45
spark.py https://github.com/feast-dev/feast/pull/6565/files#diff-ef3fce408c702d00aa891015376e83ff1084907c69c95cafacf5fae657fca486
utils.py https://github.com/feast-dev/feast/pull/6565/files#diff-af8ec0a83a01d693f6bb4294e884c8a4e2f673217b920f8b83318bc0f9b8a843
__init__.py https://github.com/feast-dev/feast/pull/6565/files#diff-97f17b771c78ccbfed852979950417d7e25b1453aa6682b79c6b13e248fdad15
catalog_config.py https://github.com/feast-dev/feast/pull/6565/files#diff-a3c594de479f819b607ba9cea522dcbe30fbc4ea0b54d2fcd067150fa48f2f61
catalog_manager.py https://github.com/feast-dev/feast/pull/6565/files#diff-0b93b8acf388f641c65fa3ce51f21ac6f38671df57e192c1e3787a44dced09f2
iceberg_source.py https://github.com/feast-dev/feast/pull/6565/files#diff-954056e317fd0267d341f2608178bbce2ec4c152ff921352cbf847da113afd2f
registration.py https://github.com/feast-dev/feast/pull/6565/files#diff-eb416d6960b192b7e7ce31885328cbf6789b8fbce3459d96e46f7e227fbeebee
repo_config.py https://github.com/feast-dev/feast/pull/6565/files#diff-c90c6781dcec3cdcc26843e013d3d6e9c1ce89d084b3a67e818fe76a0c7d0436
test_databricks_uc.py https://github.com/feast-dev/feast/pull/6565/files#diff-c934b69e3144d9ae41f27014454a27fdb02a4108a711391e588ca93d66fe42db
test_iceberg_source.py https://github.com/feast-dev/feast/pull/6565/files#diff-68bc3c906ac1f9c01d3e0e81a998ddff651f51b257c59bf8ef224f80ca66e77c
test_uc_registration.py https://github.com/feast-dev/feast/pull/6565/files#diff-bde86da9d64da0fa3bf1baefaa711aecf737ab36d73725903dffbd4fa36a0415
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L10
sdk/python/feast/feature_store.pyhttps://github.com/feast-dev/feast/pull/6565/files#diff-ff4e2a65c8c29b7971edc77a61a7e970d410d77d9f173f72714d1bb49e2509a2
View file https://github.com/feast-dev/feast/blob/23d8c15d827cd677c4897dbd683047bf81edfdcb/sdk/python/feast/feature_store.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/6565/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/6565/files#diff-ff4e2a65c8c29b7971edc77a61a7e970d410d77d9f173f72714d1bb49e2509a2
https://github.com/feast-dev/feast/pull/6565/files#diff-ff4e2a65c8c29b7971edc77a61a7e970d410d77d9f173f72714d1bb49e2509a2
https://github.com/feast-dev/feast/pull/6565/files#diff-ff4e2a65c8c29b7971edc77a61a7e970d410d77d9f173f72714d1bb49e2509a2
https://github.com/feast-dev/feast/pull/6565/files#diff-ff4e2a65c8c29b7971edc77a61a7e970d410d77d9f173f72714d1bb49e2509a2
https://github.com/feast-dev/feast/pull/6565/files#diff-ff4e2a65c8c29b7971edc77a61a7e970d410d77d9f173f72714d1bb49e2509a2
https://github.com/feast-dev/feast/pull/6565/files#diff-ff4e2a65c8c29b7971edc77a61a7e970d410d77d9f173f72714d1bb49e2509a2
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L10
sdk/python/feast/infra/compute_engines/local/nodes.pyhttps://github.com/feast-dev/feast/pull/6565/files#diff-2bd83cc19ff86d45bccb21f290302107ce03cff87ace4e600cda864645481f8d
View file https://github.com/feast-dev/feast/blob/23d8c15d827cd677c4897dbd683047bf81edfdcb/sdk/python/feast/infra/compute_engines/local/nodes.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/6565/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/6565/files#diff-2bd83cc19ff86d45bccb21f290302107ce03cff87ace4e600cda864645481f8d
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L10
sdk/python/feast/infra/compute_engines/spark/nodes.pyhttps://github.com/feast-dev/feast/pull/6565/files#diff-ef3c9f42859de83e0118dbc9b53b79509853421c612aa0cf630f2f894ecd3538
View file https://github.com/feast-dev/feast/blob/23d8c15d827cd677c4897dbd683047bf81edfdcb/sdk/python/feast/infra/compute_engines/spark/nodes.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/6565/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/6565/files#diff-ef3c9f42859de83e0118dbc9b53b79509853421c612aa0cf630f2f894ecd3538
https://github.com/feast-dev/feast/pull/6565/files#diff-ef3c9f42859de83e0118dbc9b53b79509853421c612aa0cf630f2f894ecd3538
Please reload this pagehttps://github.com/feast-dev/feast/pull/6565/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.