René's URL Explorer Experiment


Title: feat: Extend Feast's DataSource to natively support Iceberg REST Catalog-backed tables · Issue #6499 · feast-dev/feast · GitHub

Open Graph Title: feat: Extend Feast's DataSource to natively support Iceberg REST Catalog-backed tables · Issue #6499 · feast-dev/feast

X Title: feat: Extend Feast's DataSource to natively support Iceberg REST Catalog-backed tables · Issue #6499 · feast-dev/feast

Description: Problem Teams running Unity Catalog can read UC-governed Delta tables today via the Spark offline store and SparkSource (e.g. catalog.schema.table), but there is no first-class integration for: UC feature table registration — Feast feast...

Open Graph Description: Problem Teams running Unity Catalog can read UC-governed Delta tables today via the Spark offline store and SparkSource (e.g. catalog.schema.table), but there is no first-class integration for: UC ...

X Description: Problem Teams running Unity Catalog can read UC-governed Delta tables today via the Spark offline store and SparkSource (e.g. catalog.schema.table), but there is no first-class integration for: UC ...

Opengraph URL: https://github.com/feast-dev/feast/issues/6499

X: @github

direct link

Domain: github.com


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"feat: Extend Feast's DataSource to natively support Iceberg REST Catalog-backed tables","articleBody":"## Problem\n\nTeams running **Unity Catalog** can read UC-governed Delta tables today via the **Spark offline store** and `SparkSource` (e.g. `catalog.schema.table`), but there is no first-class integration for:\n\n1. **UC feature table registration** — Feast `feast apply` does not register feature views as UC feature tables (primary keys, Features UI, Catalog Explorer discovery).\n2. **UC-backed materialization** — `feast materialize` writes to the online store but does not persist governed Delta tables back to UC or sync UC lineage.\n3. **Databricks-aware configuration** — Users must hand-wire Spark session / cluster config instead of a dedicated offline store type with UC defaults.\n\nUC tables are Spark-accessible Delta tables, so the **read path** works generically. The gap is the **UC governance/registration layer** on top (feature table metadata, primary keys, discovery, lineage) that Unity Catalog provides natively.\n\n## Motivation / use cases\n\n- Platform teams want **one feature definition** in Feast (entities, TTLs, PIT joins, serving API) while keeping **UC as the governance catalog** for discovery and access control.\n- Data scientists expect feature tables to appear in **Catalog Explorer / Features UI**, not only in the Feast registry.\n- ML engineers need **lineage** from source UC tables → feature tables → models without maintaining parallel metadata.\n- Teams evaluating Feast vs Databricks Feature Store need a clear path when UC registration is a hard requirement.\n\n## Current state\n\n| Capability | Supported today? |\n|------------|------------------|\n| Read UC Delta tables via Spark | ✅ via Spark offline store + `SparkSource` |\n| Point-in-time training joins | ✅ |\n| UC feature table registration on `feast apply` | ❌ |\n| Materialize to UC Delta + online store | ❌ (`offline_write_batch` not supported for Spark offline store) |\n| Databricks-specific offline store config | ❌ |\n| Import existing UC feature tables as Feast views | ❌ |\n\nRelated issues: #2406 (Delta/Iceberg/Hudi table formats), #764 (Databricks Spark runner, closed).\n\n## Proposed solution (phased)\n\n### L1 — Databricks-aware Spark offline store (read path)\n- New contrib type e.g. `databricks_uc` extending Spark offline store\n- `feature_store.yaml` config for workspace host, default catalog/schema, auth\n- `UnityCatalogSource` (or extended `SparkSource`) with UC path validation\n\n### L2 — UC registration on `feast apply`\n- Hook after registry apply: register/update UC feature tables via `FeatureEngineeringClient` (or UC REST APIs)\n- Map `Entity.join_keys` → UC primary key constraints\n- Sync Feast tags, description, owner to UC table properties\n- Opt-out per feature view: `uc_config.register_as_feature_table: false`\n\n### L3 — UC-backed materialization\n- Extend materialization to MERGE/append into `catalog.schema.\u003cfeature_view>` Delta tables\n- Continue writing to configured online store for low-latency serving\n- Emit OpenLineage events with UC FQNs\n\n### L4 (optional) — Bidirectional sync\n- `feast import-uc-table` to scaffold `FeatureView` from existing UC feature tables\n- UC lineage bridge for apply/materialize events\n\n## Example API sketch\n\n```yaml\n# feature_store.yaml\noffline_store:\n  type: databricks_uc\n  workspace_host: https://adb-xxx.azuredatabricks.net\n  catalog: prod_ml\n  schema: features\n  uc_registration:\n    enabled: true\n    on_apply: true\n```\n\n```python\ncustomer_features = FeatureView(\n    name=\"customer_features\",\n    entities=[customer],\n    source=UnityCatalogSource(\n        table=\"prod_raw.bronze.transactions\",\n        timestamp_field=\"event_timestamp\",\n    ),\n    schema=[...],\n    uc_config={\n        \"catalog\": \"prod_ml\",\n        \"schema\": \"features\",\n        \"table\": \"customer_features\",\n        \"register_as_feature_table\": True,\n        \"materialize_offline\": True,\n    },\n)\n```\n\n## Expected behavior\n\n```text\nfeast apply\n  → Feast registry updated (existing)\n  → UC: create/register feature table, set primary key, sync metadata\n\nfeast materialize-incremental \u003cend>\n  → Read from UC sources via Spark\n  → Write Delta to UC feature table (new)\n  → Write to online store (existing)\n```\n\n","author":{"url":"https://github.com/ntkathole","@type":"Person","name":"ntkathole"},"datePublished":"2026-06-11T14:46:06Z","url":"https://github.com/feast-dev/feast/issues/6499"}

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format)
route-controllervoltron_issues_fragments
route-actionissue_layout
fetch-noncev2:633730d4-3747-4742-7671-3da08c210d3d
current-catalog-service-hash81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114
request-idA6B8:354A0:18A467:220B24:6AFE9223
html-safe-noncecdb3bf77a64f953f3f84040438a0ebe95c9d8d577034b428176e66a91223a5c5
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBNkI4OjM1NEEwOjE4QTQ2NzoyMjBCMjQ6NkFGRTkyMjMiLCJ2aXNpdG9yX2lkIjoiMTY0Njc5Mzg1OTA5OTg5OTIzIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac75763c9236e2d9030c859acdbbce9b04b662d8ea9a0536acb2783cee3e7e50d2
hovercard-subject-tagissue:4641566429
github-keyboard-shortcutsrepository,issues,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///voltron/issues_fragments/issue_layout
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/feast-dev/feast/6499/issue_layout
twitter:imagehttps://opengraph.githubassets.com/26fe55c1acb0533c35c16ef22d6289bda4997a1573f12fc7b2662fbf84a2d5f4/feast-dev/feast/issues/6499
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/26fe55c1acb0533c35c16ef22d6289bda4997a1573f12fc7b2662fbf84a2d5f4/feast-dev/feast/issues/6499
og:image:altProblem Teams running Unity Catalog can read UC-governed Delta tables today via the Spark offline store and SparkSource (e.g. catalog.schema.table), but there is no first-class integration for: UC ...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamentkathole
hostnamegithub.com
expected-hostnamegithub.com
Noneb3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86
turbo-cache-controlno-preview
go-importgithub.com/feast-dev/feast git https://github.com/feast-dev/feast.git
octolytics-dimension-user_id57027613
octolytics-dimension-user_loginfeast-dev
octolytics-dimension-repository_id161133770
octolytics-dimension-repository_nwofeast-dev/feast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id161133770
octolytics-dimension-repository_network_root_nwofeast-dev/feast
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release4a10310af51a1bfffbedc4fd81cb582acf0cb0ff
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-nameissues

Links:

Skip to contenthttps://github.com/feast-dev/feast/issues/6499#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fissues%2F6499
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fissues%2F6499
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fvoltron%2Fissues_fragments%2Fissue_layout&source=header-repo&source_repo=feast-dev%2Ffeast
Reloadhttps://github.com/feast-dev/feast/issues/6499
Reloadhttps://github.com/feast-dev/feast/issues/6499
Reloadhttps://github.com/feast-dev/feast/issues/6499
feast-devhttps://github.com/feast-dev
feasthttps://github.com/feast-dev/feast
Codehttps://github.com/feast-dev/feast
Issues223 (223)https://github.com/feast-dev/feast/issues
Pull requests143 (143)https://github.com/feast-dev/feast/pulls
Discussionshttps://github.com/feast-dev/feast/discussions
Actionshttps://github.com/feast-dev/feast/actions
Security and quality1 (1)https://github.com/feast-dev/feast/security
Insightshttps://github.com/feast-dev/feast/insights
https://github.com/feast-dev/feast
New issuehttps://github.com/login?return_to=https://github.com/feast-dev/feast/issues/6499
New issuehttps://github.com/login?return_to=https://github.com/feast-dev/feast/issues/6499
#6565https://github.com/feast-dev/feast/pull/6565
feat: Extend Feast's DataSource to natively support Iceberg REST Catalog-backed tableshttps://github.com/feast-dev/feast/issues/6499#top
#6565https://github.com/feast-dev/feast/pull/6565
kind/featureNew feature or requesthttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22kind%2Ffeature%22
https://github.com/ntkathole
ntkatholehttps://github.com/ntkathole
on Jun 11, 2026https://github.com/feast-dev/feast/issues/6499#issue-4641566429
#2406https://github.com/feast-dev/feast/issues/2406
#764https://github.com/feast-dev/feast/issues/764
ntkatholehttps://github.com/ntkathole
kind/featureNew feature or requesthttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22kind%2Ffeature%22
on Jun 11, 2026https://github.com/feast-dev/feast/issues/6499#event-26631323608
ntkatholehttps://github.com/ntkathole
on Jun 11, 2026https://github.com/feast-dev/feast/issues/6499#event-26631529574
https://github.com/falloficaruss
falloficarusshttps://github.com/falloficaruss
on Jun 28, 2026https://github.com/feast-dev/feast/issues/6499#issuecomment-4825689533
@ntkatholehttps://github.com/ntkathole
https://github.com/ntkathole
ntkatholehttps://github.com/ntkathole
on Jun 29, 2026https://github.com/feast-dev/feast/issues/6499#issuecomment-4833608954
@falloficarusshttps://github.com/falloficaruss
ntkatholehttps://github.com/ntkathole
on Jun 29, 2026https://github.com/feast-dev/feast/issues/6499#event-27334081388
https://github.com/falloficaruss
falloficarusshttps://github.com/falloficaruss
on Jun 29, 2026https://github.com/feast-dev/feast/issues/6499#issuecomment-4834687240
@ntkatholehttps://github.com/ntkathole
https://github.com/ntkathole
ntkatholehttps://github.com/ntkathole
on Jun 29, 2026https://github.com/feast-dev/feast/issues/6499#issuecomment-4834850359
Sign up for freehttps://github.com/signup?return_to=https://github.com/feast-dev/feast/issues/6499
Sign in to commenthttps://github.com/login?return_to=https://github.com/feast-dev/feast/issues/6499
kind/featureNew feature or requesthttps://github.com/feast-dev/feast/issues?q=state%3Aopen%20label%3A%22kind%2Ffeature%22
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.