René's URL Explorer Experiment


Title: feat: Add PolarisSource and PolarisProvider for Apache Polaris by haoxu0 · Pull Request #7006 · feast-dev/feast · GitHub

Open Graph Title: feat: Add PolarisSource and PolarisProvider for Apache Polaris by haoxu0 · Pull Request #7006 · feast-dev/feast

X Title: feat: Add PolarisSource and PolarisProvider for Apache Polaris by haoxu0 · Pull Request #7006 · feast-dev/feast

Description: What this PR does / why we need it: Adds Apache Polaris support on top of the Iceberg REST catalog integration (iceberg_catalog contrib), mirroring the Unity Catalog layering from #6499. PolarisSource(IcebergSource): endpoint defaults to $POLARIS_HOST/api/catalog; OAuth2 client-credentials or bearer-token auth read from env vars (only the variable names are stored in the registry); credential vending for reads/writes; PolarisSource.discover() builds sources for tables in a catalog. PolarisClient: OAuth client-credentials token acquisition with refresh before expiry, and table property updates via the standard Iceberg REST updateTable (set-properties / remove-properties). PolarisProvider (provider: polaris): on feast apply, records feast.project, feast.feature_view, feast.owner, feast.description, feast.tag.* and feast.is_feature_table on the backing Polaris tables. A deleted feature view keeps the table and marks it feast.is_feature_table=false + feast.deleted_at. A failed sync is logged and never fails feast apply. Refactor: the PyIceberg REST catalog config was duplicated in three places (DuckDB read, DuckDB write, Spark). It now lives in IcebergSource.get_pyiceberg_catalog_config() / load_pyiceberg_table() so subclasses can override it. Behavior for existing IcebergSource users is unchanged (covered by a test). Polaris has no lineage API, so there is no sync_lineage equivalent. Not included (follow-up): column projection / predicate pushdown on the read path, which needs changes to how the offline stores call into the source. Multi-level namespaces keep the existing REST client behavior (single-level only). Which issue(s) this PR fixes: Refs #7005 (related: #6499) Checks I've made sure the tests are passing. My commits are signed off (git commit -s) My PR title follows conventional commits format Testing Strategy Unit tests Integration tests Manual tests Testing is not required for this change Unit: 33 new tests in iceberg_catalog/tests/test_polaris.py (HTTP mocked); ruff and mypy clean. In the existing iceberg_catalog tests, 7 fail identically on master and with this change: 2 DuckDB tests that patch get_catalog_client on a REST source, and 5 Spark tests that need pyspark. Manual: ran against a local Apache Polaris (apache/polaris:latest) with MinIO: table discovery, DuckDB read with OAuth + vended credentials, feast apply with provider: polaris (properties verified by reloading the table through PyIceberg), get_historical_features, materialize + online read, feature view deletion, static-token mode, and bad credentials (sync returns False, no exception). Misc Docs are updated in docs/reference/data-sources/iceberg.md.

Open Graph Description: What this PR does / why we need it: Adds Apache Polaris support on top of the Iceberg REST catalog integration (iceberg_catalog contrib), mirroring the Unity Catalog layering from #6499. PolarisSo...

X Description: What this PR does / why we need it: Adds Apache Polaris support on top of the Iceberg REST catalog integration (iceberg_catalog contrib), mirroring the Unity Catalog layering from #6499. PolarisSo...

Opengraph URL: https://github.com/feast-dev/feast/pull/7006

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:e4bbf546-c149-6262-b40b-1541d4ad1a50
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idBDB0:F4E6A:CEBA4D:111474D:6AFE925B
html-safe-nonce03f4070dd6f7c9b95fddcd541abb84a761565caaf09df1ebce4831c58c874d29
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCREIwOkY0RTZBOkNFQkE0RDoxMTE0NzREOjZBRkU5MjVCIiwidmlzaXRvcl9pZCI6IjYyNDM5ODQ5MzA4NjMyMjMzODciLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmacbcc0da1b07cd772ab40ba324fcb1d944989a5402aa43f1450cce985338bec7e7
hovercard-subject-tagpull_request:4847917708
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/feast-dev/feast/pull/7006/files
twitter:imagehttps://avatars.githubusercontent.com/u/20422210?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/20422210?s=400&v=4
og:image:altWhat this PR does / why we need it: Adds Apache Polaris support on top of the Iceberg REST catalog integration (iceberg_catalog contrib), mirroring the Unity Catalog layering from #6499. PolarisSo...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneb3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/feast-dev/feast git https://github.com/feast-dev/feast.git
octolytics-dimension-user_id57027613
octolytics-dimension-user_loginfeast-dev
octolytics-dimension-repository_id161133770
octolytics-dimension-repository_nwofeast-dev/feast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id161133770
octolytics-dimension-repository_network_root_nwofeast-dev/feast
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release4a10310af51a1bfffbedc4fd81cb582acf0cb0ff
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/feast-dev/feast/pull/7006/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F7006%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F7006%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=feast-dev%2Ffeast
Reloadhttps://github.com/feast-dev/feast/pull/7006/files
Reloadhttps://github.com/feast-dev/feast/pull/7006/files
Reloadhttps://github.com/feast-dev/feast/pull/7006/files
feast-devhttps://github.com/feast-dev
feasthttps://github.com/feast-dev/feast
Codehttps://github.com/feast-dev/feast
Issues223 (223)https://github.com/feast-dev/feast/issues
Pull requests143 (143)https://github.com/feast-dev/feast/pulls
Discussionshttps://github.com/feast-dev/feast/discussions
Actionshttps://github.com/feast-dev/feast/actions
Security and quality1 (1)https://github.com/feast-dev/feast/security
Insightshttps://github.com/feast-dev/feast/insights
Sign up for GitHub https://github.com/signup?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
haoxu0https://github.com/haoxu0
feast-dev:masterhttps://github.com/feast-dev/feast/tree/master
haoxu0:feat/polaris-sourcehttps://github.com/haoxu0/feast/tree/feat/polaris-source
Conversation 4 https://github.com/feast-dev/feast/pull/7006
Commits 3 https://github.com/feast-dev/feast/pull/7006/commits
Checks 23 https://github.com/feast-dev/feast/pull/7006/checks
Files changed https://github.com/feast-dev/feast/pull/7006/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/7006/files
feat: Add PolarisSource and PolarisProvider for Apache Polaris https://github.com/feast-dev/feast/pull/7006/files#top
Show all changes 3 commits https://github.com/feast-dev/feast/pull/7006/files
de3da24 feat: Add PolarisSource and PolarisProvider for Apache Polaris haoxu0 Oct 13, 2026 https://github.com/feast-dev/feast/pull/7006/commits/de3da247beca3d5c0b6b12b9d3600fae89be7a2e
e5162c6 Merge branch 'master' into feat/polaris-source haoxu0 Oct 13, 2026 https://github.com/feast-dev/feast/pull/7006/commits/e5162c618c4c870751bd4be4743d8562a1094078
5ea289d fix: Address CI secret-scan and CodeQL findings in Polaris source haoxu0 Oct 14, 2026 https://github.com/feast-dev/feast/pull/7006/commits/5ea289dbb693cc0dc54f2819e5d057b0f00c341f
Clear filters https://github.com/feast-dev/feast/pull/7006/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/7006/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/7006/files
iceberg.md https://github.com/feast-dev/feast/pull/7006/files#diff-93361c86740f2d2f1182424c000fd25e8c712be375de90ddb10d2080036ad4f9
__init__.py https://github.com/feast-dev/feast/pull/7006/files#diff-36d307586ff46e06e634fb8afc3e67db047d3b68c7ff9238387c9bf9efc3f768
iceberg_source.py https://github.com/feast-dev/feast/pull/7006/files#diff-4825611eea20eb87302ec932ee9981836fdfb01a644f17898faa5a6ec4cd42f0
polaris_client.py https://github.com/feast-dev/feast/pull/7006/files#diff-e988a9d0ee068742b7b2026526c662e8483837ca7cf29d8c5cb86ba16f3ea5a6
polaris_provider.py https://github.com/feast-dev/feast/pull/7006/files#diff-2313ca35c9c0080160bc9f1f395eef471ee9a0796f082a4d6615a56156258873
polaris_source.py https://github.com/feast-dev/feast/pull/7006/files#diff-fadfc6d8efd0e88db02f0d26343b72f01172c9fe91cc639fef732a022dd9a09d
test_polaris.py https://github.com/feast-dev/feast/pull/7006/files#diff-38c7052ea0228880109fa9ebbc310c4115316c815b6c7e6cdaf6bde9c4166d9c
spark.py https://github.com/feast-dev/feast/pull/7006/files#diff-ef3fce408c702d00aa891015376e83ff1084907c69c95cafacf5fae657fca486
duckdb.py https://github.com/feast-dev/feast/pull/7006/files#diff-ea2fa10bfef868a728514ef5f0890661d652c372ca286830d16361d99e93477d
provider.py https://github.com/feast-dev/feast/pull/7006/files#diff-465c56d60ad11aa485727982ae4b7adf6e1eca816f610442078f871ddd9357a5
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L4
docs/reference/data-sources/iceberg.mdhttps://github.com/feast-dev/feast/pull/7006/files#diff-93361c86740f2d2f1182424c000fd25e8c712be375de90ddb10d2080036ad4f9
View file https://github.com/haoxu0/feast/blob/5ea289dbb693cc0dc54f2819e5d057b0f00c341f/docs/reference/data-sources/iceberg.md
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/7006/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/7006/files#diff-93361c86740f2d2f1182424c000fd25e8c712be375de90ddb10d2080036ad4f9
https://github.com/feast-dev/feast/pull/7006/files#diff-93361c86740f2d2f1182424c000fd25e8c712be375de90ddb10d2080036ad4f9
https://github.com/feast-dev/feast/pull/7006/files#diff-93361c86740f2d2f1182424c000fd25e8c712be375de90ddb10d2080036ad4f9
https://github.com/feast-dev/feast/pull/7006/files#diff-93361c86740f2d2f1182424c000fd25e8c712be375de90ddb10d2080036ad4f9
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L10
sdk/python/feast/infra/data_sources/contrib/iceberg_catalog/__init__.pyhttps://github.com/feast-dev/feast/pull/7006/files#diff-36d307586ff46e06e634fb8afc3e67db047d3b68c7ff9238387c9bf9efc3f768
View file https://github.com/haoxu0/feast/blob/5ea289dbb693cc0dc54f2819e5d057b0f00c341f/sdk/python/feast/infra/data_sources/contrib/iceberg_catalog/__init__.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/7006/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/7006/files#diff-36d307586ff46e06e634fb8afc3e67db047d3b68c7ff9238387c9bf9efc3f768
https://github.com/feast-dev/feast/pull/7006/files#diff-36d307586ff46e06e634fb8afc3e67db047d3b68c7ff9238387c9bf9efc3f768
https://github.com/feast-dev/feast/pull/7006/files#diff-36d307586ff46e06e634fb8afc3e67db047d3b68c7ff9238387c9bf9efc3f768
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L10
sdk/python/feast/infra/data_sources/contrib/iceberg_catalog/iceberg_source.pyhttps://github.com/feast-dev/feast/pull/7006/files#diff-4825611eea20eb87302ec932ee9981836fdfb01a644f17898faa5a6ec4cd42f0
View file https://github.com/haoxu0/feast/blob/5ea289dbb693cc0dc54f2819e5d057b0f00c341f/sdk/python/feast/infra/data_sources/contrib/iceberg_catalog/iceberg_source.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/7006/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/7006/files#diff-4825611eea20eb87302ec932ee9981836fdfb01a644f17898faa5a6ec4cd42f0
https://github.com/feast-dev/feast/pull/7006/files#diff-4825611eea20eb87302ec932ee9981836fdfb01a644f17898faa5a6ec4cd42f0
https://github.com/feast-dev/feast/pull/7006/files#diff-4825611eea20eb87302ec932ee9981836fdfb01a644f17898faa5a6ec4cd42f0
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L10
sdk/python/feast/infra/data_sources/contrib/iceberg_catalog/polaris_client.pyhttps://github.com/feast-dev/feast/pull/7006/files#diff-e988a9d0ee068742b7b2026526c662e8483837ca7cf29d8c5cb86ba16f3ea5a6
View file https://github.com/haoxu0/feast/blob/5ea289dbb693cc0dc54f2819e5d057b0f00c341f/sdk/python/feast/infra/data_sources/contrib/iceberg_catalog/polaris_client.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/7006/{{ revealButtonHref }}
Please reload this pagehttps://github.com/feast-dev/feast/pull/7006/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/7006/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.