René's URL Explorer Experiment


Title: feat: Add Trino compute engine for batch retrieval and materialization by Marcus-Rosti · Pull Request #6898 · feast-dev/feast · GitHub

Open Graph Title: feat: Add Trino compute engine for batch retrieval and materialization by Marcus-Rosti · Pull Request #6898 · feast-dev/feast

X Title: feat: Add Trino compute engine for batch retrieval and materialization by Marcus-Rosti · Pull Request #6898 · feast-dev/feast

Description: What this PR does / why we need it: Adds Trino as a native Feast compute engine (type: trino.engine or type: trino), enabling DAG-based historical feature retrieval and materialization directly via Trino SQL without requiring Spark or Ray: Historical Retrieval: Compiles DAG operations into an ANSI Trino query with point-in-time joins, windowed aggregations, and deduplication. Materialization: Supports streaming Arrow batches into online stores and atomic staging/rename-swap into offline tables. Transformations: Introduces TrinoTransformation supporting SQL templates ({}) and callable UDFs. Docs & Coverage: Includes reference documentation and unit test suite (>93% coverage). Which issue(s) this PR fixes: Checks I've made sure the tests are passing. My commits are signed off (git commit -s) My PR title follows conventional commits format Testing Strategy Unit tests Integration tests Manual tests Testing is not required for this change

Open Graph Description: What this PR does / why we need it: Adds Trino as a native Feast compute engine (type: trino.engine or type: trino), enabling DAG-based historical feature retrieval and materialization directly via...

X Description: What this PR does / why we need it: Adds Trino as a native Feast compute engine (type: trino.engine or type: trino), enabling DAG-based historical feature retrieval and materialization directly via...

Opengraph URL: https://github.com/feast-dev/feast/pull/6898

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:9f2b7581-bcf4-7e14-ca04-dcc3a2259ec2
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idA9B0:342711:2CEFA5:3BF891:6AFE987F
html-safe-nonced2ff2adac134887b6e802b6a1fe416363e5d8858476c4775404e53cab54e54fb
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBOUIwOjM0MjcxMToyQ0VGQTU6M0JGODkxOjZBRkU5ODdGIiwidmlzaXRvcl9pZCI6IjEzODcwMjExMDgzNDcwNTAxMTEiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac5e5a76f9dd05c94f034a163e85dfdc60520fe886980f0392c20d9201db229307
hovercard-subject-tagpull_request:4682820519
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/feast-dev/feast/pull/6898/files
twitter:imagehttps://avatars.githubusercontent.com/u/8094255?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/8094255?s=400&v=4
og:image:altWhat this PR does / why we need it: Adds Trino as a native Feast compute engine (type: trino.engine or type: trino), enabling DAG-based historical feature retrieval and materialization directly via...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneb3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/feast-dev/feast git https://github.com/feast-dev/feast.git
octolytics-dimension-user_id57027613
octolytics-dimension-user_loginfeast-dev
octolytics-dimension-repository_id161133770
octolytics-dimension-repository_nwofeast-dev/feast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id161133770
octolytics-dimension-repository_network_root_nwofeast-dev/feast
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release4a10310af51a1bfffbedc4fd81cb582acf0cb0ff
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/feast-dev/feast/pull/6898/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F6898%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F6898%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=feast-dev%2Ffeast
Reloadhttps://github.com/feast-dev/feast/pull/6898/files
Reloadhttps://github.com/feast-dev/feast/pull/6898/files
Reloadhttps://github.com/feast-dev/feast/pull/6898/files
feast-devhttps://github.com/feast-dev
feasthttps://github.com/feast-dev/feast
Codehttps://github.com/feast-dev/feast
Issues223 (223)https://github.com/feast-dev/feast/issues
Pull requests143 (143)https://github.com/feast-dev/feast/pulls
Discussionshttps://github.com/feast-dev/feast/discussions
Actionshttps://github.com/feast-dev/feast/actions
Security and quality1 (1)https://github.com/feast-dev/feast/security
Insightshttps://github.com/feast-dev/feast/insights
Sign up for GitHub https://github.com/signup?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Ffeast-dev%2Ffeast%2Fissues%2Fnew%2Fchoose
ntkatholehttps://github.com/ntkathole
feast-dev:masterhttps://github.com/feast-dev/feast/tree/master
Marcus-Rosti:mrosti/trino-computehttps://github.com/Marcus-Rosti/feast/tree/mrosti/trino-compute
Conversation 15 https://github.com/feast-dev/feast/pull/6898
Commits 10 https://github.com/feast-dev/feast/pull/6898/commits
Checks 23 https://github.com/feast-dev/feast/pull/6898/checks
Files changed https://github.com/feast-dev/feast/pull/6898/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/6898/files
feat: Add Trino compute engine for batch retrieval and materialization https://github.com/feast-dev/feast/pull/6898/files#top
Show all changes 10 commits https://github.com/feast-dev/feast/pull/6898/files
7e6b80e feat: Adds Trino as a compute engine Marcus-Rosti Sep 29, 2026 https://github.com/feast-dev/feast/pull/6898/commits/7e6b80e5439b6ef78ad5320b3f810b3eba995319
45ae953 fix: Join entity_df during backfill Marcus-Rosti Oct 2, 2026 https://github.com/feast-dev/feast/pull/6898/commits/45ae95376aa49bdb2267efbbfbcbe40e7cb2d326
297224e fix: Exclude internal _feast_rn column from Trino dedup output Marcus-Rosti Oct 2, 2026 https://github.com/feast-dev/feast/pull/6898/commits/297224e880b878010b313750ddb35417e63fb169
2c3e632 fix: Adds a trino write type (append/merge/overwrite) Marcus-Rosti Oct 3, 2026 https://github.com/feast-dev/feast/pull/6898/commits/2c3e632997847e8b182653efaebb0d4fdaafc983
1d799d5 fix: Throw an error when semicolons are present in filters Marcus-Rosti Oct 6, 2026 https://github.com/feast-dev/feast/pull/6898/commits/1d799d5d5955b6b0c00db3a543f6eae2ed0561c1
efcc389 fix: Throw error when client is not configured Marcus-Rosti Oct 6, 2026 https://github.com/feast-dev/feast/pull/6898/commits/efcc38977314109eef5bd8186ef0e092f1dd80b6
6c3e2ef fix: Implements a trino integration test Marcus-Rosti Oct 6, 2026 https://github.com/feast-dev/feast/pull/6898/commits/6c3e2efac706231db1b3509198403cab2a8aeed6
ac3364c fix: More efficient streaming for pyarrow Marcus-Rosti Oct 6, 2026 https://github.com/feast-dev/feast/pull/6898/commits/ac3364c64e3e1b4192592ec3760babf99d938294
42b6a7d fix: Qualified select statements Marcus-Rosti Oct 6, 2026 https://github.com/feast-dev/feast/pull/6898/commits/42b6a7d0de266a5712191659487a968ca31cce2d
ecb671a fix: Validate Trino client configuration in historical retrieval Marcus-Rosti Oct 6, 2026 https://github.com/feast-dev/feast/pull/6898/commits/ecb671ac005c0002a227a984d97fcc43b4366984
Clear filters https://github.com/feast-dev/feast/pull/6898/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/6898/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/6898/files
compute-engine.md https://github.com/feast-dev/feast/pull/6898/files#diff-3a2432cc9f8bed7a94a0fad37ede430a0b9a1b9ed6c05f71c1ceb850da6d1c95
trino.md https://github.com/feast-dev/feast/pull/6898/files#diff-b6feeec8a4b24c019e343385f1d80fe36f35f17ab208e15b0757fd27f3d52165
model.py https://github.com/feast-dev/feast/pull/6898/files#diff-702e08391378ad77548e5d3795efc4d213b1b1abfbe61287b944728ebb2ecdf1
__init__.py https://github.com/feast-dev/feast/pull/6898/files#diff-7edd808146013669a992b7380effc4362e7d7491abd1ad27fed6d0ce53faddf0
compute.py https://github.com/feast-dev/feast/pull/6898/files#diff-72dbd4100b72b967e7059a93ea6a877857f838fa6ff149eac18bbd3603118edf
feature_builder.py https://github.com/feast-dev/feast/pull/6898/files#diff-3bf7e5ebf62fe2e6d41588b3aefd86905a65e3a3f96ae1b14b8513730eb0bd21
job.py https://github.com/feast-dev/feast/pull/6898/files#diff-a946740b2331f24b89a75241ce9c7980e90a6e84064e2371f1c24c3005d34167
nodes.py https://github.com/feast-dev/feast/pull/6898/files#diff-ae3fa3148a7422ab61c5eb6a704014b0bc676f063fcd16e610169095580075ee
sql_builder.py https://github.com/feast-dev/feast/pull/6898/files#diff-715f5d61761ad2adfaba4fe83080c8112c6022ef12a2b6a8c8093f4ec8208fe9
utils.py https://github.com/feast-dev/feast/pull/6898/files#diff-b1559dc9f7fd89d6b2055dab420e132d80b5e9e152e708a08b4b1ea309f5ad57
trino_queries.py https://github.com/feast-dev/feast/pull/6898/files#diff-43501c8c77d529114e44cab644a3ae663ddbca25c19f6b8e4c0ce497dd13ca79
repo_config.py https://github.com/feast-dev/feast/pull/6898/files#diff-c90c6781dcec3cdcc26843e013d3d6e9c1ce89d084b3a67e818fe76a0c7d0436
mode.py https://github.com/feast-dev/feast/pull/6898/files#diff-7190e9b257c57a9dae5574f463ca598dc7d1ea797e6ebbe6d49d82e2a3cd3864
trino_transformation.py https://github.com/feast-dev/feast/pull/6898/files#diff-86a623ef1d448b05a5c3659910b7710f50175b6e517c9b62a94d9a0f85ad47ac
test_compute.py https://github.com/feast-dev/feast/pull/6898/files#diff-4cd20c66c76ec28f7f5a57be582b8d0f8c3c7ba879b3f4f7ee2336dfcc610b0e
test_trino_compute_engine.py https://github.com/feast-dev/feast/pull/6898/files#diff-457537948cc82ae75e8a27be3870346813dcea6deff5ee07d03f5bfd5e64b222
test_trino_compute_engine.py https://github.com/feast-dev/feast/pull/6898/files#diff-b26a4f1614573c06f8ac79453d759d27c815f76b7d343bf644a735e19bec9fa0
test_mode.py https://github.com/feast-dev/feast/pull/6898/files#diff-296165b4155190a9461aa37e732452433cab22f6186f48383b339b45b34d25c8
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L4
docs/getting-started/components/compute-engine.mdhttps://github.com/feast-dev/feast/pull/6898/files#diff-3a2432cc9f8bed7a94a0fad37ede430a0b9a1b9ed6c05f71c1ceb850da6d1c95
View file https://github.com/Marcus-Rosti/feast/blob/ecb671ac005c0002a227a984d97fcc43b4366984/docs/getting-started/components/compute-engine.md
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/6898/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/6898/files#diff-3a2432cc9f8bed7a94a0fad37ede430a0b9a1b9ed6c05f71c1ceb850da6d1c95
https://github.com/feast-dev/feast/pull/6898/files#diff-3a2432cc9f8bed7a94a0fad37ede430a0b9a1b9ed6c05f71c1ceb850da6d1c95
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L4
docs/reference/compute-engine/trino.mdhttps://github.com/feast-dev/feast/pull/6898/files#diff-b6feeec8a4b24c019e343385f1d80fe36f35f17ab208e15b0757fd27f3d52165
View file https://github.com/Marcus-Rosti/feast/blob/ecb671ac005c0002a227a984d97fcc43b4366984/docs/reference/compute-engine/trino.md
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/6898/{{ revealButtonHref }}
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L10
sdk/python/feast/infra/compute_engines/dag/model.pyhttps://github.com/feast-dev/feast/pull/6898/files#diff-702e08391378ad77548e5d3795efc4d213b1b1abfbe61287b944728ebb2ecdf1
View file https://github.com/Marcus-Rosti/feast/blob/ecb671ac005c0002a227a984d97fcc43b4366984/sdk/python/feast/infra/compute_engines/dag/model.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/6898/{{ revealButtonHref }}
https://github.com/feast-dev/feast/pull/6898/files#diff-702e08391378ad77548e5d3795efc4d213b1b1abfbe61287b944728ebb2ecdf1
https://github.com/feast-dev/feast/blob/master/CODEOWNERS#L10
sdk/python/feast/infra/compute_engines/trino/__init__.pyhttps://github.com/feast-dev/feast/pull/6898/files#diff-7edd808146013669a992b7380effc4362e7d7491abd1ad27fed6d0ce53faddf0
View file https://github.com/Marcus-Rosti/feast/blob/ecb671ac005c0002a227a984d97fcc43b4366984/sdk/python/feast/infra/compute_engines/trino/__init__.py
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/feast-dev/feast/pull/6898/{{ revealButtonHref }}
Please reload this pagehttps://github.com/feast-dev/feast/pull/6898/files
Please reload this pagehttps://github.com/feast-dev/feast/pull/6898/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.