René's URL Explorer Experiment


Title: feat: Stream Trino offline results via to_arrow_reader by dbbvitor · Pull Request #6897 · feast-dev/feast · GitHub

Open Graph Title: feat: Stream Trino offline results via to_arrow_reader by dbbvitor · Pull Request #6897 · feast-dev/feast

X Title: feat: Stream Trino offline results via to_arrow_reader by dbbvitor · Pull Request #6897 · feast-dev/feast

Description: The Open Source Feature Store for AI/ML. Contribute to feast-dev/feast development by creating an account on GitHub.

Open Graph Description: What this PR does / why we need it: Adds a default RetrievalJob.to_arrow_reader() (wraps to_arrow(), so every existing offline store keeps working unchanged), a Trino-specific override that pages r...

X Description: What this PR does / why we need it: Adds a default RetrievalJob.to_arrow_reader() (wraps to_arrow(), so every existing offline store keeps working unchanged), a Trino-specific override that pages r...

Opengraph URL: https://github.com/feast-dev/feast/pull/6897

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/commits(.:format)
route-controllerpull_requests
route-actioncommits
fetch-noncev2:1b14441b-fc46-2d21-9197-7f781cb48776
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-id8D80:119A4:F42B5D:141C0D5:6AFE9895
html-safe-nonceb4896279180ad5a0e6c1af877765fa46ddb89cc363f572b7020e6ceb6afcd0f0
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4RDgwOjExOUE0OkY0MkI1RDoxNDFDMEQ1OjZBRkU5ODk1IiwidmlzaXRvcl9pZCI6IjY3ODQ4MTk2NjgxODA3MDMzODEiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac614106db7f5b72909cefb537030924695a8bb14e0ab655aa3b6b53bffc0d97e4
hovercard-subject-tagpull_request:4682481824
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/commits
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/feast-dev/feast/pull/6897/commits
twitter:imagehttps://opengraph.githubassets.com/5332328919267638873fce184938092e5f62a02988e7b2f7c6b881f404b6b51a/feast-dev/feast/pull/6897
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/5332328919267638873fce184938092e5f62a02988e7b2f7c6b881f404b6b51a/feast-dev/feast/pull/6897
og:image:altWhat this PR does / why we need it: Adds a default RetrievalJob.to_arrow_reader() (wraps to_arrow(), so every existing offline store keeps working unchanged), a Trino-specific override that pages r...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamedbbvitor
hostnamegithub.com
expected-hostnamegithub.com
Noneb3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86
turbo-cache-controlno-cache
go-importgithub.com/feast-dev/feast git https://github.com/feast-dev/feast.git
octolytics-dimension-user_id57027613
octolytics-dimension-user_loginfeast-dev
octolytics-dimension-repository_id161133770
octolytics-dimension-repository_nwofeast-dev/feast
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id161133770
octolytics-dimension-repository_network_root_nwofeast-dev/feast
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release4a10310af51a1bfffbedc4fd81cb582acf0cb0ff
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/feast-dev/feast/pull/6897/commits#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F6897%2Fcommits
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ffeast-dev%2Ffeast%2Fpull%2F6897%2Fcommits
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Fcommits&source=header-repo&source_repo=feast-dev%2Ffeast
Reloadhttps://github.com/feast-dev/feast/pull/6897/commits
Reloadhttps://github.com/feast-dev/feast/pull/6897/commits
Reloadhttps://github.com/feast-dev/feast/pull/6897/commits
feast-devhttps://github.com/feast-dev
feasthttps://github.com/feast-dev/feast
Codehttps://github.com/feast-dev/feast
Issues223 (223)https://github.com/feast-dev/feast/issues
Pull requests143 (143)https://github.com/feast-dev/feast/pulls
Discussionshttps://github.com/feast-dev/feast/discussions
Actionshttps://github.com/feast-dev/feast/actions
Security and quality1 (1)https://github.com/feast-dev/feast/security
Insightshttps://github.com/feast-dev/feast/insights
https://github.com/feast-dev/feast
dbbvitorhttps://github.com/dbbvitor
feast-dev:masterhttps://github.com/feast-dev/feast/tree/master
dbbvitor:feat/trino-streaming-arrow-readerhttps://github.com/dbbvitor/feast/tree/feat/trino-streaming-arrow-reader
Conversationhttps://github.com/feast-dev/feast/pull/6897
Commits19 (19)https://github.com/feast-dev/feast/pull/6897/commits
Checkshttps://github.com/feast-dev/feast/pull/6897/checks
Files changedhttps://github.com/feast-dev/feast/pull/6897/files
feat: Stream Trino offline results via to_arrow_readerhttps://github.com/feast-dev/feast/pull/6897/commits#top
dbbvitorhttps://github.com/dbbvitor
feast-dev:masterhttps://github.com/feast-dev/feast/tree/master
dbbvitor:feat/trino-streaming-arrow-readerhttps://github.com/dbbvitor/feast/tree/feat/trino-streaming-arrow-reader
fix: Bound Arrow Flight batch size in the offline serverhttps://github.com/feast-dev/feast/pull/6897/commits/7ffed6530db006e9bb76b342d2ce79bb4a4a7137
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
7ffed65https://github.com/feast-dev/feast/pull/6897/commits/7ffed6530db006e9bb76b342d2ce79bb4a4a7137
https://github.com/feast-dev/feast/tree/7ffed6530db006e9bb76b342d2ce79bb4a4a7137
test: Kill the FloorDiv/TrueDiv equivalent mutant in _split_oversizedhttps://github.com/feast-dev/feast/pull/6897/commits/a7ee4903150c3b45e98d18dd63348eddb36e2c7f
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
a7ee490https://github.com/feast-dev/feast/pull/6897/commits/a7ee4903150c3b45e98d18dd63348eddb36e2c7f
https://github.com/feast-dev/feast/tree/a7ee4903150c3b45e98d18dd63348eddb36e2c7f
feat: Add RetrievalJob.to_arrow_reader and shared offline metrics helperhttps://github.com/feast-dev/feast/pull/6897/commits/e7cadc345a546cc61ac5cc690d659efb890bfe82
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
e7cadc3https://github.com/feast-dev/feast/pull/6897/commits/e7cadc345a546cc61ac5cc690d659efb890bfe82
https://github.com/feast-dev/feast/tree/e7cadc345a546cc61ac5cc690d659efb890bfe82
feat: Stream Trino offline results page by page via to_arrow_readerhttps://github.com/feast-dev/feast/pull/6897/commits/1ef37089ef7a2e3c1a8f7908de31be047a5e372c
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
1ef3708https://github.com/feast-dev/feast/pull/6897/commits/1ef37089ef7a2e3c1a8f7908de31be047a5e372c
https://github.com/feast-dev/feast/tree/1ef37089ef7a2e3c1a8f7908de31be047a5e372c
feat: Stream offline server reads through RetrievalJob.to_arrow_readerhttps://github.com/feast-dev/feast/pull/6897/commits/e56710105f3f4e780a06e36c5a269aae8fa744a2
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
e567101https://github.com/feast-dev/feast/pull/6897/commits/e56710105f3f4e780a06e36c5a269aae8fa744a2
https://github.com/feast-dev/feast/tree/e56710105f3f4e780a06e36c5a269aae8fa744a2
test: Kill cosmic-ray survivors in the metrics helper and Trino readerhttps://github.com/feast-dev/feast/pull/6897/commits/5404d244b9db3ceebb9e793eb74245d42570f617
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
5404d24https://github.com/feast-dev/feast/pull/6897/commits/5404d244b9db3ceebb9e793eb74245d42570f617
https://github.com/feast-dev/feast/tree/5404d244b9db3ceebb9e793eb74245d42570f617
docs: Mark Trino as supporting arrow-batch export in the overview matrixhttps://github.com/feast-dev/feast/pull/6897/commits/0f24febc5212f12b89551b4490cbf3535a02c794
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
0f24febhttps://github.com/feast-dev/feast/pull/6897/commits/0f24febc5212f12b89551b4490cbf3535a02c794
https://github.com/feast-dev/feast/tree/0f24febc5212f12b89551b4490cbf3535a02c794
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/73d1d4ffeefe45b287eb6f73ad95f08ed3697010
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
73d1d4fhttps://github.com/feast-dev/feast/pull/6897/commits/73d1d4ffeefe45b287eb6f73ad95f08ed3697010
https://github.com/feast-dev/feast/tree/73d1d4ffeefe45b287eb6f73ad95f08ed3697010
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/8f6baf7fd413cd1450912f6a19dcd5241dcb09a4
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
8f6baf7https://github.com/feast-dev/feast/pull/6897/commits/8f6baf7fd413cd1450912f6a19dcd5241dcb09a4
https://github.com/feast-dev/feast/tree/8f6baf7fd413cd1450912f6a19dcd5241dcb09a4
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/8fb4126e1ae0add1f2995b294d957886f904e8bb
https://github.com/haoxu0
haoxu0https://github.com/feast-dev/feast/commits?author=haoxu0
8fb4126https://github.com/feast-dev/feast/pull/6897/commits/8fb4126e1ae0add1f2995b294d957886f904e8bb
https://github.com/feast-dev/feast/tree/8fb4126e1ae0add1f2995b294d957886f904e8bb
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/a0b22b47ded0dfdd505bbeb80e7046776426a8f8
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
a0b22b4https://github.com/feast-dev/feast/pull/6897/commits/a0b22b47ded0dfdd505bbeb80e7046776426a8f8
https://github.com/feast-dev/feast/tree/a0b22b47ded0dfdd505bbeb80e7046776426a8f8
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/f299854906b2e088b00e5384fe484f9cfdc7c1b8
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
f299854https://github.com/feast-dev/feast/pull/6897/commits/f299854906b2e088b00e5384fe484f9cfdc7c1b8
https://github.com/feast-dev/feast/tree/f299854906b2e088b00e5384fe484f9cfdc7c1b8
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/2cdd603c4d1f91409074634f32802897c7fe7824
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
2cdd603https://github.com/feast-dev/feast/pull/6897/commits/2cdd603c4d1f91409074634f32802897c7fe7824
https://github.com/feast-dev/feast/tree/2cdd603c4d1f91409074634f32802897c7fe7824
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/c322eb181653ffcede3fd6d508b4a70c0ba4ddd9
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
c322eb1https://github.com/feast-dev/feast/pull/6897/commits/c322eb181653ffcede3fd6d508b4a70c0ba4ddd9
https://github.com/feast-dev/feast/tree/c322eb181653ffcede3fd6d508b4a70c0ba4ddd9
Merge remote-tracking branch 'upstream/master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/b987526e2d07c422b3b5c0d8822c3e02d605bf0e
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
b987526https://github.com/feast-dev/feast/pull/6897/commits/b987526e2d07c422b3b5c0d8822c3e02d605bf0e
https://github.com/feast-dev/feast/tree/b987526e2d07c422b3b5c0d8822c3e02d605bf0e
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/018a33b65062506065a45d16dc25dc094f82a8e3
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
018a33bhttps://github.com/feast-dev/feast/pull/6897/commits/018a33b65062506065a45d16dc25dc094f82a8e3
https://github.com/feast-dev/feast/tree/018a33b65062506065a45d16dc25dc094f82a8e3
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/0bac2571067d37013ec2cc822b21ec400008a418
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
0bac257https://github.com/feast-dev/feast/pull/6897/commits/0bac2571067d37013ec2cc822b21ec400008a418
https://github.com/feast-dev/feast/tree/0bac2571067d37013ec2cc822b21ec400008a418
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/820dba9c25f789302898c04ff847a109c0db1bf3
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
820dba9https://github.com/feast-dev/feast/pull/6897/commits/820dba9c25f789302898c04ff847a109c0db1bf3
https://github.com/feast-dev/feast/tree/820dba9c25f789302898c04ff847a109c0db1bf3
Merge branch 'master' into feat/trino-streaming-arrow-readerhttps://github.com/feast-dev/feast/pull/6897/commits/2766ab8454533b96e523567f1f9635aaae84c338
https://github.com/dbbvitor
dbbvitorhttps://github.com/feast-dev/feast/commits?author=dbbvitor
2766ab8https://github.com/feast-dev/feast/pull/6897/commits/2766ab8454533b96e523567f1f9635aaae84c338
https://github.com/feast-dev/feast/tree/2766ab8454533b96e523567f1f9635aaae84c338
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.