Title: Lack of Spark Support for On-Demand Feature Views · Issue #5475 · feast-dev/feast · GitHub
Open Graph Title: Lack of Spark Support for On-Demand Feature Views · Issue #5475 · feast-dev/feast
X Title: Lack of Spark Support for On-Demand Feature Views · Issue #5475 · feast-dev/feast
Description: Currently, stream feature views support both spark and spark_sql execution modes, which enables them to scale efficiently with large datasets. However, on-demand feature views are limited to pandas or python modes only. This limitation b...
Open Graph Description: Currently, stream feature views support both spark and spark_sql execution modes, which enables them to scale efficiently with large datasets. However, on-demand feature views are limited to pandas...
X Description: Currently, stream feature views support both spark and spark_sql execution modes, which enables them to scale efficiently with large datasets. However, on-demand feature views are limited to pandas...
Opengraph URL: https://github.com/feast-dev/feast/issues/5475
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Lack of Spark Support for On-Demand Feature Views","articleBody":"Currently, stream feature views support both spark and spark_sql execution modes, which enables them to scale efficiently with large datasets. However, on-demand feature views are limited to pandas or python modes only.\n\nThis limitation becomes a bottleneck when trying to perform transformations on features that haven't been precomputed, especially in cases where those transformations need to scale to large data volumes. Without Spark support, users are forced to rely on local computation, which significantly hinders scalability and performance.","author":{"url":"https://github.com/FabioTomaz","@type":"Person","name":"FabioTomaz"},"datePublished":"2025-06-29T23:49:31Z","url":"https://github.com/feast-dev/feast/issues/5475"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:2137af44-8bae-145a-9cb8-e6be82248fac |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | A32E:BF02A:18BB7E:22388D:6AFE922B |
| html-safe-nonce | b469429c487cee964feea6c8856944f47a9dee1200d829d224fc6a0bd657cf62 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBMzJFOkJGMDJBOjE4QkI3RToyMjM4OEQ6NkFGRTkyMkIiLCJ2aXNpdG9yX2lkIjoiNzY0NTAyOTI0NzM3MDU2NDEzOSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | a3c878f0cc71e38ca3c9818ba7c8538fbe49b30551d2f6bd42a9a1d75f6bdd5a |
| hovercard-subject-tag | issue:3186700622 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/feast-dev/feast/5475/issue_layout |
| twitter:image | https://opengraph.githubassets.com/aaff39f0fc881587aa6288fed54bb9f3a1928561fd54e851e1e2c925edfd9c47/feast-dev/feast/issues/5475 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/aaff39f0fc881587aa6288fed54bb9f3a1928561fd54e851e1e2c925edfd9c47/feast-dev/feast/issues/5475 |
| og:image:alt | Currently, stream feature views support both spark and spark_sql execution modes, which enables them to scale efficiently with large datasets. However, on-demand feature views are limited to pandas... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | FabioTomaz |
| hostname | github.com |
| expected-hostname | github.com |
| None | b3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86 |
| turbo-cache-control | no-preview |
| go-import | github.com/feast-dev/feast git https://github.com/feast-dev/feast.git |
| octolytics-dimension-user_id | 57027613 |
| octolytics-dimension-user_login | feast-dev |
| octolytics-dimension-repository_id | 161133770 |
| octolytics-dimension-repository_nwo | feast-dev/feast |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 161133770 |
| octolytics-dimension-repository_network_root_nwo | feast-dev/feast |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 4a10310af51a1bfffbedc4fd81cb582acf0cb0ff |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width