Title: Online read: columnar store return and proto-direct to_arrow to cut client CPU on wide reads · Issue #7072 · feast-dev/feast · GitHub
Open Graph Title: Online read: columnar store return and proto-direct to_arrow to cut client CPU on wide reads · Issue #7072 · feast-dev/feast
X Title: Online read: columnar store return and proto-direct to_arrow to cut client CPU on wide reads · Issue #7072 · feast-dev/feast
Description: Problem For wide online reads against the Redis store (4 feature views, ~90 features, 100 to 500 entities per call) the fetch is now GIL-free with client: glide (#6870), but most of get_online_features wall time is still Python after the...
Open Graph Description: Problem For wide online reads against the Redis store (4 feature views, ~90 features, 100 to 500 entities per call) the fetch is now GIL-free with client: glide (#6870), but most of get_online_feat...
X Description: Problem For wide online reads against the Redis store (4 feature views, ~90 features, 100 to 500 entities per call) the fetch is now GIL-free with client: glide (#6870), but most of get_online_feat...
Opengraph URL: https://github.com/feast-dev/feast/issues/7072
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Online read: columnar store return and proto-direct to_arrow to cut client CPU on wide reads","articleBody":"**Problem**\n\nFor wide online reads against the Redis store (4 feature views, ~90 features, 100 to 500 entities per call) the fetch is now GIL-free with `client: glide` (#6870), but most of `get_online_features` wall time is still Python after the fetch:\n\n- `online_read` returns one `dict[str, ValueProto]` per entity, built value by value.\n- `_get_online_features` walks those into `GetOnlineFeaturesResponse` one value at a time.\n- `OnlineResponse.to_arrow()` is `pa.Table.from_pydict(self.to_dict())`, so it costs more than `to_dict`, not less.\n- `get_feature_service(allow_cache=True)` rebuilds the `FeatureService` from proto on every call, about 2 ms per request.\n\nMeasured locally (Apple silicon, Valkey 9.1, feast 0.67.0, 1500 entities x 11 feature views, service of 90 features from 4 views, p50 ms):\n\n| k | SDK `client: glide` + proto walk to Arrow | SDK `to_arrow()` | raw GLIDE HMGET fetch only | fetch + per-column decode straight to Arrow |\n| --------------------------- | ----------------------------------------- | ---------------- | -------------------------- | ------------------------------------------- |\n| 100 | 20 | 18 | 3.6 | 6.7 |\n| 500 | 106 | 112 | 18 | 33 |\n| 1500 | 316 | 330 | 53 | 96 |\n| 100, one busy Python thread | 143 | 99 | n/a | 70 |\n\nThe fetch is about 17% of the SDK read. The same shape holds on the `precompute_online=True` fast path: one GET per entity, yet 34 to 72 ms at k=360 to 500 in an earlier run because response assembly dominates.\n\n**Proposal**\n\n1. An optional columnar return on `OnlineStore`, e.g. `online_read_columns(...) -> dict[feature, list[bytes | None]]` plus per-view timestamps, with the base class falling back to today's `online_read`. Redis can fill it straight from the pipeline replies with no per-value proto objects.\n2. `OnlineResponse.to_arrow()` builds one `pa.array` per column from `response.proto` instead of going through `to_dict`.\n3. Key the `registry_proto_cache` decorators in `proto_registry_utils` on the registry's `version_id` instead of `id(registry_proto)`. Every registry refresh produces a new proto object, so today each refresh rebuilds every `FeatureService` from proto (about 35 ms for 14 services, most of it typeguard checks on `Field.__init__`), and `get_feature_service` has no object cache at all (about 2 ms per read).\n\nA note on the tail: at k=500 the `precompute_online` fast path measured p50 63 ms with the default collector and 34 ms after `gc.freeze()`, because each read allocates tens of thousands of proto wrappers and trips gen2 collections. Not a Feast change, but worth a line in the feature server performance tuning guide.\n\nEach is backwards compatible. I have working drafts of 2 and 3 (3 measured at 35 ms to 0.1 ms per refresh) and can open PRs if the direction is agreed. Fetch-side repro: see the script on #6856.\n","author":{"url":"https://github.com/chandlerok","@type":"Person","name":"chandlerok"},"datePublished":"2026-10-26T22:22:51Z","url":"https://github.com/feast-dev/feast/issues/7072"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:4f0f8dc2-07c9-1f19-ed30-bca0099c16b8 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | C306:6CCC0:E85230:1320D28:6AFE9524 |
| html-safe-nonce | a7b2cc812f9830e59b271df3d410315186305c9c6f9de892f90d4737aa6eb536 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDMzA2OjZDQ0MwOkU4NTIzMDoxMzIwRDI4OjZBRkU5NTI0IiwidmlzaXRvcl9pZCI6IjcwNTIyNTU1MDkxOTcyNjQxNjQiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 25a1ad4d03554c5055bc87232242d6fdfbeaf44e0914cda4e0afc897cfa8b85c |
| hovercard-subject-tag | issue:6049230248 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/feast-dev/feast/7072/issue_layout |
| twitter:image | https://opengraph.githubassets.com/7b001824b7077d5efe5941068bc70e1833e327f74e5dea80cb1612e7956c5d94/feast-dev/feast/issues/7072 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/7b001824b7077d5efe5941068bc70e1833e327f74e5dea80cb1612e7956c5d94/feast-dev/feast/issues/7072 |
| og:image:alt | Problem For wide online reads against the Redis store (4 feature views, ~90 features, 100 to 500 entities per call) the fetch is now GIL-free with client: glide (#6870), but most of get_online_feat... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | chandlerok |
| hostname | github.com |
| expected-hostname | github.com |
| None | b3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86 |
| turbo-cache-control | no-preview |
| go-import | github.com/feast-dev/feast git https://github.com/feast-dev/feast.git |
| octolytics-dimension-user_id | 57027613 |
| octolytics-dimension-user_login | feast-dev |
| octolytics-dimension-repository_id | 161133770 |
| octolytics-dimension-repository_nwo | feast-dev/feast |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 161133770 |
| octolytics-dimension-repository_network_root_nwo | feast-dev/feast |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 4a10310af51a1bfffbedc4fd81cb582acf0cb0ff |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width