Title: Extend WriteMetricsTransform in Ingestion to write feature value stats to StatsD by davidheryanto · Pull Request #486 · feast-dev/feast · GitHub
Open Graph Title: Extend WriteMetricsTransform in Ingestion to write feature value stats to StatsD by davidheryanto · Pull Request #486 · feast-dev/feast
X Title: Extend WriteMetricsTransform in Ingestion to write feature value stats to StatsD by davidheryanto · Pull Request #486 · feast-dev/feast
Description: What this PR does / why we need it: This PR adds a step (blue coloured box) to write stats for numerical value of every feature to StatsD. A fixed window (default to 30s) will first be applied, before the stats calculation of each feature. This is to ensure the metrics collector is not overwhelmed with metrics data (and drop the metrics as a result). For validation of features by value, an aggregated windowed view of the values is also usually adequate. The following gauge metrics will be sent to StatsD for every feature at the end of the window: feature_value_min feature_value_max feature_value_mean feature_value_percentile_50 feature_value_percentile_90 feature_value_percentile_95 Reason for using gauge metric type as opposed to histogram/timings in StatsD is because StatsD only support positive values for histogram metric types, while numerical feature values can be of any double value. Which issue(s) this PR fixes: Related to #172 Does this PR introduce a user-facing change?:
Open Graph Description: What this PR does / why we need it: This PR adds a step (blue coloured box) to write stats for numerical value of every feature to StatsD. A fixed window (default to 30s) will first be applied, be...
X Description: What this PR does / why we need it: This PR adds a step (blue coloured box) to write stats for numerical value of every feature to StatsD. A fixed window (default to 30s) will first be applied, be...
Opengraph URL: https://github.com/feast-dev/feast/pull/486
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository/pull/:id/files(.:format) |
| route-controller | pull_requests |
| route-action | files |
| fetch-nonce | v2:acdf4c78-7ec6-2538-e3d5-d1dc19a9a3ed |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | AA0E:191A63:413D67C:5779022:697B1949 |
| html-safe-nonce | e2f20dc906ada2720f6eb09ae34d21f1a660af9ba411258af82a5a4dda63ba6f |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBQTBFOjE5MUE2Mzo0MTNENjdDOjU3NzkwMjI6Njk3QjE5NDkiLCJ2aXNpdG9yX2lkIjoiMTc4NzY0NDY0OTY5MTM1NTQ2NSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | e7593626e2242edc3742cc117f39669638b586b29dfe7d5fdcfcc7d38a17b74f |
| hovercard-subject-tag | pull_request:378656335 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/feast-dev/feast/pull/486/files |
| twitter:image | https://avatars.githubusercontent.com/u/5300554?s=400&v=4 |
| twitter:card | summary_large_image |
| og:image | https://avatars.githubusercontent.com/u/5300554?s=400&v=4 |
| og:image:alt | What this PR does / why we need it: This PR adds a step (blue coloured box) to write stats for numerical value of every feature to StatsD. A fixed window (default to 30s) will first be applied, be... |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 7ce8ed0a54c4730aeca4e6abacfc6490365fc42e25480b86883054df3f9181c8 |
| turbo-cache-control | no-preview |
| diff-view | unified |
| go-import | github.com/feast-dev/feast git https://github.com/feast-dev/feast.git |
| octolytics-dimension-user_id | 57027613 |
| octolytics-dimension-user_login | feast-dev |
| octolytics-dimension-repository_id | 161133770 |
| octolytics-dimension-repository_nwo | feast-dev/feast |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 161133770 |
| octolytics-dimension-repository_network_root_nwo | feast-dev/feast |
| turbo-body-classes | logged-out env-production page-responsive full-width |
| disable-turbo | true |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | d7bfc78137af9a4828305e52ab993fce981d7085 |
| ui-target | canary-2 |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width