Title: Probe and autoscaler status rewrite 250 KB ConfigMaps into etcd on every sample · Issue #266 · ExaDev/github-runner · GitHub
Open Graph Title: Probe and autoscaler status rewrite 250 KB ConfigMaps into etcd on every sample · Issue #266 · ExaDev/github-runner
X Title: Probe and autoscaler status rewrite 250 KB ConfigMaps into etcd on every sample · Issue #266 · ExaDev/github-runner
Description: The role controller's probe (scripts/fleet-role-probe.sh) merge-patches its own key of the shared fleet-role-probe ConfigMap every 15 seconds. Each key holds a 100-sample window of about 57 KB, so with six nodes the object is about 256 K...
Open Graph Description: The role controller's probe (scripts/fleet-role-probe.sh) merge-patches its own key of the shared fleet-role-probe ConfigMap every 15 seconds. Each key holds a 100-sample window of about 57 KB, so ...
X Description: The role controller's probe (scripts/fleet-role-probe.sh) merge-patches its own key of the shared fleet-role-probe ConfigMap every 15 seconds. Each key holds a 100-sample window of about 57 KB,...
Opengraph URL: https://github.com/ExaDev/github-runner/issues/266
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Probe and autoscaler status rewrite 250 KB ConfigMaps into etcd on every sample","articleBody":"The role controller's probe (`scripts/fleet-role-probe.sh`) merge-patches its own key of the shared `fleet-role-probe` ConfigMap every 15 seconds. Each key holds a 100-sample window of about 57 KB, so with six nodes the object is about 256 KB and every patch is a 220 KB raft proposal. The `autoscaler-status` ConfigMap is a further 290 KB, mostly its `job-memory` and `job-peak` keys.\n\nWhy it matters: the control-plane container restarts when its leader-election lease updates time out against a slow datastore (see #256), and etcd on the control plane counts slow applies and logs 100 to 200 ms reads. The write size is a candidate contributor, not a proven cause.\n\nProposed change: keep the sample window inside the probe (in memory or in its data directory) and publish only the node's current summary, one small object per node, so a write is a few KB and the shared object cannot approach the 1 MiB ConfigMap limit. Cap or age out the `autoscaler-status` per-job keys the same way.\n\nRevisit trigger: another control-plane restart after a quiet period, or either ConfigMap passing 500 KB.\n","author":{"url":"https://github.com/Mearman","@type":"Person","name":"Mearman"},"datePublished":"2026-11-20T05:22:30Z","url":"https://github.com/ExaDev/github-runner/issues/266"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:528dd639-4c4a-0980-dd8c-08f58fb3ea94 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | D1E6:DC070:4E30AD:6D9FB9:6B007368 |
| html-safe-nonce | 6c0f7de84987f4671c713048bcc3eaa212d0bdd20a378bf4c71ca43a4e0e644c |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEMUU2OkRDMDcwOjRFMzBBRDo2RDlGQjk6NkIwMDczNjgiLCJ2aXNpdG9yX2lkIjoiODU0NTE1MTQ1MDgzNjEzNjgwOCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 01f07f4e551d95517c0f8b426d52b0a19cc37b4634433ee3bee953d1d965bb43 |
| hovercard-subject-tag | issue:6505405067 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/ExaDev/github-runner/266/issue_layout |
| twitter:image | https://opengraph.githubassets.com/155adbff1791dde31a1373bbc5a06f5d70824de9517ce9a4d6a2d0a638328c5e/ExaDev/github-runner/issues/266 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/155adbff1791dde31a1373bbc5a06f5d70824de9517ce9a4d6a2d0a638328c5e/ExaDev/github-runner/issues/266 |
| og:image:alt | The role controller's probe (scripts/fleet-role-probe.sh) merge-patches its own key of the shared fleet-role-probe ConfigMap every 15 seconds. Each key holds a 100-sample window of about 57 KB, so ... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | Mearman |
| hostname | github.com |
| expected-hostname | github.com |
| None | 75c2b65dd205f26961d0c29afed1a8d0bb7cca9f05780571dfd1ef93eb539d16 |
| turbo-cache-control | no-preview |
| go-import | github.com/ExaDev/github-runner git https://github.com/ExaDev/github-runner.git |
| octolytics-dimension-user_id | 140118018 |
| octolytics-dimension-user_login | ExaDev |
| octolytics-dimension-repository_id | 1388126104 |
| octolytics-dimension-repository_nwo | ExaDev/github-runner |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 1388126104 |
| octolytics-dimension-repository_network_root_nwo | ExaDev/github-runner |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 84e563eb4b55f8fa102f325f117533cee9e3df4a |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width