Title: Reduce time spent in each benchmark · Issue #318 · python/bench_runner · GitHub
Open Graph Title: Reduce time spent in each benchmark · Issue #318 · python/bench_runner
X Title: Reduce time spent in each benchmark · Issue #318 · python/bench_runner
Description: Some benchmarks probably run for longer than they need to to provide useful information. Given the data we already have, it should be easy enough to do an analysis of how much variability there is between runs of each benchmark (we usual...
Open Graph Description: Some benchmarks probably run for longer than they need to to provide useful information. Given the data we already have, it should be easy enough to do an analysis of how much variability there is ...
X Description: Some benchmarks probably run for longer than they need to to provide useful information. Given the data we already have, it should be easy enough to do an analysis of how much variability there is ...
Opengraph URL: https://github.com/python/bench_runner/issues/318
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Reduce time spent in each benchmark","articleBody":"Some benchmarks probably run for longer than they need to to provide useful information.\r\n\r\nGiven the data we already have, it should be easy enough to do an analysis of how much variability there is between runs of each benchmark (we usually run each 20 times), to determine which benchmarks could safely be run fewer times.\r\n\r\nWithin each benchmark, however, they could theoretically be doing less work and still providing the same value. That will require reducing data sizes and constants within the benchmarks themselves and measuring the impact on stability. It is probably worth focusing effort on the longest running benchmarks first.\r\n\r\nCc: @mpage, @colesbury, @brandtbucher ","author":{"url":"https://github.com/mdboom","@type":"Person","name":"mdboom"},"datePublished":"2024-12-11T18:11:01Z","url":"https://github.com/python/bench_runner/issues/318"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:e4a19ab6-6b60-eb69-db55-d9fcf03671d3 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | CADA:1CCECA:183FCF6:203202A:6B021CFB |
| html-safe-nonce | 70d67f8eec64d2a8d7ff904de2a2e9c8d07671206ad5d560af8616845acfcd3f |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDQURBOjFDQ0VDQToxODNGQ0Y2OjIwMzIwMkE6NkIwMjFDRkIiLCJ2aXNpdG9yX2lkIjoiMjM5MDU4MjIzMDQyNzc3MDEwNyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 66a3d17ff78d11d0b7967bc730f5614d1bbe49b3ccf1ee499560a4a0ebc05414 |
| hovercard-subject-tag | issue:2733652884 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/python/bench_runner/318/issue_layout |
| twitter:image | https://opengraph.githubassets.com/15f44c901babe28a98405c34b3c4f7df127215e3f3499e0f77f8ab9d43b1052e/python/bench_runner/issues/318 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/15f44c901babe28a98405c34b3c4f7df127215e3f3499e0f77f8ab9d43b1052e/python/bench_runner/issues/318 |
| og:image:alt | Some benchmarks probably run for longer than they need to to provide useful information. Given the data we already have, it should be easy enough to do an analysis of how much variability there is ... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | mdboom |
| hostname | github.com |
| expected-hostname | github.com |
| None | 87e774ee7c6b3bee0490394e4d3e57ec9dbc956f74b87ea685dc8996c1676456 |
| turbo-cache-control | no-preview |
| go-import | github.com/python/bench_runner git https://github.com/python/bench_runner.git |
| octolytics-dimension-user_id | 1525981 |
| octolytics-dimension-user_login | python |
| octolytics-dimension-repository_id | 656847333 |
| octolytics-dimension-repository_nwo | python/bench_runner |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 656847333 |
| octolytics-dimension-repository_network_root_nwo | python/bench_runner |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 423dbb54c5e7bfecc838eb387c1435eb3d0e760d |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width