Title: fix(ci): isolate HTTP end-to-end suites and stop the SCIM readiness flake by waleedlatif1 · Pull Request #8544 · simstudioai/sim · GitHub
Open Graph Title: fix(ci): isolate HTTP end-to-end suites and stop the SCIM readiness flake by waleedlatif1 · Pull Request #8544 · simstudioai/sim
X Title: fix(ci): isolate HTTP end-to-end suites and stop the SCIM readiness flake by waleedlatif1 · Pull Request #8544 · simstudioai/sim
Description: Summary Flake root cause: the SCIM step starts next dev and waits for /api/health, whose first request cold-compiles the app under Turbopack. Across 40 recent green runs readiness took 42–93s (step totals up to 209s), and today's staging push hit >120s — the fixed 120s deadline failed on the slow tail. The server log was never uploaded, so failures were undiagnosable. New End-to-end over real HTTP job holds SCIM + the four search HTTP suites, on its own Postgres (provisioned via db:migrate, the production path). Previously SCIM ran on both integration matrix legs, which are the PR critical path (~13 min avg vs 7.6 min Lint and Test); the search suites were gated by matrix.provision == 'push'. Isolation also matters: the SCIM app boots hosted, which starts background usage replay against DATABASE_URL. Readiness: 300s deadline (hang catcher only), step timeout-minutes: 12, fail-fast on server exit, server log tail printed inline, and the full scim-next.log uploaded with the reports (one artifact instead of five upload steps). setup-workspace composite action replaces four copies of Bun/Node/cache/install setup. Cache keys are unchanged (existing sticky disks are reused); the integration legs now also mount the lockfile-keyed node_modules disk. Removed a duplicated comment paragraph in the base-ref step. Expected effect: ~2 min off each integration leg (the PR critical path), SCIM run once instead of twice, and the readiness flake gone. ci-score (StarSling) rates the repo 91/100 before and after; its one failing check (fetch-depth: 0 in helm.yml) is a false positive — ct diffs against the PR base. Test plan actionlint — no new findings CI on this PR: new End-to-end over real HTTP job green; integration legs no longer run SCIM
Open Graph Description: Summary Flake root cause: the SCIM step starts next dev and waits for /api/health, whose first request cold-compiles the app under Turbopack. Across 40 recent green runs readiness took 42–93s (ste...
X Description: Summary Flake root cause: the SCIM step starts next dev and waits for /api/health, whose first request cold-compiles the app under Turbopack. Across 40 recent green runs readiness took 42–93s (ste...
Opengraph URL: https://github.com/simstudioai/sim/pull/8544
X: @github
Domain: github.com
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf |
| route-pattern | /:user_id/:repository/pull/:id/files(.:format) |
| route-controller | pull_requests |
| route-action | files |
| fetch-nonce | v2:067a5b1b-937f-52fd-1115-1c6f4973b68c |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | A19C:345450:A26D57:E060B9:6AFB50DD |
| html-safe-nonce | a9f0d9975489ebe8d44c58b755fdca22967a24295653c8957cea4e9248e8ebf8 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBMTlDOjM0NTQ1MDpBMjZENTc6RTA2MEI5OjZBRkI1MEREIiwidmlzaXRvcl9pZCI6IjUyMzIwMzk4NzM3MDY5Mzg1ODkiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 20bbf240d43e19775012d44d308ec69f2450f5f6ce73e1ccb25abe0ae205a33b |
| hovercard-subject-tag | pull_request:4709798476 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/8544/files |
| twitter:image | https://avatars.githubusercontent.com/u/40672544?s=400&v=4 |
| twitter:card | summary_large_image |
| og:image | https://avatars.githubusercontent.com/u/40672544?s=400&v=4 |
| og:image:alt | Summary Flake root cause: the SCIM step starts next dev and waits for /api/health, whose first request cold-compiles the app under Turbopack. Across 40 recent green runs readiness took 42–93s (ste... |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 7122bb414b542dba14d71a3f0b9f6fd2abce715b9f5912d082800563e6c806d1 |
| turbo-cache-control | no-preview |
| diff-view | unified |
| go-import | github.com/simstudioai/sim git https://github.com/simstudioai/sim.git |
| octolytics-dimension-user_id | 199344406 |
| octolytics-dimension-user_login | simstudioai |
| octolytics-dimension-repository_id | 912559512 |
| octolytics-dimension-repository_nwo | simstudioai/sim |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 912559512 |
| octolytics-dimension-repository_network_root_nwo | simstudioai/sim |
| turbo-body-classes | logged-out env-production page-responsive full-width |
| disable-turbo | true |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | cbf66c024bb6d10e6955baa7413c54cf13a201bb |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width