René's URL Explorer Experiment


Title: ci: duration-balanced integration shards, warm desktop-live, CI on every PR by waleedlatif1 · Pull Request #8763 · simstudioai/sim · GitHub

Open Graph Title: ci: duration-balanced integration shards, warm desktop-live, CI on every PR by waleedlatif1 · Pull Request #8763 · simstudioai/sim

X Title: ci: duration-balanced integration shards, warm desktop-live, CI on every PR by waleedlatif1 · Pull Request #8763 · simstudioai/sim

Description: What Follow-up to #8750. Three changes, none of which change what a check verifies. 1. Integration shards balanced by duration (vitest.shared.ts) Before: Vitest's --shard sorts files by path hash and gives each shard an equal file count. recovery-storm.integration.ts alone takes ~217 s, about 21% of the suite, and the hash put it beside 41 other files. Shards ranged from 183 to 384 s. Change: DurationBalancedSequencer overrides only shard(). It packs files longest-first into the lightest shard, using per-file seconds from the committed vitest.integration-durations.json. Ordering within a shard is still Vitest's own sort(). Same split on every shard: each shard computes the full split from the same file list and weights, breaking ties by path and then by lowest shard index. Files stay disjoint and all are covered, which I checked against the real file lists (166 + 17): no duplicates, none missing, and the same result with the input order reversed. New or stale files: a new file gets an average weight, and a stale weight only costs balance. Result (measured weights): the apps/sim shards come out at 254 s each, so the slowest integration job drops from ~7.4 to ~5.3 min at the same runner cost. Refreshing weights: gh run download -p 'integration-reports-*' -D

, then bun run scripts/update-integration-durations.ts . 2. desktop-live: keep the Turbopack dev cache (checks.yml) The job's ~4 min route warm-up is a cold Turbopack compile, and next.config.ts already enables the dev filesystem cache (measured there at 5.4× faster restarts). Cache disk: apps/sim/.next/dev now lives on a sticky disk. It is keyed by event and fork (like the other caches) and by the installed Next version, so an upgrade starts from empty. Clean stop: the app is stopped with SIGINT before stop-session.sh runs. next dev SIGKILLs its server 100 ms after SIGTERM, which throws away a cache write in progress. Corrupt cache: if Turbopack reports a corrupt cache during startup, the job clears the cache and restarts once from empty. It also clears the cache after the run if the log shows corruption or a panic. A plain test failure keeps the shared cache. Cache size: dev:cache:cap keeps the cache under the 20 GB cap the dev scripts already use. Parallel boot: the apps now boot while the apt install and the Electron bundle run (~35 s). Expected: ~2.5–3.5 min off the job once the cache is warm. The first run on this PR is cold by design. 3. CI runs on every pull request (ci.yml) The paths-ignore for docs and markdown is gone. checks / ci is about to become the required status check, and a PR whose run never starts never reports it, so it could not merge. None of the last 200 PRs merged to staging was docs-only, so the cost is nil. Verify actionlint and shellcheck (the desktop-live script) clean; lint:check, check:audits (58), test:scripts (357), type-check Sequencer split checked on the real file lists; two real packages/db integration shards run against Postgres with it This PR's CI: every shard green, plus integration shard times Re-run desktop-live on the same commit to measure the warm cache

Open Graph Description: What Follow-up to #8750. Three changes, none of which change what a check verifies. 1. Integration shards balanced by duration (vitest.shared.ts) Before: Vitest's --shard sorts files by path h...

X Description: What Follow-up to #8750. Three changes, none of which change what a check verifies. 1. Integration shards balanced by duration (vitest.shared.ts) Before: Vitest's --shard sorts files by pa...

Opengraph URL: https://github.com/simstudioai/sim/pull/8763

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:22b971df-1614-54c0-954c-b8227d8c2201
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idADE8:63A32:41D837:5CB2EC:6AFB5A5D
html-safe-noncef11dcd639c1f4f63507afbb74a90f8cdac4adf0f87ebefc02bf5576a6b451907
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBREU4OjYzQTMyOjQxRDgzNzo1Q0IyRUM6NkFGQjVBNUQiLCJ2aXNpdG9yX2lkIjoiMTQ0MjU5NjM0NDQ3OTU3MDUyNSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac0c4e2687a43499e47b5c9f61ba1bca2c049ec5fc7017b7c7d79f2f6a2431891f
hovercard-subject-tagpull_request:4778525066
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/8763/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altWhat Follow-up to #8750. Three changes, none of which change what a check verifies. 1. Integration shards balanced by duration (vitest.shared.ts) Before: Vitest's --shard sorts files by path h...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneea33d13c96d0ff66bd8fa906b193d2213536b78cb06b0c50a4632c58b1418f94
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release59ef97164c52cf59bd10558ddec9c4f482763988
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/8763/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F8763%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F8763%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/8763/files
Reloadhttps://github.com/simstudioai/sim/pull/8763/files
Reloadhttps://github.com/simstudioai/sim/pull/8763/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
chore/ci-speedhttps://github.com/simstudioai/sim/tree/chore/ci-speed
Conversation 24 https://github.com/simstudioai/sim/pull/8763
Commits 3 https://github.com/simstudioai/sim/pull/8763/commits
Checks 46 https://github.com/simstudioai/sim/pull/8763/checks
Files changed https://github.com/simstudioai/sim/pull/8763/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8763/files
ci: duration-balanced integration shards, warm desktop-live, CI on every PR https://github.com/simstudioai/sim/pull/8763/files#top
Show all changes 3 commits https://github.com/simstudioai/sim/pull/8763/files
cdb34e8 ci: duration-balanced integration shards, warm desktop-live, CI on ev… waleedlatif1 Oct 7, 2026 https://github.com/simstudioai/sim/pull/8763/commits/cdb34e829ad0a912354c79045b7d6938256ba473
d521bda ci: clear the dev cache by absolute path, always run session cleanup,… waleedlatif1 Oct 7, 2026 https://github.com/simstudioai/sim/pull/8763/commits/d521bdada91e45582dcf21eff920323a69b6a74f
74af417 ci: a malformed durations file names its fix, and non-finite weights … waleedlatif1 Oct 7, 2026 https://github.com/simstudioai/sim/pull/8763/commits/74af417a31be2e3f134dee0be19b0d22cd435b7e
Clear filters https://github.com/simstudioai/sim/pull/8763/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8763/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8763/files
checks.yml https://github.com/simstudioai/sim/pull/8763/files#diff-3ea54af4839eb75404d71b28252bead7e7ec8f676b1f815e1cde02629a75c165
ci.yml https://github.com/simstudioai/sim/pull/8763/files#diff-b803fcb7f17ed9235f1e5cb1fcd2f5d3b2838429d4368ae4c57ce4436577f03f
update-integration-durations.ts https://github.com/simstudioai/sim/pull/8763/files#diff-0046ece6e30b75510fc9e8d9bc1c5e0430777580950d2bdae58ee7a2ee2adf2c
vitest.integration-durations.json https://github.com/simstudioai/sim/pull/8763/files#diff-16efb64d3d78dbc32b2a4c52e1110d75ad8632914b13407569f000dcac66cef6
vitest.shared.ts https://github.com/simstudioai/sim/pull/8763/files#diff-2c974cbf9cd062d634c6e50dac694594e8742f91f368c04468f0f1cbae575809
.github/workflows/checks.ymlhttps://github.com/simstudioai/sim/pull/8763/files#diff-3ea54af4839eb75404d71b28252bead7e7ec8f676b1f815e1cde02629a75c165
View file https://github.com/simstudioai/sim/blob/74af417a31be2e3f134dee0be19b0d22cd435b7e/.github/workflows/checks.yml
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8763/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/8763/files#diff-3ea54af4839eb75404d71b28252bead7e7ec8f676b1f815e1cde02629a75c165
https://github.com/simstudioai/sim/pull/8763/files#diff-3ea54af4839eb75404d71b28252bead7e7ec8f676b1f815e1cde02629a75c165
https://github.com/simstudioai/sim/pull/8763/files#diff-3ea54af4839eb75404d71b28252bead7e7ec8f676b1f815e1cde02629a75c165
Please reload this pagehttps://github.com/simstudioai/sim/pull/8763/files
https://github.com/simstudioai/sim/pull/8763/files#diff-3ea54af4839eb75404d71b28252bead7e7ec8f676b1f815e1cde02629a75c165
https://github.com/simstudioai/sim/pull/8763/files#diff-3ea54af4839eb75404d71b28252bead7e7ec8f676b1f815e1cde02629a75c165
.github/workflows/ci.ymlhttps://github.com/simstudioai/sim/pull/8763/files#diff-b803fcb7f17ed9235f1e5cb1fcd2f5d3b2838429d4368ae4c57ce4436577f03f
View file https://github.com/simstudioai/sim/blob/74af417a31be2e3f134dee0be19b0d22cd435b7e/.github/workflows/ci.yml
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8763/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/8763/files#diff-b803fcb7f17ed9235f1e5cb1fcd2f5d3b2838429d4368ae4c57ce4436577f03f
https://github.com/simstudioai/sim/pull/8763/files#diff-b803fcb7f17ed9235f1e5cb1fcd2f5d3b2838429d4368ae4c57ce4436577f03f
scripts/update-integration-durations.tshttps://github.com/simstudioai/sim/pull/8763/files#diff-0046ece6e30b75510fc9e8d9bc1c5e0430777580950d2bdae58ee7a2ee2adf2c
View file https://github.com/simstudioai/sim/blob/74af417a31be2e3f134dee0be19b0d22cd435b7e/scripts/update-integration-durations.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/8763/{{ revealButtonHref }}
Please reload this pagehttps://github.com/simstudioai/sim/pull/8763/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/8763/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.