René's URL Explorer Experiment


Title: fix(traces): make trace backfills bounded and resumable by TheodoreSpeaks · Pull Request #7974 · simstudioai/sim · GitHub

Open Graph Title: fix(traces): make trace backfills bounded and resumable by TheodoreSpeaks · Pull Request #7974 · simstudioai/sim

X Title: fix(traces): make trace backfills bounded and resumable by TheodoreSpeaks · Pull Request #7974 · simstudioai/sim

Description: Summary Make the trace backfill fail fast, scan bounded chronological pages, and resume from checkpoints that preserve timestamp precision and the scan cutoff. Use the current workflow owner for file metadata while preserving the original execution user in the stored payload. Support up to 512 workers with a shared payload byte budget, graceful shutdown, and throughput, RSS, and stage timing logs. Route execution-log reads, writes, and reference transactions through the execution pool, matching the completion path. Type of Change Bug fix Testing 112 targeted tests pass across the backfill, trace store, and payload store. All 46 repository audits, block registry checks, docs manifest check, changed-file Biome checks, and git diff --check pass. Full repository bun run lint:check passes. All GitHub CI checks pass, including Lint and Test, the app build, both PostgreSQL integration jobs, and all test shards. Built and tested the companion image against local PostgreSQL and S3-compatible fixtures: metadata ownership, original execution identity, durable references, and idempotent reruns pass. Companion image and task template: simstudioai/infra#375. No database migration or backfill execution is triggered by this PR. Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

Open Graph Description: Summary Make the trace backfill fail fast, scan bounded chronological pages, and resume from checkpoints that preserve timestamp precision and the scan cutoff. Use the current workflow owner for f...

X Description: Summary Make the trace backfill fail fast, scan bounded chronological pages, and resume from checkpoints that preserve timestamp precision and the scan cutoff. Use the current workflow owner for f...

Opengraph URL: https://github.com/simstudioai/sim/pull/7974

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:3cc47bd3-508b-3ea2-15e5-ac4b3f906c77
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idB400:23725B:157E8E6:1D5F604:6AFB7582
html-safe-nonce3e68a605b13d709e9d3205487f2948247a5792c19b462362bbd99f61dc468aa4
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCNDAwOjIzNzI1QjoxNTdFOEU2OjFENUY2MDQ6NkFGQjc1ODIiLCJ2aXNpdG9yX2lkIjoiOTE3MzQzODIyMDU4NTM2NjkxNCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac6514246fa381f53984a78d49b25c7fee78a90f42f17a438f0aeb34fa4b17f72e
hovercard-subject-tagpull_request:4571692978
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/7974/files
twitter:imagehttps://avatars.githubusercontent.com/u/19564703?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/19564703?s=400&v=4
og:image:altSummary Make the trace backfill fail fast, scan bounded chronological pages, and resume from checkpoints that preserve timestamp precision and the scan cutoff. Use the current workflow owner for f...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None0e29e7974fdda2feeaf5c891efd4b23b0734b23480232b62c7bdef13f40b5b48
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release2e8872b770cc4d5d0cc1f2026afab747a268e2ce
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/7974/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F7974%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F7974%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/7974/files
Reloadhttps://github.com/simstudioai/sim/pull/7974/files
Reloadhttps://github.com/simstudioai/sim/pull/7974/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests201 (201)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
TheodoreSpeakshttps://github.com/TheodoreSpeaks
staginghttps://github.com/simstudioai/sim/tree/staging
feat/cleanup-trace-spanshttps://github.com/simstudioai/sim/tree/feat/cleanup-trace-spans
Conversation 11 https://github.com/simstudioai/sim/pull/7974
Commits 3 https://github.com/simstudioai/sim/pull/7974/commits
Checks 35 https://github.com/simstudioai/sim/pull/7974/checks
Files changed https://github.com/simstudioai/sim/pull/7974/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7974/files
fix(traces): make trace backfills bounded and resumable https://github.com/simstudioai/sim/pull/7974/files#top
Show all changes 3 commits https://github.com/simstudioai/sim/pull/7974/files
ac91319 wip TheodoreSpeaks Sep 17, 2026 https://github.com/simstudioai/sim/pull/7974/commits/ac9131959f7c7026d244722d44a01dc6914c6413
3d97316 fix(traces): bound and resume trace backfill workers TheodoreSpeaks Sep 18, 2026 https://github.com/simstudioai/sim/pull/7974/commits/3d97316dd82ac1e6e9ac29eb6f1c4d3e4f0d9acf
e9ee2f7 fix(traces): use execution pool throughout backfill TheodoreSpeaks Sep 18, 2026 https://github.com/simstudioai/sim/pull/7974/commits/e9ee2f733041842392bce2f859c87377870384c5
Clear filters https://github.com/simstudioai/sim/pull/7974/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7974/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7974/files
store.test.ts https://github.com/simstudioai/sim/pull/7974/files#diff-7d91ce20300d191a7cc0171e2b243067e26168d21702d6f90d4e35013546641b
store.ts https://github.com/simstudioai/sim/pull/7974/files#diff-6ff75847870249858542d2e965088a457915232d884a411cf6c5d5ca45810bac
trace-store.test.ts https://github.com/simstudioai/sim/pull/7974/files#diff-84299c26f744b3f769762ddf719bf25215a8be08de0b293acf0853dbb5d50e2b
trace-store.ts https://github.com/simstudioai/sim/pull/7974/files#diff-fe3d0a8f11d559b284e0858ee61cbe42773223d4637adb2ddcb1a8b56a85c06f
backfill-trace-spans.test.ts https://github.com/simstudioai/sim/pull/7974/files#diff-d0795ea488161d1474dbd9a71aeaa4b08e0791df95ad27681a40aa2429c4844c
backfill-trace-spans.ts https://github.com/simstudioai/sim/pull/7974/files#diff-f887370536d99fee2fa6fadc2f5eb20eed7105f2e068e9d073ceec3566f0ca8d
apps/sim/lib/execution/payloads/store.test.tshttps://github.com/simstudioai/sim/pull/7974/files#diff-7d91ce20300d191a7cc0171e2b243067e26168d21702d6f90d4e35013546641b
View file https://github.com/simstudioai/sim/blob/e9ee2f733041842392bce2f859c87377870384c5/apps/sim/lib/execution/payloads/store.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7974/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7974/files#diff-7d91ce20300d191a7cc0171e2b243067e26168d21702d6f90d4e35013546641b
https://github.com/simstudioai/sim/pull/7974/files#diff-7d91ce20300d191a7cc0171e2b243067e26168d21702d6f90d4e35013546641b
apps/sim/lib/execution/payloads/store.tshttps://github.com/simstudioai/sim/pull/7974/files#diff-6ff75847870249858542d2e965088a457915232d884a411cf6c5d5ca45810bac
View file https://github.com/simstudioai/sim/blob/e9ee2f733041842392bce2f859c87377870384c5/apps/sim/lib/execution/payloads/store.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7974/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7974/files#diff-6ff75847870249858542d2e965088a457915232d884a411cf6c5d5ca45810bac
https://github.com/simstudioai/sim/pull/7974/files#diff-6ff75847870249858542d2e965088a457915232d884a411cf6c5d5ca45810bac
apps/sim/lib/logs/execution/trace-store.test.tshttps://github.com/simstudioai/sim/pull/7974/files#diff-84299c26f744b3f769762ddf719bf25215a8be08de0b293acf0853dbb5d50e2b
View file https://github.com/simstudioai/sim/blob/e9ee2f733041842392bce2f859c87377870384c5/apps/sim/lib/logs/execution/trace-store.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7974/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7974/files#diff-84299c26f744b3f769762ddf719bf25215a8be08de0b293acf0853dbb5d50e2b
https://github.com/simstudioai/sim/pull/7974/files#diff-84299c26f744b3f769762ddf719bf25215a8be08de0b293acf0853dbb5d50e2b
apps/sim/lib/logs/execution/trace-store.tshttps://github.com/simstudioai/sim/pull/7974/files#diff-fe3d0a8f11d559b284e0858ee61cbe42773223d4637adb2ddcb1a8b56a85c06f
View file https://github.com/simstudioai/sim/blob/e9ee2f733041842392bce2f859c87377870384c5/apps/sim/lib/logs/execution/trace-store.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7974/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7974/files#diff-fe3d0a8f11d559b284e0858ee61cbe42773223d4637adb2ddcb1a8b56a85c06f
https://github.com/simstudioai/sim/pull/7974/files#diff-fe3d0a8f11d559b284e0858ee61cbe42773223d4637adb2ddcb1a8b56a85c06f
https://github.com/simstudioai/sim/pull/7974/files#diff-fe3d0a8f11d559b284e0858ee61cbe42773223d4637adb2ddcb1a8b56a85c06f
https://github.com/simstudioai/sim/pull/7974/files#diff-fe3d0a8f11d559b284e0858ee61cbe42773223d4637adb2ddcb1a8b56a85c06f
Please reload this pagehttps://github.com/simstudioai/sim/pull/7974/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7974/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.