René's URL Explorer Experiment


Title: perf(webapp,run-store): point-lookup batch idempotency keys by ericallam · Pull Request #4255 · triggerdotdev/trigger.dev · GitHub

Open Graph Title: perf(webapp,run-store): point-lookup batch idempotency keys by ericallam · Pull Request #4255 · triggerdotdev/trigger.dev

X Title: perf(webapp,run-store): point-lookup batch idempotency keys by ericallam · Pull Request #4255 · triggerdotdev/trigger.dev

Description: Summary Batch triggers that use per-item idempotency keys could take seconds instead of milliseconds when the target task had a large run history. This keeps the idempotency lookup fast regardless of how many runs a task has accumulated. Root cause The batch path checks which items already have runs by looking up their idempotency keys with a single WHERE runtimeEnvironmentId = ? AND taskIdentifier = ? AND idempotencyKey IN (...) query. On a very large TaskRun table Postgres underestimates the row count of a specific (environment, task) pair, so once the IN list grows past a handful of keys it stops doing per-key index probes and instead scans every run for that (environment, task) and filters the keys in memory. The cost is then flat and large regardless of how many keys are being checked, and a routine ANALYZE does not correct the estimate at that table size. Fix Look each idempotency key up on its own, batched into a UNION ALL of point lookups (chunked, run with bounded concurrency). Each branch is an equality on all three columns of the unique index, so the planner can only do a per-key index probe and can never fall back to the range scan. Same results, same columns, confined to the batch trigger path.

Open Graph Description: Summary Batch triggers that use per-item idempotency keys could take seconds instead of milliseconds when the target task had a large run history. This keeps the idempotency lookup fast regardless ...

X Description: Summary Batch triggers that use per-item idempotency keys could take seconds instead of milliseconds when the target task had a large run history. This keeps the idempotency lookup fast regardless ...

Opengraph URL: https://github.com/triggerdotdev/trigger.dev/pull/4255

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:0c26cd9d-f5fb-6359-2c5f-34b038c72cf1
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idC720:1E3FD3:331D486:488AD15:6AFAF60A
html-safe-nonce917d1050ee1f98e6f379c6bcb0c38f0d8dde49babe0544675ff8af0202520e47
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDNzIwOjFFM0ZEMzozMzFENDg2OjQ4OEFEMTU6NkFGQUY2MEEiLCJ2aXNpdG9yX2lkIjoiNjQyNzUwOTQ4OTAxMTQ1NTQ5OCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacf3ae65bb5580828a22011b38de69552842e3435bc3f51467350e7fc35406a235
hovercard-subject-tagpull_request:4051841920
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/triggerdotdev/trigger.dev/pull/4255/files
twitter:imagehttps://avatars.githubusercontent.com/u/534?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/534?s=400&v=4
og:image:altSummary Batch triggers that use per-item idempotency keys could take seconds instead of milliseconds when the target task had a large run history. This keeps the idempotency lookup fast regardless ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None0178036d8230524a18422872393ab7e708443ae4c2047f758560a2db870c1913
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/triggerdotdev/trigger.dev git https://github.com/triggerdotdev/trigger.dev.git
octolytics-dimension-user_id95297378
octolytics-dimension-user_logintriggerdotdev
octolytics-dimension-repository_id572570113
octolytics-dimension-repository_nwotriggerdotdev/trigger.dev
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id572570113
octolytics-dimension-repository_network_root_nwotriggerdotdev/trigger.dev
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasea85e96a83bed7871993e6b1ffda24105928eee17
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/triggerdotdev/trigger.dev/pull/4255/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftriggerdotdev%2Ftrigger.dev%2Fpull%2F4255%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Ftriggerdotdev%2Ftrigger.dev%2Fpull%2F4255%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=triggerdotdev%2Ftrigger.dev
Reloadhttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
Reloadhttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
Reloadhttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
triggerdotdevhttps://github.com/triggerdotdev
trigger.devhttps://github.com/triggerdotdev/trigger.dev
Codehttps://github.com/triggerdotdev/trigger.dev
Issues203 (203)https://github.com/triggerdotdev/trigger.dev/issues
Pull requests67 (67)https://github.com/triggerdotdev/trigger.dev/pulls
Discussionshttps://github.com/triggerdotdev/trigger.dev/discussions
Actionshttps://github.com/triggerdotdev/trigger.dev/actions
Projectshttps://github.com/triggerdotdev/trigger.dev/projects
Security and quality39 (39)https://github.com/triggerdotdev/trigger.dev/security
Insightshttps://github.com/triggerdotdev/trigger.dev/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Ftriggerdotdev%2Ftrigger.dev%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Ftriggerdotdev%2Ftrigger.dev%2Fissues%2Fnew%2Fchoose
ericallamhttps://github.com/ericallam
mainhttps://github.com/triggerdotdev/trigger.dev/tree/main
perf/batch-idempotency-point-lookupshttps://github.com/triggerdotdev/trigger.dev/tree/perf/batch-idempotency-point-lookups
Conversation 11 https://github.com/triggerdotdev/trigger.dev/pull/4255
Commits 3 https://github.com/triggerdotdev/trigger.dev/pull/4255/commits
Checks 42 https://github.com/triggerdotdev/trigger.dev/pull/4255/checks
Files changed https://github.com/triggerdotdev/trigger.dev/pull/4255/files
Please reload this pagehttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
perf(webapp,run-store): point-lookup batch idempotency keys https://github.com/triggerdotdev/trigger.dev/pull/4255/files#top
Show all changes 3 commits https://github.com/triggerdotdev/trigger.dev/pull/4255/files
4d8d5ab perf(webapp,run-store): point-lookup batch idempotency keys ericallam Jul 14, 2026 https://github.com/triggerdotdev/trigger.dev/pull/4255/commits/4d8d5ab918960c743cf9f95cdd8ed50449cdb0ae
8771c07 perf(run-store,webapp): parallelize idempotency fan-out and cap looku… ericallam Jul 14, 2026 https://github.com/triggerdotdev/trigger.dev/pull/4255/commits/8771c07edeffb390aee780d920e7dc1c6de3579d
bd6a442 fix(webapp,run-store): match batch idempotency cache hits by task and… ericallam Jul 14, 2026 https://github.com/triggerdotdev/trigger.dev/pull/4255/commits/bd6a442d88d0c658e68b4fb48473b40c822fe738
Clear filters https://github.com/triggerdotdev/trigger.dev/pull/4255/files
Please reload this pagehttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
Please reload this pagehttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
fix-batch-idempotency-point-lookups.md https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-adf7cf1a1c3be90d07cf6a512a83164dfd81800a6537668da1bd580a5c2cf45a
batchTriggerV3.server.ts https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-55867b934007572d29b5479a4721efceb9743d246bfaf3a4401371bab53beebd
PostgresRunStore.findRunsByIdempotencyKeys.test.ts https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-99988478d8eff178f7816d114388452cf309398e58ad837efe0379d266179b8f
PostgresRunStore.ts https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-9c06c7000b359bcaa2f0b637af253ebfe2e2d9cf43568e42592b0e26f6910258
runOpsStore.ts https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-1d679bf075bd4e1cd8d7af604da21116c1b3701363bfd0b6dc389f714c562be8
types.ts https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-3b72267802fbd082b93adb08e3e014e75f40eb755c8a4f14bd7a76148f49ffe8
.server-changes/fix-batch-idempotency-point-lookups.mdhttps://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-adf7cf1a1c3be90d07cf6a512a83164dfd81800a6537668da1bd580a5c2cf45a
View file https://github.com/triggerdotdev/trigger.dev/blob/bd6a442d88d0c658e68b4fb48473b40c822fe738/.server-changes/fix-batch-idempotency-point-lookups.md
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/triggerdotdev/trigger.dev/pull/4255/{{ revealButtonHref }}
apps/webapp/app/v3/services/batchTriggerV3.server.tshttps://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-55867b934007572d29b5479a4721efceb9743d246bfaf3a4401371bab53beebd
View file https://github.com/triggerdotdev/trigger.dev/blob/bd6a442d88d0c658e68b4fb48473b40c822fe738/apps/webapp/app/v3/services/batchTriggerV3.server.ts
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
https://github.co/hiddenchars
https://github.com/triggerdotdev/trigger.dev/pull/4255/{{ revealButtonHref }}
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-55867b934007572d29b5479a4721efceb9743d246bfaf3a4401371bab53beebd
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-55867b934007572d29b5479a4721efceb9743d246bfaf3a4401371bab53beebd
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-55867b934007572d29b5479a4721efceb9743d246bfaf3a4401371bab53beebd
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-55867b934007572d29b5479a4721efceb9743d246bfaf3a4401371bab53beebd
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-55867b934007572d29b5479a4721efceb9743d246bfaf3a4401371bab53beebd
internal-packages/run-store/src/PostgresRunStore.findRunsByIdempotencyKeys.test.tshttps://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-99988478d8eff178f7816d114388452cf309398e58ad837efe0379d266179b8f
View file https://github.com/triggerdotdev/trigger.dev/blob/bd6a442d88d0c658e68b4fb48473b40c822fe738/internal-packages/run-store/src/PostgresRunStore.findRunsByIdempotencyKeys.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/triggerdotdev/trigger.dev/pull/4255/{{ revealButtonHref }}
internal-packages/run-store/src/PostgresRunStore.tshttps://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-9c06c7000b359bcaa2f0b637af253ebfe2e2d9cf43568e42592b0e26f6910258
View file https://github.com/triggerdotdev/trigger.dev/blob/bd6a442d88d0c658e68b4fb48473b40c822fe738/internal-packages/run-store/src/PostgresRunStore.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/triggerdotdev/trigger.dev/pull/4255/{{ revealButtonHref }}
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-9c06c7000b359bcaa2f0b637af253ebfe2e2d9cf43568e42592b0e26f6910258
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-9c06c7000b359bcaa2f0b637af253ebfe2e2d9cf43568e42592b0e26f6910258
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-9c06c7000b359bcaa2f0b637af253ebfe2e2d9cf43568e42592b0e26f6910258
Please reload this pagehttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
Please reload this pagehttps://github.com/triggerdotdev/trigger.dev/pull/4255/files
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-9c06c7000b359bcaa2f0b637af253ebfe2e2d9cf43568e42592b0e26f6910258
internal-packages/run-store/src/runOpsStore.tshttps://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-1d679bf075bd4e1cd8d7af604da21116c1b3701363bfd0b6dc389f714c562be8
View file https://github.com/triggerdotdev/trigger.dev/blob/bd6a442d88d0c658e68b4fb48473b40c822fe738/internal-packages/run-store/src/runOpsStore.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/triggerdotdev/trigger.dev/pull/4255/{{ revealButtonHref }}
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-1d679bf075bd4e1cd8d7af604da21116c1b3701363bfd0b6dc389f714c562be8
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-1d679bf075bd4e1cd8d7af604da21116c1b3701363bfd0b6dc389f714c562be8
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-1d679bf075bd4e1cd8d7af604da21116c1b3701363bfd0b6dc389f714c562be8
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-1d679bf075bd4e1cd8d7af604da21116c1b3701363bfd0b6dc389f714c562be8
internal-packages/run-store/src/types.tshttps://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-3b72267802fbd082b93adb08e3e014e75f40eb755c8a4f14bd7a76148f49ffe8
View file https://github.com/triggerdotdev/trigger.dev/blob/bd6a442d88d0c658e68b4fb48473b40c822fe738/internal-packages/run-store/src/types.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/triggerdotdev/trigger.dev/pull/4255/{{ revealButtonHref }}
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-3b72267802fbd082b93adb08e3e014e75f40eb755c8a4f14bd7a76148f49ffe8
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-3b72267802fbd082b93adb08e3e014e75f40eb755c8a4f14bd7a76148f49ffe8
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-3b72267802fbd082b93adb08e3e014e75f40eb755c8a4f14bd7a76148f49ffe8
https://github.com/triggerdotdev/trigger.dev/pull/4255/files#diff-3b72267802fbd082b93adb08e3e014e75f40eb755c8a4f14bd7a76148f49ffe8
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.