Title: fix(webapp): propagate abort signal through realtime proxy fetch by ericallam · Pull Request #3442 · triggerdotdev/trigger.dev · GitHub
Open Graph Title: fix(webapp): propagate abort signal through realtime proxy fetch by ericallam · Pull Request #3442 · triggerdotdev/trigger.dev
X Title: fix(webapp): propagate abort signal through realtime proxy fetch by ericallam · Pull Request #3442 · triggerdotdev/trigger.dev
Description: Summary Fixes an RSS-only memory leak in the three realtime proxy routes (/realtime/v1/runs, /realtime/v1/runs/:id, /realtime/v1/batches/:id). Client disconnects during an in-flight long-poll would leave the upstream fetch to Electric running with no way to abort it, so undici kept the socket open and buffered response chunks that would never be consumed. Root cause All three routes flow through RealtimeClient.streamRun/streamRuns/streamBatch → #streamRunsWhere → #performElectricRequest → longPollingFetch(url, { signal }). The chain was already signal-aware, but #streamRunsWhere hardcoded signal=undefined when calling #performElectricRequest, so no signal ever reached longPollingFetch. When a downstream client aborts a long-poll mid-flight: Express tears down the downstream response socket. The longPollingFetch promise has already resolved (it returns as soon as upstream headers arrive) and handed back new Response(upstream.body, {...}). undici keeps the upstream socket open and continues buffering chunks into the ReadableStream that nothing will ever read from. The upstream connection is eventually closed by Electric's own poll timeout (~20s). During that window the per-request buffers stay in native memory. These buffers live below V8's accounting — no heapUsed or external growth, no sign in heap snapshots, only RSS. An isolated standalone reproducer (fetch against a slow-streaming upstream, discard the Response before consuming its body) measures ~44 KB retained per leaked request after GC. That's consistent with the undici socket + receive buffer + HTTP parser state for a long-lived chunked response. The pattern is the shape documented in nodejs/undici#1108 and #2143. What changed realtimeClient.server.ts — add optional signal parameter to streamRun, streamRuns, streamBatch, and the shared #streamRunsWhere; thread it through to #performElectricRequest instead of hardcoding undefined. realtime.v1.runs.$runId.ts, realtime.v1.runs.ts, realtime.v1.batches.$batchId.ts — pass getRequestAbortSignal() (from httpAsyncStorage.server.ts) at the call site. This is the signal wired to res.on('close') and fires reliably on downstream disconnect. longPollingFetch.ts — belt-and-suspenders: cancel the upstream body explicitly in the error path, and treat AbortError as a clean 499 instead of a 500. This both releases undici's buffers deterministically on error and avoids spurious 500s in request logs when a client legitimately walks away. Verification Standalone reproducer: slow upstream server streams 32 KB chunks every 100 ms for 5 seconds per request. The proxy does fetch(url) with varying signal/cancel strategies, creates new Response(upstream.body, ...), and discards it without consuming the body (simulating the leak path). Results from 1 000 parallel fetches per variant, measured post-GC: variant Δ heap Δ external Δ RSS A. no signal, body never consumed (the bug) +0.3 MB 0 MB +59.4 MB B. signal propagated, aborted after headers (this fix) −0.1 MB 0 MB +15.4 MB C. no signal, explicit res.body.cancel() 0 MB 0 MB −25.4 MB 10-round sustained test of variant B to distinguish accumulating retention from one-time allocator overhead: round 1/10 Δ=+3.2 MB round 6/10 Δ=-12.5 MB round 2/10 Δ=-7.6 MB round 7/10 Δ=-11.9 MB round 3/10 Δ=-11.7 MB round 8/10 Δ=-2.6 MB round 4/10 Δ=+3.2 MB round 9/10 Δ=-8.0 MB round 5/10 Δ=-1.2 MB round 10/10 Δ=-12.6 MB RSS oscillates in a 49-65 MB band with no upward trend — signal propagation fully releases the buffers. Risk Behavior change only on aborted long-polls: the upstream fetch now cancels promptly instead of running to its natural timeout. This saves both memory and outbound traffic to Electric. AbortError now surfaces as 499 rather than 500. Any dashboard or alert that counts 500s in request logs will see slightly fewer of them; this is the intended behavior. Signal-aware parameter is optional on RealtimeClient.streamRun/streamRuns/streamBatch, so callers that don't opt in get the previous behavior. Test plan Existing realtime integration tests pass Dashboard realtime views (runs list, batch details) continue working normally across tab open/close cycles Under a burst of aborted long-polls, server RSS returns to baseline rather than climbing
Open Graph Description: Summary Fixes an RSS-only memory leak in the three realtime proxy routes (/realtime/v1/runs, /realtime/v1/runs/:id, /realtime/v1/batches/:id). Client disconnects during an in-flight long-poll would...
X Description: Summary Fixes an RSS-only memory leak in the three realtime proxy routes (/realtime/v1/runs, /realtime/v1/runs/:id, /realtime/v1/batches/:id). Client disconnects during an in-flight long-poll would...
Opengraph URL: https://github.com/triggerdotdev/trigger.dev/pull/3442
X: @github
Domain: github.com
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf |
| route-pattern | /:user_id/:repository/pull/:id/files(.:format) |
| route-controller | pull_requests |
| route-action | files |
| fetch-nonce | v2:3fa23d13-30ed-66f0-ad85-094abc99f650 |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | 8B9A:171254:59A0DA:84CFBE:6AFAED46 |
| html-safe-nonce | 846ec2ed8da66fd66cc0cc78c8ca3759c4d24928395e9c26e3fea4bad7ac1779 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4QjlBOjE3MTI1NDo1OUEwREE6ODRDRkJFOjZBRkFFRDQ2IiwidmlzaXRvcl9pZCI6IjYwMzQxODU2NTI1ODMxOTgwMjIiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 5ce84f41a139536fe81f2ee565070ec13da75a3e3085ee97c7b9ec59e67a9d0f |
| hovercard-subject-tag | pull_request:3579521373 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/triggerdotdev/trigger.dev/pull/3442/files |
| twitter:image | https://avatars.githubusercontent.com/u/534?s=400&v=4 |
| twitter:card | summary_large_image |
| og:image | https://avatars.githubusercontent.com/u/534?s=400&v=4 |
| og:image:alt | Summary Fixes an RSS-only memory leak in the three realtime proxy routes (/realtime/v1/runs, /realtime/v1/runs/:id, /realtime/v1/batches/:id). Client disconnects during an in-flight long-poll would... |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 0178036d8230524a18422872393ab7e708443ae4c2047f758560a2db870c1913 |
| turbo-cache-control | no-preview |
| diff-view | unified |
| go-import | github.com/triggerdotdev/trigger.dev git https://github.com/triggerdotdev/trigger.dev.git |
| octolytics-dimension-user_id | 95297378 |
| octolytics-dimension-user_login | triggerdotdev |
| octolytics-dimension-repository_id | 572570113 |
| octolytics-dimension-repository_nwo | triggerdotdev/trigger.dev |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 572570113 |
| octolytics-dimension-repository_network_root_nwo | triggerdotdev/trigger.dev |
| turbo-body-classes | logged-out env-production page-responsive full-width |
| disable-turbo | true |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 12fff95459b24b0f882a66698ee6a36a5934d247 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width