René's URL Explorer Experiment


Title: fix(connectors): stop hydration after rate limits by waleedlatif1 · Pull Request #7255 · simstudioai/sim · GitHub

Open Graph Title: fix(connectors): stop hydration after rate limits by waleedlatif1 · Pull Request #7255 · simstudioai/sim

X Title: fix(connectors): stop hydration after rate limits by waleedlatif1 · Pull Request #7255 · simstudioai/sim

Description: Summary stop deferred connector hydration after a structured upstream rate limit so later batches do not amplify one provider throttle into per-document failures preserve the typed provider error and retry delay for the existing connector backoff scheduler while leaving ordinary document failures isolated use GitHub’s documented object media type for file metadata and a byte-bounded raw blob stream for large content, surfacing non-404 failures and oversized blobs explicitly add connector and sync-engine regressions for the exact rate-limit, large-file, absence, permission, and byte-cap behaviors Testing bun run --cwd apps/sim test -- connectors/github/github.test.ts lib/knowledge/documents/utils.test.ts lib/knowledge/connectors/sync-engine.test.ts bun run --cwd apps/sim type-check bun run agent-stream-docs:generate bun run skills:sync bun run lint bun run apps/sim/scripts/check-block-registry.ts origin/staging bun run check:audits

Open Graph Description: Summary stop deferred connector hydration after a structured upstream rate limit so later batches do not amplify one provider throttle into per-document failures preserve the typed provider error ...

X Description: Summary stop deferred connector hydration after a structured upstream rate limit so later batches do not amplify one provider throttle into per-document failures preserve the typed provider error ...

Opengraph URL: https://github.com/simstudioai/sim/pull/7255

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:31fa2bc5-adb0-d379-e22a-e522cb10f40c
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idBE8E:3D53D8:19FABE5:2348874:6AFB89C5
html-safe-nonce89b64bf5625e6505a707c12e3144f1a28b8c9c25fc20abaf59c9a32eeb634e75
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCRThFOjNENTNEODoxOUZBQkU1OjIzNDg4NzQ6NkFGQjg5QzUiLCJ2aXNpdG9yX2lkIjoiODA5NDU1OTc1NzQzMzI3Njg2OSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmacfbb2890eea59b9b8f1a8d441b6e8a19108006b8bce56b405a083c5f8d72087eb
hovercard-subject-tagpull_request:4389629435
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/7255/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary stop deferred connector hydration after a structured upstream rate limit so later batches do not amplify one provider throttle into per-document failures preserve the typed provider error ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None9694464143465782ecae2a97650b2a2b0708d5c31c74f41ee86da57e315e2735
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release05d967182208691fc7f2e6af52e82fa7fabf6bd5
ui-targetcanary-2
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/7255/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F7255%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F7255%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/7255/files
Reloadhttps://github.com/simstudioai/sim/pull/7255/files
Reloadhttps://github.com/simstudioai/sim/pull/7255/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
codex/stop-connector-rate-limit-fanouthttps://github.com/simstudioai/sim/tree/codex/stop-connector-rate-limit-fanout
Conversation 16 https://github.com/simstudioai/sim/pull/7255
Commits 3 https://github.com/simstudioai/sim/pull/7255/commits
Checks 27 https://github.com/simstudioai/sim/pull/7255/checks
Files changed https://github.com/simstudioai/sim/pull/7255/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7255/files
fix(connectors): stop hydration after rate limits https://github.com/simstudioai/sim/pull/7255/files#top
Show all changes 3 commits https://github.com/simstudioai/sim/pull/7255/files
5b62952 fix(connectors): stop hydration after rate limits waleedlatif1 Aug 29, 2026 https://github.com/simstudioai/sim/pull/7255/commits/5b62952c14798679910e000b1535c8baafffe681
de451bf fix(connectors): normalize provider throttles waleedlatif1 Aug 29, 2026 https://github.com/simstudioai/sim/pull/7255/commits/de451bff964a42ea608440ee68e67cb5403d2768
c582e09 fix(connectors): inspect all drive error reasons waleedlatif1 Aug 29, 2026 https://github.com/simstudioai/sim/pull/7255/commits/c582e095e1cb86dcaface2a4274213c801dcf83c
Clear filters https://github.com/simstudioai/sim/pull/7255/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7255/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7255/files
github.test.ts https://github.com/simstudioai/sim/pull/7255/files#diff-7c757751b8454f44b8866322ad7f29a0276ba1307d1e1e62464a24a89b5f0fd8
github.ts https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
google-drive-errors.ts https://github.com/simstudioai/sim/pull/7255/files#diff-b16e8134ce4d7afb56c4c65bd11c4e88174355bbd5d50905bb09a0ad3d795df9
google-drive.test.ts https://github.com/simstudioai/sim/pull/7255/files#diff-85817908f98112923f415de954345df320723512bebc138b313f59afba839ca3
sync-engine.test.ts https://github.com/simstudioai/sim/pull/7255/files#diff-021afebf7e100833ecdc940e307263436964ce85ef3dfd40fc90307a1d115534
sync-engine.ts https://github.com/simstudioai/sim/pull/7255/files#diff-277f76464f02682e44e6de58ebd215c927f0f6a3a7165af669a0717b593790e9
utils.test.ts https://github.com/simstudioai/sim/pull/7255/files#diff-9c304be25623200be4e947db1907c03c79b289adaf4cb34e57b7c80d2aae5b0b
utils.ts https://github.com/simstudioai/sim/pull/7255/files#diff-94a5318c859361a50ad73b5ea07e35e594a315dd6be5288b97489301c434addb
apps/sim/connectors/github/github.test.tshttps://github.com/simstudioai/sim/pull/7255/files#diff-7c757751b8454f44b8866322ad7f29a0276ba1307d1e1e62464a24a89b5f0fd8
View file https://github.com/simstudioai/sim/blob/c582e095e1cb86dcaface2a4274213c801dcf83c/apps/sim/connectors/github/github.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7255/{{ revealButtonHref }}
apps/sim/connectors/github/github.tshttps://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
View file https://github.com/simstudioai/sim/blob/c582e095e1cb86dcaface2a4274213c801dcf83c/apps/sim/connectors/github/github.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7255/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
Please reload this pagehttps://github.com/simstudioai/sim/pull/7255/files
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
https://github.com/simstudioai/sim/pull/7255/files#diff-568e3e321373fb7709612cdf0818a435418300d87fee10988cb65094cf048613
apps/sim/connectors/google-drive/google-drive-errors.tshttps://github.com/simstudioai/sim/pull/7255/files#diff-b16e8134ce4d7afb56c4c65bd11c4e88174355bbd5d50905bb09a0ad3d795df9
View file https://github.com/simstudioai/sim/blob/c582e095e1cb86dcaface2a4274213c801dcf83c/apps/sim/connectors/google-drive/google-drive-errors.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7255/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7255/files#diff-b16e8134ce4d7afb56c4c65bd11c4e88174355bbd5d50905bb09a0ad3d795df9
https://github.com/simstudioai/sim/pull/7255/files#diff-b16e8134ce4d7afb56c4c65bd11c4e88174355bbd5d50905bb09a0ad3d795df9
https://github.com/simstudioai/sim/pull/7255/files#diff-b16e8134ce4d7afb56c4c65bd11c4e88174355bbd5d50905bb09a0ad3d795df9
https://github.com/simstudioai/sim/pull/7255/files#diff-b16e8134ce4d7afb56c4c65bd11c4e88174355bbd5d50905bb09a0ad3d795df9
apps/sim/connectors/google-drive/google-drive.test.tshttps://github.com/simstudioai/sim/pull/7255/files#diff-85817908f98112923f415de954345df320723512bebc138b313f59afba839ca3
View file https://github.com/simstudioai/sim/blob/c582e095e1cb86dcaface2a4274213c801dcf83c/apps/sim/connectors/google-drive/google-drive.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7255/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7255/files#diff-85817908f98112923f415de954345df320723512bebc138b313f59afba839ca3
https://github.com/simstudioai/sim/pull/7255/files#diff-85817908f98112923f415de954345df320723512bebc138b313f59afba839ca3
Please reload this pagehttps://github.com/simstudioai/sim/pull/7255/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7255/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.