René's URL Explorer Experiment


Title: perf(db): optimize recurring query paths by waleedlatif1 · Pull Request #7014 · simstudioai/sim · GitHub

Open Graph Title: perf(db): optimize recurring query paths by waleedlatif1 · Pull Request #7014 · simstudioai/sim

X Title: perf(db): optimize recurring query paths by waleedlatif1 · Pull Request #7014 · simstudioai/sim

Description: Summary replace offset-based log export pagination with deterministic keyset reads and bounded streaming hydration combine related billing aggregates and batch repeated workspace and custom-block reads add query-shape-matched online indexes, remove catalog-identical redundant indexes, and tune maintenance thresholds for an append-heavy ledger These changes preserve existing authorization, filtering, ordering, aggregation, and response contracts. Index changes intentionally balance targeted read improvements against their write and storage cost. Type of Change Improvement Testing focused regression suites for logs, billing, knowledge, custom blocks, VFS, and workspaces bun run type-check bun run lint bun run check:audits bun run check:migrations origin/staging Drizzle schema and migration integrity checks Checklist Code follows project style guidelines Self-reviewed the changes Tests were added or updated and pass No new warnings were introduced Database changes use one new backward-compatible migration

Open Graph Description: Summary replace offset-based log export pagination with deterministic keyset reads and bounded streaming hydration combine related billing aggregates and batch repeated workspace and custom-block ...

X Description: Summary replace offset-based log export pagination with deterministic keyset reads and bounded streaming hydration combine related billing aggregates and batch repeated workspace and custom-block ...

Opengraph URL: https://github.com/simstudioai/sim/pull/7014

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:a6a42bc5-a570-edc4-2ab4-789db50232f2
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idE108:B85F4:E4C30A:138E807:6AFB5C6C
html-safe-nonce8c9d30f685339403092c5cd98326ecad873569f430774422847a29bc77f2daa0
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFMTA4OkI4NUY0OkU0QzMwQToxMzhFODA3OjZBRkI1QzZDIiwidmlzaXRvcl9pZCI6Ijg3MTU3ODUyMzU4NzU5NzgzNDgiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac129b7493b45dfbe0b8a75105f4e8f9a30032870b5752aadd365f9e696d740644
hovercard-subject-tagpull_request:4343132058
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/7014/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary replace offset-based log export pagination with deterministic keyset reads and bounded streaming hydration combine related billing aggregates and batch repeated workspace and custom-block ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneea33d13c96d0ff66bd8fa906b193d2213536b78cb06b0c50a4632c58b1418f94
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release59ef97164c52cf59bd10558ddec9c4f482763988
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/7014/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F7014%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F7014%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/7014/files
Reloadhttps://github.com/simstudioai/sim/pull/7014/files
Reloadhttps://github.com/simstudioai/sim/pull/7014/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
codex/db-query-performancehttps://github.com/simstudioai/sim/tree/codex/db-query-performance
Conversation 19 https://github.com/simstudioai/sim/pull/7014
Commits 5 https://github.com/simstudioai/sim/pull/7014/commits
Checks 30 https://github.com/simstudioai/sim/pull/7014/checks
Files changed https://github.com/simstudioai/sim/pull/7014/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7014/files
perf(db): optimize recurring query paths https://github.com/simstudioai/sim/pull/7014/files#top
Show all changes 5 commits https://github.com/simstudioai/sim/pull/7014/files
3367f44 perf(db): optimize recurring query paths waleedlatif1 Aug 23, 2026 https://github.com/simstudioai/sim/pull/7014/commits/3367f4498fc64e6f98059d81b53d4092aeba043f
ef57fcb perf(logs): batch keyset export reads waleedlatif1 Aug 23, 2026 https://github.com/simstudioai/sim/pull/7014/commits/ef57fcb5f576b25d4dedd9555060156f4a0eb1ac
ff7c610 fix(workspaces): type nullable member count targets waleedlatif1 Aug 23, 2026 https://github.com/simstudioai/sim/pull/7014/commits/ff7c6104dab63607529580658a233fd950b4c93a
3ca60d2 fix(db): harden query performance changes waleedlatif1 Aug 23, 2026 https://github.com/simstudioai/sim/pull/7014/commits/3ca60d256d80cc70909024123465863f602d8adb
72eb8b6 fix(logs): guard export stream cancellation waleedlatif1 Aug 23, 2026 https://github.com/simstudioai/sim/pull/7014/commits/72eb8b6378b09352e4a02683957b1f4f444aa80f
Clear filters https://github.com/simstudioai/sim/pull/7014/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7014/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7014/files
route.test.ts https://github.com/simstudioai/sim/pull/7014/files#diff-41bd5c3baa4d15e80d8330fe6ce8841e7b9126da0e8f8e55385ae57408071eb2
route.ts https://github.com/simstudioai/sim/pull/7014/files#diff-b5b53a0f4584e8d218f789bf4953b1924cb6746c148189c9114a9009b6f4b159
usage-monitor.test.ts https://github.com/simstudioai/sim/pull/7014/files#diff-ccc1372b58f250bc7662d09f888006a56be80ac2855f61612ec6554a5b511ea7
usage-monitor.ts https://github.com/simstudioai/sim/pull/7014/files#diff-952d682fdab349d4e9744b11be30f9f96f0396201f6f3c936e2054e387136537
daily-refresh.test.ts https://github.com/simstudioai/sim/pull/7014/files#diff-fe70bb3b48551ec48e3c087bfc556c283f125b3c998e63e821b6b142432f4768
daily-refresh.ts https://github.com/simstudioai/sim/pull/7014/files#diff-8bf3828d314ee198de779b19aa5d48a88ec28efb76b2dcbb37f97d312e33fc2d
workspace-vfs.test.ts https://github.com/simstudioai/sim/pull/7014/files#diff-9a32d4d367729abc182ea9e45849f3fd1808c865930f8a9544c0882baebefc7f
workspace-vfs.ts https://github.com/simstudioai/sim/pull/7014/files#diff-8e6937a8dfe45385ece110f82c25b4371a1ecb90dd552ef0a523e29201ad858b
service.ts https://github.com/simstudioai/sim/pull/7014/files#diff-6978b26968fd05cf5c7635c366c8c806693b6145235f476627302fb402f32d18
operations.test.ts https://github.com/simstudioai/sim/pull/7014/files#diff-b9013e878621fc541ef80bd37ebb16ae747113da48fff4b2fa6cbe370cca5df5
operations.ts https://github.com/simstudioai/sim/pull/7014/files#diff-62275746551c533d2f1fde5464bc8e91f8884813163e90d8a4c9e905c9ffa44f
list-public-workspaces.test.ts https://github.com/simstudioai/sim/pull/7014/files#diff-53e6640e3bb66e43c00504d7fbbedfb39baca6b5240bf592dc9081277fca8e8d
list-public-workspaces.ts https://github.com/simstudioai/sim/pull/7014/files#diff-ff59bb115843acb64018fd92ad91e8d6a7dc8ffaeb30434c9e1d181193d9db15
public-queries.test.ts https://github.com/simstudioai/sim/pull/7014/files#diff-e7ac9a7d405a91f1918cd1330561226eaa8b2f0971e2e91796b94907947888b0
public-queries.ts https://github.com/simstudioai/sim/pull/7014/files#diff-5e5715fe7f199576b89beac2dc5078cb5d66adbc9453bd912e651321374a1e3d
0303_colorful_gressill.sql https://github.com/simstudioai/sim/pull/7014/files#diff-673ddaba404813e387d952669ed421ac96a3e4ba20f3b4d70b532c5014d40f4d
0303_snapshot.json https://github.com/simstudioai/sim/pull/7014/files#diff-33d5c7ba913ef736a3785eddd6b538bf88dc8554fd2c6dfc990b2fae03eeb4a1
_journal.json https://github.com/simstudioai/sim/pull/7014/files#diff-37150cc65ad16ee6fbc5fa318fc096be7730e16d63eaf863e3df5521b7030649
schema.ts https://github.com/simstudioai/sim/pull/7014/files#diff-9a959e2ce3cb4c86957bbae021d06eae364f7b0cb18964f5873bab53220af928
schema.mock.ts https://github.com/simstudioai/sim/pull/7014/files#diff-3b648ee44a059e5fc069169fdfd7c32c89200a3e79b5d0dc25227d3470da73af
apps/sim/app/api/logs/export/route.test.tshttps://github.com/simstudioai/sim/pull/7014/files#diff-41bd5c3baa4d15e80d8330fe6ce8841e7b9126da0e8f8e55385ae57408071eb2
View file https://github.com/simstudioai/sim/blob/72eb8b6378b09352e4a02683957b1f4f444aa80f/apps/sim/app/api/logs/export/route.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7014/{{ revealButtonHref }}
Please reload this pagehttps://github.com/simstudioai/sim/pull/7014/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7014/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.