René's URL Explorer Experiment


Title: perf: cut database transfer for CMS content by 6-7x by ysamcode · Pull Request #675 · ycode/ycode · GitHub

Open Graph Title: perf: cut database transfer for CMS content by 6-7x by ysamcode · Pull Request #675 · ycode/ycode

X Title: perf: cut database transfer for CMS content by 6-7x by ysamcode · Pull Request #675 · ycode/ycode

Description: Summary Every CMS value read (getValuesByItemIds — used by page rendering, dynamic pages, the builder, imports and publishing) fetched rows over the raw Postgres connection, which has no compression. A new SQL function returns the same data as one JSON object through PostgREST, which gzips it in transit. On real data this is 6–7x fewer bytes and faster, with byte-identical results. Follows #673 and #674. Changes Add migration creating get_collection_item_values(item_ids, is_published, field_ids) returning { item_id: { field_id: value } } (executable by service_role only, idempotent) Make getValuesByItemIds call the function via supabase.rpc() first; keep the direct-DB and chunked PostgREST paths as fallbacks Remember when the function is missing (migration not run yet) so later calls skip the failing round-trip until restart Measurements (staging site, 1,842 items) Read Direct DB (before) RPC gzipped (after) All values, all items (41k rows) ~9.8 MB, 4.3 s 1.7 MB, 1.3 s 3 fields, all items (1k rows) ~101 KB 15 KB Output compared equal for every item in all three cases (draft, published, field-filtered). Deployment note Run migrations before or with the deploy. Until the function exists the code falls back to the previous query, so ordering is safe either way. Test plan Run npm run migrate:latest; confirm get_collection_item_values exists Render a page with collection lists and a dynamic page — same content as before Builder CMS table loads items and values; editing/publishing an item works Drop the function locally and confirm pages still render (fallback path, one warning-free miss) npm test passes (328 tests) Made with Cursor

Open Graph Description: Summary Every CMS value read (getValuesByItemIds — used by page rendering, dynamic pages, the builder, imports and publishing) fetched rows over the raw Postgres connection, which has no compressio...

X Description: Summary Every CMS value read (getValuesByItemIds — used by page rendering, dynamic pages, the builder, imports and publishing) fetched rows over the raw Postgres connection, which has no compressio...

Opengraph URL: https://github.com/ycode/ycode/pull/675

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:ec296059-e387-8ca8-bd50-d51a3003ab53
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idCDE2:308F56:234710:2E84CE:6AFE5988
html-safe-nonceab0335d6d80404f2a68aff9dc9d4f46e053062d7f649a02b811bb0acc1a59602
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDREUyOjMwOEY1NjoyMzQ3MTA6MkU4NENFOjZBRkU1OTg4IiwidmlzaXRvcl9pZCI6IjE3MjkyNDQ1NzQ5Mzg3MTY1NTIiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac62c0f9203384b3612197fe8e08ba1fc73ec9ab57cacfe8cd3060c06b04bcb764
hovercard-subject-tagpull_request:5170273707
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/ycode/ycode/pull/675/files
twitter:imagehttps://avatars.githubusercontent.com/u/7631193?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/7631193?s=400&v=4
og:image:altSummary Every CMS value read (getValuesByItemIds — used by page rendering, dynamic pages, the builder, imports and publishing) fetched rows over the raw Postgres connection, which has no compressio...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneb3c0f155eafc27e60db6e254d1ffff0e072e9ab3b4018a5ee518797c19d89f86
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/ycode/ycode git https://github.com/ycode/ycode.git
octolytics-dimension-user_id65892203
octolytics-dimension-user_loginycode
octolytics-dimension-repository_id1165452593
octolytics-dimension-repository_nwoycode/ycode
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id1165452593
octolytics-dimension-repository_network_root_nwoycode/ycode
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release4a10310af51a1bfffbedc4fd81cb582acf0cb0ff
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/ycode/ycode/pull/675/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fycode%2Fycode%2Fpull%2F675%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fycode%2Fycode%2Fpull%2F675%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=ycode%2Fycode
Reloadhttps://github.com/ycode/ycode/pull/675/files
Reloadhttps://github.com/ycode/ycode/pull/675/files
Reloadhttps://github.com/ycode/ycode/pull/675/files
ycodehttps://github.com/ycode
ycodehttps://github.com/ycode/ycode
Codehttps://github.com/ycode/ycode
Issues7 (7)https://github.com/ycode/ycode/issues
Pull requests1 (1)https://github.com/ycode/ycode/pulls
Discussionshttps://github.com/ycode/ycode/discussions
Actionshttps://github.com/ycode/ycode/actions
Projectshttps://github.com/ycode/ycode/projects
Security and quality1 (1)https://github.com/ycode/ycode/security
Insightshttps://github.com/ycode/ycode/insights
Sign up for GitHub https://github.com/signup?return_to=%2Fycode%2Fycode%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fycode%2Fycode%2Fissues%2Fnew%2Fchoose
ysamcodehttps://github.com/ysamcode
develophttps://github.com/ycode/ycode/tree/develop
perf/item-values-rpchttps://github.com/ycode/ycode/tree/perf/item-values-rpc
Conversation 0 https://github.com/ycode/ycode/pull/675
Commits 1 https://github.com/ycode/ycode/pull/675/commits
Checks 0 https://github.com/ycode/ycode/pull/675/checks
Files changed https://github.com/ycode/ycode/pull/675/files
Please reload this pagehttps://github.com/ycode/ycode/pull/675/files
perf: cut database transfer for CMS content by 6-7x https://github.com/ycode/ycode/pull/675/files#top
Show all changes 1 commit https://github.com/ycode/ycode/pull/675/files
4a06c13 perf: read collection item values through a gzipped RPC ysamcode Nov 5, 2026 https://github.com/ycode/ycode/pull/675/commits/4a06c13af83e795c76e280d795e8c9dbcab7ab24
Clear filters https://github.com/ycode/ycode/pull/675/files
Please reload this pagehttps://github.com/ycode/ycode/pull/675/files
Please reload this pagehttps://github.com/ycode/ycode/pull/675/files
20261105000001_add_get_collection_item_values_function.ts https://github.com/ycode/ycode/pull/675/files#diff-49ec2a533da65dad426db24769f8a0490838d393f0c49957a19f3bf431d4c5bb
collectionItemValueRepository.ts https://github.com/ycode/ycode/pull/675/files#diff-c0312f4a8df04e06b9c4a0c0ce1fcd4ae6804e84991063b6f73f36488af4125c
https://github.com/ycode/ycode/blob/develop/.github/CODEOWNERS#L1
database/migrations/20261105000001_add_get_collection_item_values_function.tshttps://github.com/ycode/ycode/pull/675/files#diff-49ec2a533da65dad426db24769f8a0490838d393f0c49957a19f3bf431d4c5bb
View file https://github.com/ycode/ycode/blob/4a06c13af83e795c76e280d795e8c9dbcab7ab24/database/migrations/20261105000001_add_get_collection_item_values_function.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/ycode/ycode/pull/675/{{ revealButtonHref }}
https://github.com/ycode/ycode/blob/develop/.github/CODEOWNERS#L1
lib/repositories/collectionItemValueRepository.tshttps://github.com/ycode/ycode/pull/675/files#diff-c0312f4a8df04e06b9c4a0c0ce1fcd4ae6804e84991063b6f73f36488af4125c
View file https://github.com/ycode/ycode/blob/4a06c13af83e795c76e280d795e8c9dbcab7ab24/lib/repositories/collectionItemValueRepository.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/ycode/ycode/pull/675/{{ revealButtonHref }}
https://github.com/ycode/ycode/pull/675/files#diff-c0312f4a8df04e06b9c4a0c0ce1fcd4ae6804e84991063b6f73f36488af4125c
https://github.com/ycode/ycode/pull/675/files#diff-c0312f4a8df04e06b9c4a0c0ce1fcd4ae6804e84991063b6f73f36488af4125c
https://github.com/ycode/ycode/pull/675/files#diff-c0312f4a8df04e06b9c4a0c0ce1fcd4ae6804e84991063b6f73f36488af4125c
https://github.com/ycode/ycode/pull/675/files#diff-c0312f4a8df04e06b9c4a0c0ce1fcd4ae6804e84991063b6f73f36488af4125c
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.