René's URL Explorer Experiment


Title: fix(search): read the full text of Slack canvases and files instead of the preview by waleedlatif1 · Pull Request #10082 · simstudioai/sim · GitHub

Open Graph Title: fix(search): read the full text of Slack canvases and files instead of the preview by waleedlatif1 · Pull Request #10082 · simstudioai/sim

X Title: fix(search): read the full text of Slack canvases and files instead of the preview by waleedlatif1 · Pull Request #10082 · simstudioai/sim

Description: Summary Reading a Slack file returned only Slack's short preview (or just the title), while search returned the file's text, so a model that found the right canvas or doc got almost nothing when it opened it Slack file reads now download the full text from Slack's file host: canvases as HTML (converted to text), snippets and text files as text, PDF and DOCX through the same extraction Drive uses The token only goes to files.slack.com, never a remote file's own URL; the client's sibling-host option (previously Sheets-only) now covers both, each locked to its own provider origin Text decodes strictly in its byte-order mark or declared charset (UTF-8 otherwise); bytes that do not decode keep the preview Bounded: per-format download caps, 1 MiB of extracted text, and a 5s download limit so a slow file host can't use up the read deadline Anything short of a caller abort (denial, redirect, size limit, unreadable bytes, timeout) keeps today's preview, plus the provider's reason when it gave one, and records a slack.file_preview diagnostic signal on every read that returns the preview PDF/DOCX extraction moved from drive-content.ts into shared file-text.ts; Drive behavior is unchanged No new Slack scopes: downloads use the existing files:read grant Type of Change Bug fix Testing New slack.test.ts: canvas, text, PDF full-text reads; token never leaves Slack's file host (foreign host, http:, external file); preview + reason on denial, redirect, timeout; caller abort propagates; oversize and unsupported files skip the download; MIME parameters/case normalized. Each guard reverted and watched go red. http.test.ts: sibling hosts only reachable from their own provider origin lib/sim-search/live + lib/knowledge/search suites pass; biome; egress-boundary, organization-egress, boundaries, comment-hygiene, file-names, explicit-any, utils, test-patterns, import-specifiers, source-text audits pass Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing (new tests pass the test-audit authoring gate) No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

Open Graph Description: Summary Reading a Slack file returned only Slack's short preview (or just the title), while search returned the file's text, so a model that found the right canvas or doc got almost nothin...

X Description: Summary Reading a Slack file returned only Slack's short preview (or just the title), while search returned the file's text, so a model that found the right canvas or doc got almos...

Opengraph URL: https://github.com/simstudioai/sim/pull/10082

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:e966635b-e60c-332d-94d7-0686664e8788
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-id940A:296553:3F59D6:56837C:6AFB9A25
html-safe-nonced5d6d7c456b85ad81126ef355b56bb73c1e61b224451aefea5df78b238503bb2
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5NDBBOjI5NjU1MzozRjU5RDY6NTY4MzdDOjZBRkI5QTI1IiwidmlzaXRvcl9pZCI6IjY0NzU4NDY5Mjc4NjEzODk4NjEiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac92f0dff7f8be22fefb42654ae75df043ebf086bfd47362f5395a6925d61ee1e6
hovercard-subject-tagpull_request:5331592732
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/10082/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary Reading a Slack file returned only Slack's short preview (or just the title), while search returned the file's text, so a model that found the right canvas or doc got almost nothin...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None3cefd19a936819d82cfb5279d50fb56fe79cb9ec30f0f807e04e89b0c58ffae1
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release606800bdb1b81d125fc845bdcc262c9fe063fc8f
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/10082/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F10082%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F10082%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/10082/files
Reloadhttps://github.com/simstudioai/sim/pull/10082/files
Reloadhttps://github.com/simstudioai/sim/pull/10082/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests199 (199)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
fix/slack-file-readhttps://github.com/simstudioai/sim/tree/fix/slack-file-read
Conversation 16 https://github.com/simstudioai/sim/pull/10082
Commits 3 https://github.com/simstudioai/sim/pull/10082/commits
Checks 81 https://github.com/simstudioai/sim/pull/10082/checks
Files changed https://github.com/simstudioai/sim/pull/10082/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/10082/files
fix(search): read the full text of Slack canvases and files instead of the preview https://github.com/simstudioai/sim/pull/10082/files#top
Show all changes 3 commits https://github.com/simstudioai/sim/pull/10082/files
97af1ad fix(search): read the full text of Slack canvases and files instead o… waleedlatif1 Nov 16, 2026 https://github.com/simstudioai/sim/pull/10082/commits/97af1ada5d83d874b8386178ff42e5aaa1bad394
fa4fbbe fix(search): decode Slack text files in their charset and count every… waleedlatif1 Nov 16, 2026 https://github.com/simstudioai/sim/pull/10082/commits/fa4fbbea34141fdb81414baf4e167526b94b122b
95a9ead fix(search): let a UTF-8 byte-order mark override a declared charset waleedlatif1 Nov 16, 2026 https://github.com/simstudioai/sim/pull/10082/commits/95a9eadb4ba1d95444e894fe2c3fb996127457e8
Clear filters https://github.com/simstudioai/sim/pull/10082/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/10082/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/10082/files
diagnostics.ts https://github.com/simstudioai/sim/pull/10082/files#diff-454cb97c4d1f9ca41cc9ec69e41039731b15cf7250ff59d784f19495ea0caea6
README.md https://github.com/simstudioai/sim/pull/10082/files#diff-19572bf4479f2bc12cbad3de0512e7d2df1562e071af8aa5229541589fb25cc9
drive-content.ts https://github.com/simstudioai/sim/pull/10082/files#diff-4ffa88449578b2dd54d85c36bc5d1da381d8feb62ec09cdea0e26ea5377ad157
file-text.ts https://github.com/simstudioai/sim/pull/10082/files#diff-c9cc6a10a3d27ed22e183a8bb270baa0db29d10105dff76632b2c6a6c5fed389
google.ts https://github.com/simstudioai/sim/pull/10082/files#diff-20db91c07a8997154a33fb052fa22750f72177676fd7d30f112342da91e3bd32
http.test.ts https://github.com/simstudioai/sim/pull/10082/files#diff-d28b55c3fe2736c2de5e2cd5b01dc7ecc3a2cc730b757f59e8d0b63a47568395
http.ts https://github.com/simstudioai/sim/pull/10082/files#diff-db05fa39c3e2fd0f48efd209b627af77b955e94f9ee317f45173cbfe5d3211ec
providers.ts https://github.com/simstudioai/sim/pull/10082/files#diff-ad549d3c28ef3182ec60f5ca78dc79e21da5ff0c852a532bdd79821a2021e681
slack.test.ts https://github.com/simstudioai/sim/pull/10082/files#diff-8225478c047adb9860167baba5e3de4b48ceab6b3cfac35178f9730a2305fdf1
slack.ts https://github.com/simstudioai/sim/pull/10082/files#diff-afa4927cf22f4ebe11d8e6b450eae81d91ccd55b52190a3b547e339c45d57fc7
types.ts https://github.com/simstudioai/sim/pull/10082/files#diff-903e1809d21028703feb5eb49052c958edeeabadd974153ef4c027b103fbe795
apps/sim/lib/knowledge/search/diagnostics.tshttps://github.com/simstudioai/sim/pull/10082/files#diff-454cb97c4d1f9ca41cc9ec69e41039731b15cf7250ff59d784f19495ea0caea6
View file https://github.com/simstudioai/sim/blob/95a9eadb4ba1d95444e894fe2c3fb996127457e8/apps/sim/lib/knowledge/search/diagnostics.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/10082/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/10082/files#diff-454cb97c4d1f9ca41cc9ec69e41039731b15cf7250ff59d784f19495ea0caea6
https://github.com/simstudioai/sim/pull/10082/files#diff-454cb97c4d1f9ca41cc9ec69e41039731b15cf7250ff59d784f19495ea0caea6
apps/sim/lib/sim-search/live/README.mdhttps://github.com/simstudioai/sim/pull/10082/files#diff-19572bf4479f2bc12cbad3de0512e7d2df1562e071af8aa5229541589fb25cc9
View file https://github.com/simstudioai/sim/blob/95a9eadb4ba1d95444e894fe2c3fb996127457e8/apps/sim/lib/sim-search/live/README.md
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/10082/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/10082/files#diff-19572bf4479f2bc12cbad3de0512e7d2df1562e071af8aa5229541589fb25cc9
https://github.com/simstudioai/sim/pull/10082/files#diff-19572bf4479f2bc12cbad3de0512e7d2df1562e071af8aa5229541589fb25cc9
https://github.com/simstudioai/sim/pull/10082/files#diff-19572bf4479f2bc12cbad3de0512e7d2df1562e071af8aa5229541589fb25cc9
https://github.com/simstudioai/sim/pull/10082/files#diff-19572bf4479f2bc12cbad3de0512e7d2df1562e071af8aa5229541589fb25cc9
apps/sim/lib/sim-search/live/drive-content.tshttps://github.com/simstudioai/sim/pull/10082/files#diff-4ffa88449578b2dd54d85c36bc5d1da381d8feb62ec09cdea0e26ea5377ad157
View file https://github.com/simstudioai/sim/blob/95a9eadb4ba1d95444e894fe2c3fb996127457e8/apps/sim/lib/sim-search/live/drive-content.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/10082/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/10082/files#diff-4ffa88449578b2dd54d85c36bc5d1da381d8feb62ec09cdea0e26ea5377ad157
https://github.com/simstudioai/sim/pull/10082/files#diff-4ffa88449578b2dd54d85c36bc5d1da381d8feb62ec09cdea0e26ea5377ad157
https://github.com/simstudioai/sim/pull/10082/files#diff-4ffa88449578b2dd54d85c36bc5d1da381d8feb62ec09cdea0e26ea5377ad157
apps/sim/lib/sim-search/live/file-text.tshttps://github.com/simstudioai/sim/pull/10082/files#diff-c9cc6a10a3d27ed22e183a8bb270baa0db29d10105dff76632b2c6a6c5fed389
View file https://github.com/simstudioai/sim/blob/95a9eadb4ba1d95444e894fe2c3fb996127457e8/apps/sim/lib/sim-search/live/file-text.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/10082/{{ revealButtonHref }}
apps/sim/lib/sim-search/live/google.tshttps://github.com/simstudioai/sim/pull/10082/files#diff-20db91c07a8997154a33fb052fa22750f72177676fd7d30f112342da91e3bd32
View file https://github.com/simstudioai/sim/blob/95a9eadb4ba1d95444e894fe2c3fb996127457e8/apps/sim/lib/sim-search/live/google.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/10082/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/10082/files#diff-20db91c07a8997154a33fb052fa22750f72177676fd7d30f112342da91e3bd32
https://github.com/simstudioai/sim/pull/10082/files#diff-20db91c07a8997154a33fb052fa22750f72177676fd7d30f112342da91e3bd32
apps/sim/lib/sim-search/live/http.test.tshttps://github.com/simstudioai/sim/pull/10082/files#diff-d28b55c3fe2736c2de5e2cd5b01dc7ecc3a2cc730b757f59e8d0b63a47568395
View file https://github.com/simstudioai/sim/blob/95a9eadb4ba1d95444e894fe2c3fb996127457e8/apps/sim/lib/sim-search/live/http.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/10082/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/10082/files#diff-d28b55c3fe2736c2de5e2cd5b01dc7ecc3a2cc730b757f59e8d0b63a47568395
https://github.com/simstudioai/sim/pull/10082/files#diff-d28b55c3fe2736c2de5e2cd5b01dc7ecc3a2cc730b757f59e8d0b63a47568395
Please reload this pagehttps://github.com/simstudioai/sim/pull/10082/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/10082/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.