René's URL Explorer Experiment


Title: feat(knowledge): crawl Slack per member on Sim Search through each person's own Slack user token by waleedlatif1 · Pull Request #7421 · simstudioai/sim · GitHub

Open Graph Title: feat(knowledge): crawl Slack per member on Sim Search through each person's own Slack user token by waleedlatif1 · Pull Request #7421 · simstudioai/sim

X Title: feat(knowledge): crawl Slack per member on Sim Search through each person's own Slack user token by waleedlatif1 · Pull Request #7421 · simstudioai/sim

Description: Summary Slack joins the per-member Sources on Sim Search. Credential Group enrollment already issues each person their own Slack user token through the workspace's custom Slack app, and conversations.list under that token returns exactly the public channels and the private channels they belong to, so the existing members engine crawls Slack the same way it crawls Gmail and Google Chat: each member's listing is their access, and the reader token s:slack:: is derived from the same credential row on both sides. No new access mode, no bot crawl, no membership walk, no email matching. Slack's 2025 rate-limit change to conversations.history exempts internal customer-built apps, which is what a Credential Group's custom bot is, so a per-member crawl runs at full Tier 3 speed. The Slack connector now lists channels as deferred stubs: the transcript is fetched in getDocument, once per channel per run however many members list it, and hydrates five at a time under the shared 12 MiB text ceiling. With no channel configured it lists every readable channel through the cursor, which is what a members-mode crawl does (the channel selection is the listing cap). A channel listing carries no signal of new messages, so the stub hash is run-scoped and the real hash getDocument computes decides whether anything is re-indexed: an unchanged channel costs one history page and no embedding. Each channel document opens with a header naming the channel, its topic and its purpose, so an empty channel is a live document rather than a deletion, and the message count reports only the messages the transcript holds. The hash prefix moves to slack-v3 so channels indexed before the header and ceiling re-index once. The shared text accumulator now takes which end survives when a document reaches the ceiling. A mail thread keeps what came first, because its root message is the context; a chat transcript keeps what came last, so the newest messages are the ones people search for. Google Chat moves to the same rule, and both keep their pinned header with a note where text was left out. Members-mode scope validation goes through the Credential Group provider adapter instead of the managed OAuth policy registry, which had no Slack entry. The standard OAuth adapter's scope comparison now reads the provider's policy alone, so validating a saved option no longer needs the OAuth client configured. First connect from Sim Search cannot create a Slack Credential Group, since the option authorizes through the workspace's own Slack app that only an admin can configure in Settings: it adopts the one ready Slack option, and otherwise says what to set up. Options that are not configured yet are never adopted, for any provider. Type of Change New feature Testing New Slack connector suite: deferred stubs without history reads, all-channel listing with cursor paging and the public and private channel types, one stub per channel across members of a run, a new stub each run, the header and slack-v3 hash on hydration, an empty channel kept live, null only for a channel Slack no longer knows. Text accumulator: keeping the last records drops the oldest to fit, keeps the pinned header, refuses only a record too large on its own, and joins plainly when everything fits. Members-mode binding validation: a Slack option passes through the Slack scope policy, a channel selection is refused as a cap, a missing history scope is refused. Provisioning: adopts the one ready Slack option, points at Settings when none is ready, leaves two for the admin, and still creates a group for a standard OAuth provider. The cross-connector permission-scoped listing test now includes Slack and checks every connector's read scopes against its Credential Group adapter. Slack's conversations.history reference confirms user tokens read public channels they are not in, which the all-channel listing relies on. Type-check, lint, check:audits (45 audits), and the knowledge, credential-group, connector, and search suites (2,832 tests) pass. Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

Open Graph Description: Summary Slack joins the per-member Sources on Sim Search. Credential Group enrollment already issues each person their own Slack user token through the workspace's custom Slack app, and conver...

X Description: Summary Slack joins the per-member Sources on Sim Search. Credential Group enrollment already issues each person their own Slack user token through the workspace's custom Slack app, and co...

Opengraph URL: https://github.com/simstudioai/sim/pull/7421

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:b3a39ce0-5006-6723-2c8e-e8a9fd6115ef
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-id9F8A:22FE8E:6E49FA:9CB652:6AFB4690
html-safe-noncec71f89ad15ad4242554501997dce81c7d3d70e5b5acf04a2e0134496b22cdae1
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5RjhBOjIyRkU4RTo2RTQ5RkE6OUNCNjUyOjZBRkI0NjkwIiwidmlzaXRvcl9pZCI6IjQyOTI0NTc5MzMwODczOTM0MjQiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac379ed9dbded8cd8092fe79ce235443d383ed91aaf3cdbd1cc88406afa587bedd
hovercard-subject-tagpull_request:4427302681
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/7421/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary Slack joins the per-member Sources on Sim Search. Credential Group enrollment already issues each person their own Slack user token through the workspace's custom Slack app, and conver...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneacf7616d06cc051644705b379878c9bb13dc5e70ecf4ffd9b34140f8ac01d7e1
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release26504db649b58525278f77a52b80ba5f10d5f4de
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/7421/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F7421%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F7421%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/7421/files
Reloadhttps://github.com/simstudioai/sim/pull/7421/files
Reloadhttps://github.com/simstudioai/sim/pull/7421/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests199 (199)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
feat/slack-member-searchhttps://github.com/simstudioai/sim/tree/feat/slack-member-search
Conversation 16 https://github.com/simstudioai/sim/pull/7421
Commits 3 https://github.com/simstudioai/sim/pull/7421/commits
Checks 29 https://github.com/simstudioai/sim/pull/7421/checks
Files changed https://github.com/simstudioai/sim/pull/7421/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7421/files
feat(knowledge): crawl Slack per member on Sim Search through each person's own Slack user token https://github.com/simstudioai/sim/pull/7421/files#top
Show all changes 3 commits https://github.com/simstudioai/sim/pull/7421/files
9fc991a feat(knowledge): crawl Slack per member on Sim Search through each pe… waleedlatif1 Sep 2, 2026 https://github.com/simstudioai/sim/pull/7421/commits/9fc991a724b023d15efc50151fb56b617b7c81e8
d995615 fix(connectors): keep the newest messages when a chat transcript reac… waleedlatif1 Sep 2, 2026 https://github.com/simstudioai/sim/pull/7421/commits/d9956152d779f4d5f56ef200a30bdb8967706603
89bb7a0 fix(slack): fold the channel header into the content hash so a rename… waleedlatif1 Sep 2, 2026 https://github.com/simstudioai/sim/pull/7421/commits/89bb7a006b87b1b7700f07145a63930a116a315e
Clear filters https://github.com/simstudioai/sim/pull/7421/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7421/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7421/files
google-chat.ts https://github.com/simstudioai/sim/pull/7421/files#diff-ebbe3715bda19f447950c3463c68aa4c202b43c6046b2758cadb6d1edfe0cb29
permission-scoped-listing.test.ts https://github.com/simstudioai/sim/pull/7421/files#diff-44f979d405adcad580fc0c92ff4dc03f5fe938d133b45910830f039b5c364be6
meta.ts https://github.com/simstudioai/sim/pull/7421/files#diff-aa87126967901ad0d5d386303e55e59f54f9afe88d0a28d8149fa42e46303b5e
slack.test.ts https://github.com/simstudioai/sim/pull/7421/files#diff-e4691ffd81ad52bb42179f11f2fd0a4a2e3c4d753f21296d4ff41da24c7d503a
slack.ts https://github.com/simstudioai/sim/pull/7421/files#diff-148e7cb1c1964ac610d4691a00318e85c3240cf07e414729c4c876d07a151462
utils.test.ts https://github.com/simstudioai/sim/pull/7421/files#diff-2405bfb9d79e30136f8e29677391cd1f1164759188077003e27518634e26bbe9
utils.ts https://github.com/simstudioai/sim/pull/7421/files#diff-c27db14947d25b8915e236c873ccf485a2e0497266dde4f61bd295f93e7f3920
standard-oauth-provider.ts https://github.com/simstudioai/sim/pull/7421/files#diff-17101717df2510dee592f4579fa70379075f005a584721036d990c4136cd6813
member-access.test.ts https://github.com/simstudioai/sim/pull/7421/files#diff-ba48ecaaed454f74f5e234f288c7a263c6897b712b1be01beeb4b8387e1617d6
member-access.ts https://github.com/simstudioai/sim/pull/7421/files#diff-1e3288f4c5661bc86252708e80575a80689d3a258f188d429cf0c5205c1e38cc
member-provisioning.test.ts https://github.com/simstudioai/sim/pull/7421/files#diff-aa3789397ea33e02780dd44f760ba051a71704f02c15ede0bc5a62ed64466beb
member-provisioning.ts https://github.com/simstudioai/sim/pull/7421/files#diff-7c3af815dfcfa798139730245261d860c3e42c593d4feb879449b95f287d24c2
apps/sim/connectors/google-chat/google-chat.tshttps://github.com/simstudioai/sim/pull/7421/files#diff-ebbe3715bda19f447950c3463c68aa4c202b43c6046b2758cadb6d1edfe0cb29
View file https://github.com/simstudioai/sim/blob/89bb7a006b87b1b7700f07145a63930a116a315e/apps/sim/connectors/google-chat/google-chat.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7421/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7421/files#diff-ebbe3715bda19f447950c3463c68aa4c202b43c6046b2758cadb6d1edfe0cb29
https://github.com/simstudioai/sim/pull/7421/files#diff-ebbe3715bda19f447950c3463c68aa4c202b43c6046b2758cadb6d1edfe0cb29
apps/sim/connectors/permission-scoped-listing.test.tshttps://github.com/simstudioai/sim/pull/7421/files#diff-44f979d405adcad580fc0c92ff4dc03f5fe938d133b45910830f039b5c364be6
View file https://github.com/simstudioai/sim/blob/89bb7a006b87b1b7700f07145a63930a116a315e/apps/sim/connectors/permission-scoped-listing.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7421/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7421/files#diff-44f979d405adcad580fc0c92ff4dc03f5fe938d133b45910830f039b5c364be6
https://github.com/simstudioai/sim/pull/7421/files#diff-44f979d405adcad580fc0c92ff4dc03f5fe938d133b45910830f039b5c364be6
https://github.com/simstudioai/sim/pull/7421/files#diff-44f979d405adcad580fc0c92ff4dc03f5fe938d133b45910830f039b5c364be6
https://github.com/simstudioai/sim/pull/7421/files#diff-44f979d405adcad580fc0c92ff4dc03f5fe938d133b45910830f039b5c364be6
apps/sim/connectors/slack/meta.tshttps://github.com/simstudioai/sim/pull/7421/files#diff-aa87126967901ad0d5d386303e55e59f54f9afe88d0a28d8149fa42e46303b5e
View file https://github.com/simstudioai/sim/blob/89bb7a006b87b1b7700f07145a63930a116a315e/apps/sim/connectors/slack/meta.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7421/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/7421/files#diff-aa87126967901ad0d5d386303e55e59f54f9afe88d0a28d8149fa42e46303b5e
https://github.com/simstudioai/sim/pull/7421/files#diff-aa87126967901ad0d5d386303e55e59f54f9afe88d0a28d8149fa42e46303b5e
apps/sim/connectors/slack/slack.test.tshttps://github.com/simstudioai/sim/pull/7421/files#diff-e4691ffd81ad52bb42179f11f2fd0a4a2e3c4d753f21296d4ff41da24c7d503a
View file https://github.com/simstudioai/sim/blob/89bb7a006b87b1b7700f07145a63930a116a315e/apps/sim/connectors/slack/slack.test.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/7421/{{ revealButtonHref }}
Please reload this pagehttps://github.com/simstudioai/sim/pull/7421/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/7421/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.