René's URL Explorer Experiment


Title: feat(knowledge): add embedding model selection and Cohere reranker by waleedlatif1 · Pull Request #4349 · simstudioai/sim · GitHub

Open Graph Title: feat(knowledge): add embedding model selection and Cohere reranker by waleedlatif1 · Pull Request #4349 · simstudioai/sim

X Title: feat(knowledge): add embedding model selection and Cohere reranker by waleedlatif1 · Pull Request #4349 · simstudioai/sim

Description: Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders. - feat(knowledge): add embedding model selection and Cohere reranker by waleedlatif1 · Pull Request #4349 · simstudioai/sim

Open Graph Description: Summary Add embedding model dropdown to KB creation (text-embedding-3-small/large, gemini-embedding-001) Add per-search Cohere reranker (rerank-v4.0-pro/fast, rerank-v3.5) with BYOK + rotating key...

X Description: Summary Add embedding model dropdown to KB creation (text-embedding-3-small/large, gemini-embedding-001) Add per-search Cohere reranker (rerank-v4.0-pro/fast, rerank-v3.5) with BYOK + rotating key...

Opengraph URL: https://github.com/simstudioai/sim/pull/4349

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/commits(.:format)
route-controllerpull_requests
route-actioncommits
fetch-noncev2:cf969b42-2276-a8fb-df92-80091e46a7db
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-id986A:25245F:E882A1:13E7737:6AFB5F5C
html-safe-nonce7917bfe423ef33ca6370eaa65507c7a7650e4ebc83c0ee9cf207a0b21154d31e
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5ODZBOjI1MjQ1RjpFODgyQTE6MTNFNzczNzo2QUZCNUY1QyIsInZpc2l0b3JfaWQiOiIyNzAyMjY1NDY4NzcyMzc2NDEyIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac11d9f68031313352774928c25ed09f168ce3e8963ef60c716c1e6a360fc64b02
hovercard-subject-tagpull_request:3605781964
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/commits
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/4349/commits
twitter:imagehttps://opengraph.githubassets.com/99f93b4abf5a1041f1189798c9a4ad97eaed35184362786b8e6d99fc86037234/simstudioai/sim/pull/4349
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/99f93b4abf5a1041f1189798c9a4ad97eaed35184362786b8e6d99fc86037234/simstudioai/sim/pull/4349
og:image:altSummary Add embedding model dropdown to KB creation (text-embedding-3-small/large, gemini-embedding-001) Add per-search Cohere reranker (rerank-v4.0-pro/fast, rerank-v3.5) with BYOK + rotating key...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
og:author:usernamewaleedlatif1
hostnamegithub.com
expected-hostnamegithub.com
Noneea33d13c96d0ff66bd8fa906b193d2213536b78cb06b0c50a4632c58b1418f94
turbo-cache-controlno-cache
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release59ef97164c52cf59bd10558ddec9c4f482763988
ui-targetfull
theme-color#1e2327
color-schemelight dark
react-app-namepull-requests

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/4349/commits#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F4349%2Fcommits
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F4349%2Fcommits
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Fcommits&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/4349/commits
Reloadhttps://github.com/simstudioai/sim/pull/4349/commits
Reloadhttps://github.com/simstudioai/sim/pull/4349/commits
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
https://github.com/simstudioai/sim
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
waleedlatif1/embedding-model-researchhttps://github.com/simstudioai/sim/tree/waleedlatif1/embedding-model-research
Conversationhttps://github.com/simstudioai/sim/pull/4349
Commits22 (22)https://github.com/simstudioai/sim/pull/4349/commits
Checkshttps://github.com/simstudioai/sim/pull/4349/checks
Files changedhttps://github.com/simstudioai/sim/pull/4349/files
feat(knowledge): add embedding model selection and Cohere rerankerhttps://github.com/simstudioai/sim/pull/4349/commits#top
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
waleedlatif1/embedding-model-researchhttps://github.com/simstudioai/sim/tree/waleedlatif1/embedding-model-research
feat(knowledge): add embedding model selection and Cohere rerankerhttps://github.com/simstudioai/sim/pull/4349/commits/9614a2869dfd4fe0405c0ca44e54798d077e161c
https://github.com/waleedlatif1
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
9614a28https://github.com/simstudioai/sim/pull/4349/commits/9614a2869dfd4fe0405c0ca44e54798d077e161c
https://github.com/simstudioai/sim/tree/9614a2869dfd4fe0405c0ca44e54798d077e161c
fix(knowledge): split reranker model constants into client-safe modulehttps://github.com/simstudioai/sim/pull/4349/commits/c56b7a467c9c15278b9d54ff027740bfef0af6f6
https://github.com/waleedlatif1
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
c56b7a4https://github.com/simstudioai/sim/pull/4349/commits/c56b7a467c9c15278b9d54ff027740bfef0af6f6
https://github.com/simstudioai/sim/tree/c56b7a467c9c15278b9d54ff027740bfef0af6f6
fix(knowledge): bill rerank on every successful API call and fix MDX docs literalhttps://github.com/simstudioai/sim/pull/4349/commits/5d1446f6b3291e37f7323d905ef74fb6730d3cc2
https://github.com/waleedlatif1
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
5d1446fhttps://github.com/simstudioai/sim/pull/4349/commits/5d1446f6b3291e37f7323d905ef74fb6730d3cc2
https://github.com/simstudioai/sim/tree/5d1446f6b3291e37f7323d905ef74fb6730d3cc2
test(knowledge): align embedding tests with provider abstraction changeshttps://github.com/simstudioai/sim/pull/4349/commits/553021a7f9c9b074178a151d2a1c71352ac2735a
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
553021ahttps://github.com/simstudioai/sim/pull/4349/commits/553021a7f9c9b074178a151d2a1c71352ac2735a
https://github.com/simstudioai/sim/tree/553021a7f9c9b074178a151d2a1c71352ac2735a
fix(knowledge): require explicit Azure deployment per OpenAI embedding modelhttps://github.com/simstudioai/sim/pull/4349/commits/542d2edc7f3dc7aa32f8b22d20ab10ae5eb3f03d
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
542d2edhttps://github.com/simstudioai/sim/pull/4349/commits/542d2edc7f3dc7aa32f8b22d20ab10ae5eb3f03d
https://github.com/simstudioai/sim/tree/542d2edc7f3dc7aa32f8b22d20ab10ae5eb3f03d
fix(knowledge): skip platform reranker billing for BYOK Cohere keyshttps://github.com/simstudioai/sim/pull/4349/commits/d70ac8f917c3d9cb579a6366459a0b82995955ba
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
d70ac8fhttps://github.com/simstudioai/sim/pull/4349/commits/d70ac8f917c3d9cb579a6366459a0b82995955ba
https://github.com/simstudioai/sim/tree/d70ac8f917c3d9cb579a6366459a0b82995955ba
fix(knowledge): match search tokenizer to embedding provider; remove dead varhttps://github.com/simstudioai/sim/pull/4349/commits/57589cbce95013f00ce359fcee7b69a9ed2cfe3b
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
57589cbhttps://github.com/simstudioai/sim/pull/4349/commits/57589cbce95013f00ce359fcee7b69a9ed2cfe3b
https://github.com/simstudioai/sim/tree/57589cbce95013f00ce359fcee7b69a9ed2cfe3b
fix(knowledge): match chunk tokenizer to KB embedding providerhttps://github.com/simstudioai/sim/pull/4349/commits/96cf4dd71ed43e276ceb1f0aad67765328c8b7c0
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
96cf4ddhttps://github.com/simstudioai/sim/pull/4349/commits/96cf4dd71ed43e276ceb1f0aad67765328c8b7c0
https://github.com/simstudioai/sim/tree/96cf4dd71ed43e276ceb1f0aad67765328c8b7c0
refactor(knowledge): centralize tokenizer mapping on EmbeddingModelInfohttps://github.com/simstudioai/sim/pull/4349/commits/14538a1df2ed399c3ece677473ecfcb0c33d080c
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
14538a1https://github.com/simstudioai/sim/pull/4349/commits/14538a1df2ed399c3ece677473ecfcb0c33d080c
https://github.com/simstudioai/sim/tree/14538a1df2ed399c3ece677473ecfcb0c33d080c
refactor(knowledge): lock embedding model to KB_EMBEDDING_MODEL env varhttps://github.com/simstudioai/sim/pull/4349/commits/7a9ba8b64cfd9b4b3e334af4112a152c5034371e
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
7a9ba8bhttps://github.com/simstudioai/sim/pull/4349/commits/7a9ba8b64cfd9b4b3e334af4112a152c5034371e
https://github.com/simstudioai/sim/tree/7a9ba8b64cfd9b4b3e334af4112a152c5034371e
fix(knowledge): use provider tokenizer for chunks and bound rerank indiceshttps://github.com/simstudioai/sim/pull/4349/commits/53624f3028d30f46da455b9189bfc65eb8a396ca
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
53624f3https://github.com/simstudioai/sim/pull/4349/commits/53624f3028d30f46da455b9189bfc65eb8a396ca
https://github.com/simstudioai/sim/tree/53624f3028d30f46da455b9189bfc65eb8a396ca
fix(knowledge): use .count from estimateTokenCount return valuehttps://github.com/simstudioai/sim/pull/4349/commits/97fa4d5c67b94a305259b9adf84358de68170429
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
97fa4d5https://github.com/simstudioai/sim/pull/4349/commits/97fa4d5c67b94a305259b9adf84358de68170429
https://github.com/simstudioai/sim/tree/97fa4d5c67b94a305259b9adf84358de68170429
fix(knowledge): only enforce single embedding model when query is presenthttps://github.com/simstudioai/sim/pull/4349/commits/b1643ee8d97e91ccdee646cf34e16e18c6fdad22
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
b1643eehttps://github.com/simstudioai/sim/pull/4349/commits/b1643ee8d97e91ccdee646cf34e16e18c6fdad22
https://github.com/simstudioai/sim/tree/b1643ee8d97e91ccdee646cf34e16e18c6fdad22
fix(knowledge): use getConfiguredEmbeddingModel in copilot KB creationhttps://github.com/simstudioai/sim/pull/4349/commits/78d6af7ba19d19a84d2b0c99f92ecdc16d39b594
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
78d6af7https://github.com/simstudioai/sim/pull/4349/commits/78d6af7ba19d19a84d2b0c99f92ecdc16d39b594
https://github.com/simstudioai/sim/tree/78d6af7ba19d19a84d2b0c99f92ecdc16d39b594
fix(knowledge): make EMBEDDING_DIMENSIONS a literal typehttps://github.com/simstudioai/sim/pull/4349/commits/687b7f58f71fa291890e46b64d8b012357a1d8c4
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
687b7f5https://github.com/simstudioai/sim/pull/4349/commits/687b7f58f71fa291890e46b64d8b012357a1d8c4
https://github.com/simstudioai/sim/tree/687b7f58f71fa291890e46b64d8b012357a1d8c4
fix(knowledge): use per-KB embedding model in v1 search routehttps://github.com/simstudioai/sim/pull/4349/commits/f7eef618838f2a8318a6d1747bafa4843ffa83a7
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
f7eef61https://github.com/simstudioai/sim/pull/4349/commits/f7eef618838f2a8318a6d1747bafa4843ffa83a7
https://github.com/simstudioai/sim/tree/f7eef618838f2a8318a6d1747bafa4843ffa83a7
chore(knowledge): polish embedding/reranker implementationhttps://github.com/simstudioai/sim/pull/4349/commits/cb1cab736448ff073eefe9bde7f99424cc92a5e6
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
cb1cab7https://github.com/simstudioai/sim/pull/4349/commits/cb1cab736448ff073eefe9bde7f99424cc92a5e6
https://github.com/simstudioai/sim/tree/cb1cab736448ff073eefe9bde7f99424cc92a5e6
fix(knowledge): resolve type errors and unhandled rejection in search routeshttps://github.com/simstudioai/sim/pull/4349/commits/5dfaed208526c4f9d3e3b84aea2fb3de6cfb3c57
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
5dfaed2https://github.com/simstudioai/sim/pull/4349/commits/5dfaed208526c4f9d3e3b84aea2fb3de6cfb3c57
https://github.com/simstudioai/sim/tree/5dfaed208526c4f9d3e3b84aea2fb3de6cfb3c57
fix(knowledge): pass Gemini API key via x-goog-api-key headerhttps://github.com/simstudioai/sim/pull/4349/commits/b73c2184a36b87d8cdc62b5b0ece79f70d6b886e
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
b73c218https://github.com/simstudioai/sim/pull/4349/commits/b73c2184a36b87d8cdc62b5b0ece79f70d6b886e
https://github.com/simstudioai/sim/tree/b73c2184a36b87d8cdc62b5b0ece79f70d6b886e
fix(knowledge): default Azure deployment name to embedding model namehttps://github.com/simstudioai/sim/pull/4349/commits/64a17dbdae8d88ba6aa635874599212e1185c2f4
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
64a17dbhttps://github.com/simstudioai/sim/pull/4349/commits/64a17dbdae8d88ba6aa635874599212e1185c2f4
https://github.com/simstudioai/sim/tree/64a17dbdae8d88ba6aa635874599212e1185c2f4
fix(knowledge): cap Gemini batches at 100 items, add singular GEMINI_API_KEY fallbackhttps://github.com/simstudioai/sim/pull/4349/commits/99743d90dee494f97fa03fa493976fa7551a6cdc
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
99743d9https://github.com/simstudioai/sim/pull/4349/commits/99743d90dee494f97fa03fa493976fa7551a6cdc
https://github.com/simstudioai/sim/tree/99743d90dee494f97fa03fa493976fa7551a6cdc
fix(knowledge): prefer singular Cohere key before rotationhttps://github.com/simstudioai/sim/pull/4349/commits/8fd0557671f9273e693cde97a2a6af89cbb1200e
waleedlatif1https://github.com/simstudioai/sim/commits?author=waleedlatif1
claudehttps://github.com/simstudioai/sim/commits?author=claude
8fd0557https://github.com/simstudioai/sim/pull/4349/commits/8fd0557671f9273e693cde97a2a6af89cbb1200e
https://github.com/simstudioai/sim/tree/8fd0557671f9273e693cde97a2a6af89cbb1200e
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.