René's URL Explorer Experiment


Title: feat(exa): refresh Exa integration against current API, retire dead research endpoint by waleedlatif1 · Pull Request #6074 · simstudioai/sim · GitHub

Open Graph Title: feat(exa): refresh Exa integration against current API, retire dead research endpoint by waleedlatif1 · Pull Request #6074 · simstudioai/sim

X Title: feat(exa): refresh Exa integration against current API, retire dead research endpoint by waleedlatif1 · Pull Request #6074 · simstudioai/sim

Description: Summary Exa's dev-rel team sent over a list of places our integration had drifted from their current API. I validated every claim against the live API with a real key, and found several things their list didn't cover. Broken in production today: exa_research calls /research/v1, which returns HTTP 410 RESEARCH_RETIRED. Every workflow using the Research operation fails. Removed it and added an Agent operation on /agent/runs. Workflows saved on the old operation route to Agent, so they start working again instead of erroring. The category dropdown sent values Exa no longer recognizes (research_paper, news_article, movie, song, pdf, github, tweet). Exa treats category as an unvalidated soft hint, so these never errored — they just silently stopped steering results. Replaced with the current taxonomy (company, publication, news, personal site, financial report, people) and remapped legacy values so existing workflows improve rather than break. Live Crawl Mode defaulted to never, so every search was silently pinned to cache-only unless the user dug into advanced mode. Removed the default and exposed maxAgeHours instead. API drift Exa flagged, all confirmed: Search types are now instant/fast/auto/deep-lite/deep/deep-reasoning. Legacy neural/keyword still pass through for saved workflows. numResults is 1–100, not the 25 we documented. livecrawl is deprecated in favor of maxAgeHours (−1 to 720). Exa 400s if both are sent, so they're now mutually exclusive. useAutoprompt dropped, crawl-date filters marked deprecated (still functional, so existing configs are untouched). score isn't in the search result schema — it only comes back for the legacy neural type. Marked optional instead of claiming it's always present. answer's text controls the cited sources' page text, not the answer. Fixed the description and removed a dead query field that was always empty. /findSimilar is deprecated but still live, so it stays, labeled. Capability gaps closed: Search results now expose id, so results can be chained into Get Contents via ids (previously you had to round-trip through URLs). Added outputSchema structured output with field-level grounding on Search, Answer, and Agent. Added highlightScores, subpages, entities, extras, statuses, requestId. Unrelated bug found along the way: copilot's search-online never requested page content from Exa, so every result snippet was an empty string. Now requests highlights. Docs regenerate from the tool definitions, so the docs page Exa reviewed is fixed by these code changes. Type of Change Bug fix New feature Testing Validated every change against the live Exa API with a real key — including the cases that 400 (livecrawl + maxAgeHours, ids + urls), the full Agent create/poll/complete cycle with structured output and cost metering, and search→contents id chaining. Added 33 unit tests covering the freshness mutual-exclusion, category remapping, request-body shape per endpoint, and the legacy research→agent routing. Full block/tool suite green (519 tests). Typecheck and check:api-validation clean. Backwards compatibility Legacy exa_research operation routes to Agent, with the old research models mapped onto effort levels. Legacy category and search-type values still work. livecrawl still accepted as a passthrough; deprecated crawl-date filters left in place. The pi search handler passes text as an object rather than a boolean; that path is preserved and covered by a test. Checklist Code follows project style guidelines Self-reviewed my changes Tests added/updated and passing No new warnings introduced I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

Open Graph Description: Summary Exa's dev-rel team sent over a list of places our integration had drifted from their current API. I validated every claim against the live API with a real key, and found several things ...

X Description: Summary Exa's dev-rel team sent over a list of places our integration had drifted from their current API. I validated every claim against the live API with a real key, and found several thi...

Opengraph URL: https://github.com/simstudioai/sim/pull/6074

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:666077b9-b80e-2741-f2f9-5ba700a353ea
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-id9462:14CABD:5989CD:802E01:6AFB3EB5
html-safe-nonce8c8647c250a93e06ef16d5bb4f8b63587729012c38dc0b88b849950fb8b83eab
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5NDYyOjE0Q0FCRDo1OTg5Q0Q6ODAyRTAxOjZBRkIzRUI1IiwidmlzaXRvcl9pZCI6IjEyMDU2OTY4NzA1MzQwMzcxNzMiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac6523bf72604fba8b2d0fced9b6c9472cf0dc6dbb140de73881f8dc6bcef19562
hovercard-subject-tagpull_request:4165195073
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/6074/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary Exa's dev-rel team sent over a list of places our integration had drifted from their current API. I validated every claim against the live API with a real key, and found several things ...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None2169b0dfbef67ed6b128074a5ed45bb7d5d1859783b10178b09a7765ad5f3693
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release3b4fc8df5ef1c6757e733a23e6b81b6725021823
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/6074/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F6074%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F6074%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/6074/files
Reloadhttps://github.com/simstudioai/sim/pull/6074/files
Reloadhttps://github.com/simstudioai/sim/pull/6074/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests202 (202)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
worktree-exa-api-refreshhttps://github.com/simstudioai/sim/tree/worktree-exa-api-refresh
Conversation 29 https://github.com/simstudioai/sim/pull/6074
Commits 5 https://github.com/simstudioai/sim/pull/6074/commits
Checks 27 https://github.com/simstudioai/sim/pull/6074/checks
Files changed https://github.com/simstudioai/sim/pull/6074/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
feat(exa): refresh Exa integration against current API, retire dead research endpoint https://github.com/simstudioai/sim/pull/6074/files#top
Show all changes 5 commits https://github.com/simstudioai/sim/pull/6074/files
7016f85 feat(exa): refresh Exa integration against current API, retire dead r… waleedlatif1 Jul 30, 2026 https://github.com/simstudioai/sim/pull/6074/commits/7016f85658d62a60380cacefd16f7ae8f446de79
95122fd fix(exa): address review findings on the API refresh waleedlatif1 Jul 30, 2026 https://github.com/simstudioai/sim/pull/6074/commits/95122fdda9d9f5a8dea396e8db7d357f016aa8a2
914c9b2 fix(exa): keep legacy research model, add subblock migrations, sharpe… waleedlatif1 Jul 30, 2026 https://github.com/simstudioai/sim/pull/6074/commits/914c9b23bf60133b06ff38b2c632509d94581d0d
af94705 fix(exa): flag empty Get Contents configs in the editor, keep legacy … waleedlatif1 Jul 30, 2026 https://github.com/simstudioai/sim/pull/6074/commits/af94705f5287e41a21f568be3d9a172eabbba531
8e5a779 fix(exa): revert conditional required on Get Contents URLs waleedlatif1 Jul 30, 2026 https://github.com/simstudioai/sim/pull/6074/commits/8e5a779b4ad2010cad2cfc7d91a939dec3a13fc6
Clear filters https://github.com/simstudioai/sim/pull/6074/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
exa.mdx https://github.com/simstudioai/sim/pull/6074/files#diff-ac964e34823db613f6cd5e2387483259d27f906f34eb814c459e06abe808d93f
exa.ts https://github.com/simstudioai/sim/pull/6074/files#diff-79b6abf2c95fbb5a5447e14d13299f47f73c3f71c75b83ccfa0aa00febeca08e
search-online.ts https://github.com/simstudioai/sim/pull/6074/files#diff-8e124d828579913d764ce2de33f58d8ca2bae3d566d48b62d50da08ee82bcef2
integrations.json https://github.com/simstudioai/sim/pull/6074/files#diff-0c4cc916562765dac61bd44d1b984d95e44d7901c070e0a3f668474c684d92bd
subblock-migrations.ts https://github.com/simstudioai/sim/pull/6074/files#diff-a4896ba7fb391788ee6d285aba4ccf9bc1851c1ef908b0eb71b1dd7a2644c895
agent.ts https://github.com/simstudioai/sim/pull/6074/files#diff-def64646dc087f0dab29139ba725b4c02abfce2bba9c4311d98d6b59b472529c
answer.ts https://github.com/simstudioai/sim/pull/6074/files#diff-0b48ad3cd49ff64e2862b83693d6949962bd75d7edd9518daae8f712792a25ed
exa.test.ts https://github.com/simstudioai/sim/pull/6074/files#diff-62cb29934f6842b6b19a2579690f814b6c8882ece11f4b3330f20e41bd519319
find_similar_links.ts https://github.com/simstudioai/sim/pull/6074/files#diff-33349c0671fd283950aeed22d43204689253b79dea90333392ea121173d2aed1
get_contents.ts https://github.com/simstudioai/sim/pull/6074/files#diff-8e31e898e0ffe8ea4ba5e8bc3e72a5cb328fe042080fc6d1984d7f7face92d44
index.ts https://github.com/simstudioai/sim/pull/6074/files#diff-39b4b6ac3836b35f4bff8702e371082f7ce394dbf6d880b52ae67c35698ef52a
research.ts https://github.com/simstudioai/sim/pull/6074/files#diff-c3426e7858d76859c52d9ab6870cd2a75958f6f8a5df8929110720bcc23f2507
search.ts https://github.com/simstudioai/sim/pull/6074/files#diff-6c7f78ed86865e008b2109856e52e16b86a69cf62bb2f47618c7de77b0e16af1
types.ts https://github.com/simstudioai/sim/pull/6074/files#diff-2762ec2544b2ee8e94e35c16eb567b12be472c8bebf415636c0b277f0224ff98
utils.ts https://github.com/simstudioai/sim/pull/6074/files#diff-1761011240b7139540285a5c11e5aaf074f4abff6bea954209560e67a1bed45b
registry.ts https://github.com/simstudioai/sim/pull/6074/files#diff-a05e54887bf05477726b00df4183dd4a3fa0fd1f82b867bbf156e1b6a6d7e3fa
apps/docs/content/docs/en/integrations/exa.mdxhttps://github.com/simstudioai/sim/pull/6074/files#diff-ac964e34823db613f6cd5e2387483259d27f906f34eb814c459e06abe808d93f
View file https://github.com/simstudioai/sim/blob/8e5a779b4ad2010cad2cfc7d91a939dec3a13fc6/apps/docs/content/docs/en/integrations/exa.mdx
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
apps/sim/blocks/blocks/exa.tshttps://github.com/simstudioai/sim/pull/6074/files#diff-79b6abf2c95fbb5a5447e14d13299f47f73c3f71c75b83ccfa0aa00febeca08e
View file https://github.com/simstudioai/sim/blob/8e5a779b4ad2010cad2cfc7d91a939dec3a13fc6/apps/sim/blocks/blocks/exa.ts
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
apps/sim/lib/copilot/tools/server/other/search-online.tshttps://github.com/simstudioai/sim/pull/6074/files#diff-8e124d828579913d764ce2de33f58d8ca2bae3d566d48b62d50da08ee82bcef2
View file https://github.com/simstudioai/sim/blob/8e5a779b4ad2010cad2cfc7d91a939dec3a13fc6/apps/sim/lib/copilot/tools/server/other/search-online.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/6074/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/6074/files#diff-8e124d828579913d764ce2de33f58d8ca2bae3d566d48b62d50da08ee82bcef2
https://github.com/simstudioai/sim/pull/6074/files#diff-8e124d828579913d764ce2de33f58d8ca2bae3d566d48b62d50da08ee82bcef2
https://github.com/simstudioai/sim/pull/6074/files#diff-8e124d828579913d764ce2de33f58d8ca2bae3d566d48b62d50da08ee82bcef2
https://github.com/simstudioai/sim/pull/6074/files#diff-8e124d828579913d764ce2de33f58d8ca2bae3d566d48b62d50da08ee82bcef2
apps/sim/lib/integrations/integrations.jsonhttps://github.com/simstudioai/sim/pull/6074/files#diff-0c4cc916562765dac61bd44d1b984d95e44d7901c070e0a3f668474c684d92bd
View file https://github.com/simstudioai/sim/blob/8e5a779b4ad2010cad2cfc7d91a939dec3a13fc6/apps/sim/lib/integrations/integrations.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/6074/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/6074/files#diff-0c4cc916562765dac61bd44d1b984d95e44d7901c070e0a3f668474c684d92bd
https://github.com/simstudioai/sim/pull/6074/files#diff-0c4cc916562765dac61bd44d1b984d95e44d7901c070e0a3f668474c684d92bd
https://github.com/simstudioai/sim/pull/6074/files#diff-0c4cc916562765dac61bd44d1b984d95e44d7901c070e0a3f668474c684d92bd
https://github.com/simstudioai/sim/pull/6074/files#diff-0c4cc916562765dac61bd44d1b984d95e44d7901c070e0a3f668474c684d92bd
apps/sim/lib/workflows/migrations/subblock-migrations.tshttps://github.com/simstudioai/sim/pull/6074/files#diff-a4896ba7fb391788ee6d285aba4ccf9bc1851c1ef908b0eb71b1dd7a2644c895
View file https://github.com/simstudioai/sim/blob/8e5a779b4ad2010cad2cfc7d91a939dec3a13fc6/apps/sim/lib/workflows/migrations/subblock-migrations.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/6074/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/6074/files#diff-a4896ba7fb391788ee6d285aba4ccf9bc1851c1ef908b0eb71b1dd7a2644c895
https://github.com/simstudioai/sim/pull/6074/files#diff-a4896ba7fb391788ee6d285aba4ccf9bc1851c1ef908b0eb71b1dd7a2644c895
apps/sim/tools/exa/agent.tshttps://github.com/simstudioai/sim/pull/6074/files#diff-def64646dc087f0dab29139ba725b4c02abfce2bba9c4311d98d6b59b472529c
View file https://github.com/simstudioai/sim/blob/8e5a779b4ad2010cad2cfc7d91a939dec3a13fc6/apps/sim/tools/exa/agent.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/6074/{{ revealButtonHref }}
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/6074/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.