René's URL Explorer Experiment


Title: feat(context-dev): add Context.dev web + brand data integration by waleedlatif1 · Pull Request #5048 · simstudioai/sim · GitHub

Open Graph Title: feat(context-dev): add Context.dev web + brand data integration by waleedlatif1 · Pull Request #5048 · simstudioai/sim

X Title: feat(context-dev): add Context.dev web + brand data integration by waleedlatif1 · Pull Request #5048 · simstudioai/sim

Description: Summary Adds a Context.dev integration — a single API-key (Bearer) service for web scraping and brand/firmographic data. Modeled on the existing Firecrawl integration (AuthMode.ApiKey, BYOK via the block's API-key field). Covers all relevant Context.dev endpoints across every API family. Web scraping scrape_markdown, scrape_html, scrape_images, screenshot (stored as a downloadable file), crawl, map, search Web extraction extract (JSON-schema structured data), extract_product, extract_products, scrape_fonts, scrape_styleguide, classify_naics, classify_sic Brand intelligence get_brand (by domain), get_brand_by_name, get_brand_by_email, get_brand_by_ticker, get_brand_simplified, identify_transaction Utility prefetch_domain, prefetch_by_email 22 tools total. File handling The screenshot endpoint returns a hosted image URL. The tool surfaces it as a file-typed output (ToolFileData with url), so the executor's FileToolProcessor downloads and stores it as a UserFile — the same path other file-producing tools use. The file's MIME type/extension are derived from the returned URL. The raw screenshotUrl is also exposed. Details Endpoints, params, and response shapes verified against the live Context.dev API reference (https://docs.context.dev). Every response's key_metadata credit accounting is surfaced as creditsConsumed / creditsRemaining. Shared brand output schema + transform helper reused across the six brand endpoints. New block context_dev (white background, brand logo icon), registered in blocks/registry.ts; tools registered in tools/registry.ts. ContextDevBlockMeta with 9 use-case templates. Generated integration docs included. Validation bun run type-check — clean for the integration (0 errors in context_dev) bun run lint — clean bun run check:api-validation — passes (no new boundary routes) Review Addressed all inline findings from the first review pass (commit 3ff8e334e2): wired includeFrames into the block, split crawl/extract maxPages so the differing page limits can't be crossed, and derive the screenshot MIME type from the URL.

Open Graph Description: Summary Adds a Context.dev integration — a single API-key (Bearer) service for web scraping and brand/firmographic data. Modeled on the existing Firecrawl integration (AuthMode.ApiKey, BYOK via the...

X Description: Summary Adds a Context.dev integration — a single API-key (Bearer) service for web scraping and brand/firmographic data. Modeled on the existing Firecrawl integration (AuthMode.ApiKey, BYOK via the...

Opengraph URL: https://github.com/simstudioai/sim/pull/5048

X: @github

direct link

Domain: github.com

react-profiling0
react-import-mapreact,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf
route-pattern/:user_id/:repository/pull/:id/files(.:format)
route-controllerpull_requests
route-actionfiles
fetch-noncev2:68a76e40-df96-4020-f4d6-a80a8386fa5d
current-catalog-service-hashae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b
request-idB11A:1DCEB4:122CC:17DAF:6AFB64A7
html-safe-nonceffb77ed8514e5c1b4aee24b9d817a1054311669ffe74f1c938442196e4b2369b
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJCMTFBOjFEQ0VCNDoxMjJDQzoxN0RBRjo2QUZCNjRBNyIsInZpc2l0b3JfaWQiOiI1ODc1MDMyODc3NzY1OTc3MjU1IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmac6eab7b0f4d5f5d2348b89a3dac85620b3e6a8be9b8466fea21f9039a43dbd32b
hovercard-subject-tagpull_request:3864682904
github-keyboard-shortcutsrepository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///pull_requests/show/files
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/simstudioai/sim/pull/5048/files
twitter:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
twitter:cardsummary_large_image
og:imagehttps://avatars.githubusercontent.com/u/40672544?s=400&v=4
og:image:altSummary Adds a Context.dev integration — a single API-key (Bearer) service for web scraping and brand/firmographic data. Modeled on the existing Firecrawl integration (AuthMode.ApiKey, BYOK via the...
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneea33d13c96d0ff66bd8fa906b193d2213536b78cb06b0c50a4632c58b1418f94
turbo-cache-controlno-preview
diff-viewunified
go-importgithub.com/simstudioai/sim git https://github.com/simstudioai/sim.git
octolytics-dimension-user_id199344406
octolytics-dimension-user_loginsimstudioai
octolytics-dimension-repository_id912559512
octolytics-dimension-repository_nwosimstudioai/sim
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id912559512
octolytics-dimension-repository_network_root_nwosimstudioai/sim
turbo-body-classeslogged-out env-production page-responsive full-width
disable-turbotrue
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release59ef97164c52cf59bd10558ddec9c4f482763988
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/simstudioai/sim/pull/5048/files#start-of-content
https://github.com/
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F5048%2Ffiles
GitHubRepository hosting, code review, and collaborationhttps://github.com/platform
CopilotAI coding agent for tasks, projects, and automated workhttps://github.com/features/copilot
ActionsCI/CD and automationhttps://github.com/features/actions
Code QualityQuality analysis, fixes, and enforcementhttps://github.com/features/code-quality
CodespacesCloud development environmentshttps://github.com/features/codespaces
Code SecurityVulnerability detection and remediationhttps://github.com/security/advanced-security/code-security
Secret ProtectionSecret scanning and leak preventionhttps://github.com/security/advanced-security/secret-protection
All Featureshttps://github.com/features
Documentationhttps://docs.github.com/en
Traininghttps://learn.github.com/skills
Certificationshttps://learn.github.com/credentials
Build with Copilothttps://github.com/features/ai
Customize Copilothttps://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview
Integrationshttps://github.com/marketplace
Trending reposhttps://github.com/trending
GitHub Sponsorshttps://github.com/open-source/sponsors
Developer articleshttps://github.com/resources/articles
ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place.https://github.blog/changelog/
Enterpriseshttps://github.com/enterprise
Teamhttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
See all industrieshttps://github.com/solutions/industry
Why GitHubhttps://github.com/why-github
Customer Storieshttps://github.com/customer-stories
Business insightshttps://github.com/solutions/executive-insights
Trust Centerhttps://github.com/trust-center
GitHub Advanced SecurityEnterprise-grade code securityhttps://github.com/security/advanced-security
Copilot for businessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Documentationhttps://docs.github.com/en
Resource centerhttps://github.com/resources
Bloghttps://github.blog/
Events & webinarshttps://github.com/resources/events
Community Forumhttps://github.com/orgs/community/discussions
Customer Storieshttps://github.com/customer-stories
Integrationshttps://github.com/marketplace
Customer supporthttps://help.github.com/
Traininghttps://learn.github.com/skills
GitHub Statushttps://www.githubstatus.com/
Abouthttps://github.com/about
Partnershttps://github.com/partners
Changeloghttps://github.blog/changelog/
GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub.https://githubuniverse.com/
Pricinghttps://github.com/pricing
Sign inhttps://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsimstudioai%2Fsim%2Fpull%2F5048%2Ffiles
Sign uphttps://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fpull_requests%2Fshow%2Ffiles&source=header-repo&source_repo=simstudioai%2Fsim
Reloadhttps://github.com/simstudioai/sim/pull/5048/files
Reloadhttps://github.com/simstudioai/sim/pull/5048/files
Reloadhttps://github.com/simstudioai/sim/pull/5048/files
simstudioaihttps://github.com/simstudioai
simhttps://github.com/simstudioai/sim
Codehttps://github.com/simstudioai/sim
Issues129 (129)https://github.com/simstudioai/sim/issues
Pull requests197 (197)https://github.com/simstudioai/sim/pulls
Actionshttps://github.com/simstudioai/sim/actions
Projectshttps://github.com/simstudioai/sim/projects
Security and qualityhttps://github.com/simstudioai/sim/security
Insightshttps://github.com/simstudioai/sim/pulse
Sign up for GitHub https://github.com/signup?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
terms of servicehttps://docs.github.com/terms
privacy statementhttps://docs.github.com/privacy
Sign inhttps://github.com/login?return_to=%2Fsimstudioai%2Fsim%2Fissues%2Fnew%2Fchoose
waleedlatif1https://github.com/waleedlatif1
staginghttps://github.com/simstudioai/sim/tree/staging
worktree-context-dev-integrationhttps://github.com/simstudioai/sim/tree/worktree-context-dev-integration
Conversation 19 https://github.com/simstudioai/sim/pull/5048
Commits 3 https://github.com/simstudioai/sim/pull/5048/commits
Checks 14 https://github.com/simstudioai/sim/pull/5048/checks
Files changed https://github.com/simstudioai/sim/pull/5048/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/5048/files
feat(context-dev): add Context.dev web + brand data integration https://github.com/simstudioai/sim/pull/5048/files#top
Show all changes 3 commits https://github.com/simstudioai/sim/pull/5048/files
ca4f34d feat(context-dev): add Context.dev web + brand data integration waleedlatif1 Jun 15, 2026 https://github.com/simstudioai/sim/pull/5048/commits/ca4f34d24833540127d2d66f2267ab17559e9b45
c8ad62a feat(context-dev): add brand variants, products, fonts, styleguide, i… waleedlatif1 Jun 15, 2026 https://github.com/simstudioai/sim/pull/5048/commits/c8ad62aacb4a6534cd529018d62e6be5a6120f93
3ff8e33 fix(context-dev): wire includeFrames, split crawl/extract maxPages, d… waleedlatif1 Jun 15, 2026 https://github.com/simstudioai/sim/pull/5048/commits/3ff8e334e2a85ce534e5ba2a2dbe89536ede27de
Clear filters https://github.com/simstudioai/sim/pull/5048/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/5048/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/5048/files
icons.tsx https://github.com/simstudioai/sim/pull/5048/files#diff-ad82ea6f4020b7b9555fc40c56c93b82fb246b727c105f8e1e0da9c03dc49274
icon-mapping.ts https://github.com/simstudioai/sim/pull/5048/files#diff-193abeb0603365b837c7d5ba8637be7ef998dde35d5746dfb8fa954fe8b1fcaa
context_dev.mdx https://github.com/simstudioai/sim/pull/5048/files#diff-d63961f9d9726e4eb342f7f5d1e6c57ab92bbffe9724897fc3af1820fa06eb51
meta.json https://github.com/simstudioai/sim/pull/5048/files#diff-59d7506ddfe264c889aa27abd55383fa1815c385f9e008f02aebc41c2d9819ff
context_dev.ts https://github.com/simstudioai/sim/pull/5048/files#diff-5702cc05bc666af5fad45a6bbb626a574d5c6e86ede6380dc21ccd640ee26a8f
registry.ts https://github.com/simstudioai/sim/pull/5048/files#diff-4f64d9c87514dbcc513f9874931878cf438a64d3f66d8cd4bf83e28a2e8b5c33
icons.tsx https://github.com/simstudioai/sim/pull/5048/files#diff-75502961b6b1b69fd8b140643edfe13c66790af9f167e9a545cbcff6b2e9a20d
icon-mapping.ts https://github.com/simstudioai/sim/pull/5048/files#diff-31b9f59a480a2b6cc7d98ac5076f304e142b3a42be1ef966bfebd4643ba8c7af
integrations.json https://github.com/simstudioai/sim/pull/5048/files#diff-0c4cc916562765dac61bd44d1b984d95e44d7901c070e0a3f668474c684d92bd
classify_naics.ts https://github.com/simstudioai/sim/pull/5048/files#diff-ea6e4d609e07b9a803cc3c751edea06fb9f2bc939967c90021b0088cdee25c27
classify_sic.ts https://github.com/simstudioai/sim/pull/5048/files#diff-611208af7af391664146190d57e9389bdac1a7e8ac44bd30aa8f091455f04baf
crawl.ts https://github.com/simstudioai/sim/pull/5048/files#diff-3788c1ddf5c6679547329ef1e9901f63409eed3c646f8efeb28fb672e5b33ae3
extract.ts https://github.com/simstudioai/sim/pull/5048/files#diff-8c25d5fafc9bba4b1687fb44f2607731f8ca6340c2567b0461d4bceffa26a80a
extract_product.ts https://github.com/simstudioai/sim/pull/5048/files#diff-5d06ce4eca9aaeb8a7d4a63354d48a925774edaf16079e998c31c37695c7d3e8
extract_products.ts https://github.com/simstudioai/sim/pull/5048/files#diff-fe12ffc4acc659169ff858dac976bc01661bd60f13dcdc461af3729340ef1461
get_brand.ts https://github.com/simstudioai/sim/pull/5048/files#diff-6c197b72572adf676d45409d9f7195da11f2b12a6c29eec7a1c22ac170a50c73
get_brand_by_email.ts https://github.com/simstudioai/sim/pull/5048/files#diff-3fe363e1ea76321e3572d9e978080daff8433a0916bb410aadf66573fd9acf12
get_brand_by_name.ts https://github.com/simstudioai/sim/pull/5048/files#diff-79168745d684d7b39ed7a52fee789dbb39c298481a25b1ffe9422343df547cbf
get_brand_by_ticker.ts https://github.com/simstudioai/sim/pull/5048/files#diff-0cfac6dae1c6e0f558123cc480a206aec4dc2bf189bc6ae2a9dec00abcd4751d
get_brand_simplified.ts https://github.com/simstudioai/sim/pull/5048/files#diff-cca4ff35e22c1f36582ec838c2702f3c794a638422a082ea051efffb335efc8b
identify_transaction.ts https://github.com/simstudioai/sim/pull/5048/files#diff-cf11a83eb0d8c0c0c46ce5e668f90be35657fc5a34fc8d60e6e8cd131f8d0001
index.ts https://github.com/simstudioai/sim/pull/5048/files#diff-4588644141a3825d7c18061d6c6e3e72d2af1cbc622e78771e7a94fca0059829
map.ts https://github.com/simstudioai/sim/pull/5048/files#diff-7ca2ff98789f2724ef2056fc3ffe967bf2dc64708a7f5340eb015c4a95c15777
prefetch_by_email.ts https://github.com/simstudioai/sim/pull/5048/files#diff-22c791b4f23047dfcd7621613cc43fe1f82747610c5e5abf20935ee53ca81d49
prefetch_domain.ts https://github.com/simstudioai/sim/pull/5048/files#diff-c2938b53f224a2df54982ef017b136f3029155b7b93bb20919f85c4018f5767f
scrape_fonts.ts https://github.com/simstudioai/sim/pull/5048/files#diff-a1eb9ff73ad839eae9b5a35b5c4646992d23ab4e8f04a628a08ff8f259defaa9
scrape_html.ts https://github.com/simstudioai/sim/pull/5048/files#diff-0066e254b45fd770967810a3b198be78be6bb0736e4075db9cbb479585882fc6
scrape_images.ts https://github.com/simstudioai/sim/pull/5048/files#diff-894692ed3fe2df0f63ac6896b0e0ec43c53c68f1825daf7c4e000a58bf63d8aa
scrape_markdown.ts https://github.com/simstudioai/sim/pull/5048/files#diff-635c5ceb12e57822262638eb906b663da66aaa934ec4c7849518bb045b6ef905
scrape_styleguide.ts https://github.com/simstudioai/sim/pull/5048/files#diff-0395ba85f8054339ed9812442cf55fddb06aecced49ff81cd34434d26996c8c2
screenshot.ts https://github.com/simstudioai/sim/pull/5048/files#diff-2b8620f8cc57b52d524e4252cea70806f59ef7a93df8bdb4d50c367d5f2b99e2
search.ts https://github.com/simstudioai/sim/pull/5048/files#diff-4faa02ff4fd017b636f34453c70e86f45a21a95567109d69eac424cfcf036051
types.ts https://github.com/simstudioai/sim/pull/5048/files#diff-b10b052ea4739a7d9f4bb8fa044733572fdf6ff634acc42f47fbea5780b513a6
utils.ts https://github.com/simstudioai/sim/pull/5048/files#diff-ac86602eff7d43e01def0d36cc01e0577b5ef0a019c73bd8035270c855cfe689
registry.ts https://github.com/simstudioai/sim/pull/5048/files#diff-a05e54887bf05477726b00df4183dd4a3fa0fd1f82b867bbf156e1b6a6d7e3fa
apps/docs/components/icons.tsxhttps://github.com/simstudioai/sim/pull/5048/files#diff-ad82ea6f4020b7b9555fc40c56c93b82fb246b727c105f8e1e0da9c03dc49274
View file https://github.com/simstudioai/sim/blob/3ff8e334e2a85ce534e5ba2a2dbe89536ede27de/apps/docs/components/icons.tsx
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/5048/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/5048/files#diff-ad82ea6f4020b7b9555fc40c56c93b82fb246b727c105f8e1e0da9c03dc49274
https://github.com/simstudioai/sim/pull/5048/files#diff-ad82ea6f4020b7b9555fc40c56c93b82fb246b727c105f8e1e0da9c03dc49274
apps/docs/components/ui/icon-mapping.tshttps://github.com/simstudioai/sim/pull/5048/files#diff-193abeb0603365b837c7d5ba8637be7ef998dde35d5746dfb8fa954fe8b1fcaa
View file https://github.com/simstudioai/sim/blob/3ff8e334e2a85ce534e5ba2a2dbe89536ede27de/apps/docs/components/ui/icon-mapping.ts
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/5048/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/5048/files#diff-193abeb0603365b837c7d5ba8637be7ef998dde35d5746dfb8fa954fe8b1fcaa
https://github.com/simstudioai/sim/pull/5048/files#diff-193abeb0603365b837c7d5ba8637be7ef998dde35d5746dfb8fa954fe8b1fcaa
https://github.com/simstudioai/sim/pull/5048/files#diff-193abeb0603365b837c7d5ba8637be7ef998dde35d5746dfb8fa954fe8b1fcaa
https://github.com/simstudioai/sim/pull/5048/files#diff-193abeb0603365b837c7d5ba8637be7ef998dde35d5746dfb8fa954fe8b1fcaa
apps/docs/content/docs/en/integrations/context_dev.mdxhttps://github.com/simstudioai/sim/pull/5048/files#diff-d63961f9d9726e4eb342f7f5d1e6c57ab92bbffe9724897fc3af1820fa06eb51
View file https://github.com/simstudioai/sim/blob/3ff8e334e2a85ce534e5ba2a2dbe89536ede27de/apps/docs/content/docs/en/integrations/context_dev.mdx
Open in desktop https://desktop.github.com
Please reload this pagehttps://github.com/simstudioai/sim/pull/5048/files
apps/docs/content/docs/en/integrations/meta.jsonhttps://github.com/simstudioai/sim/pull/5048/files#diff-59d7506ddfe264c889aa27abd55383fa1815c385f9e008f02aebc41c2d9819ff
View file https://github.com/simstudioai/sim/blob/3ff8e334e2a85ce534e5ba2a2dbe89536ede27de/apps/docs/content/docs/en/integrations/meta.json
Open in desktop https://desktop.github.com
https://github.co/hiddenchars
https://github.com/simstudioai/sim/pull/5048/{{ revealButtonHref }}
https://github.com/simstudioai/sim/pull/5048/files#diff-59d7506ddfe264c889aa27abd55383fa1815c385f9e008f02aebc41c2d9819ff
https://github.com/simstudioai/sim/pull/5048/files#diff-59d7506ddfe264c889aa27abd55383fa1815c385f9e008f02aebc41c2d9819ff
Please reload this pagehttps://github.com/simstudioai/sim/pull/5048/files
Please reload this pagehttps://github.com/simstudioai/sim/pull/5048/files
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.