René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"Organization","name":"Context.dev - The Web Context API","url":"https://www.context.dev","logo":"https://www.context.dev/home/context_dev_logo_icon.svg","description":"The unified API for web data extraction, brand intelligence, and AI-powered insights. Scrape content, extract brand assets, and query any website.","email":"yahia@context.dev","sameAs":["https://x.com/getcontextdev"],"contactPoint":{"@type":"ContactPoint","email":"yahia@context.dev","contactType":"Customer Service"}}

{"@context":"https://schema.org","@type":"WebAPI","name":"Context.dev URL to Markdown API","description":"Convert any URL to clean GitHub Flavored Markdown instantly. Control whether links and images are preserved. Built for LLM pipelines, RAG systems, and content ingestion workflows.","url":"https://www.context.dev/data/web-scrape-markdown-api","documentation":"https://docs.context.dev/api-reference/web-scraping/scrape-url-and-convert-to-markdown","termsOfService":"https://www.context.dev/term","provider":{"@type":"Organization","name":"Context.dev - The Web Context API","url":"https://www.context.dev"}}

{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://www.context.dev"},{"@type":"ListItem","position":2,"name":"Data","item":"https://www.context.dev/data"},{"@type":"ListItem","position":3,"name":"URL to Markdown API","item":"https://www.context.dev/data/web-scrape-markdown-api"}]}

{"@context":"https://schema.org","@type":"FAQPage","mainEntity":[{"@type":"Question","name":"Am I billed for failed requests?","acceptedAnswer":{"@type":"Answer","text":"No. You are not billed for failed requests or requests where we are blocked (rarely happens). Credits are only consumed on successful responses."}},{"@type":"Question","name":"How do I convert HTML to Markdown from a URL?","acceptedAnswer":{"@type":"Answer","text":"Send a GET request to /v1/web/scrape/markdown?url=\u003ctarget\u003e. The API fetches the page (with proxy bypass if needed), parses the HTML, and returns clean GitHub Flavored Markdown. Tables, headings, code blocks, and lists all convert correctly. One call, no setup."}},{"@type":"Question","name":"Why convert HTML to Markdown for LLMs and RAG?","acceptedAnswer":{"@type":"Answer","text":"LLMs process Markdown ~5x more efficiently than HTML. HTML wastes tokens on tags, classes, inline styles, and tracking pixels — content that doesn't help the model and inflates context cost. Markdown preserves the meaningful structure (headings, lists, emphasis) that the model actually needs."}},{"@type":"Question","name":"What Markdown format does the API return?","acceptedAnswer":{"@type":"Answer","text":"GitHub Flavored Markdown (GFM). It's the de facto standard for LLM-readable text, supports tables and code blocks, and renders correctly in Claude, ChatGPT, Gemini, Cursor, and most documentation systems out of the box."}},{"@type":"Question","name":"Can I include or exclude links and images?","acceptedAnswer":{"@type":"Answer","text":"Yes. includeLinks (default: true) keeps hyperlinks as Markdown links so the LLM sees source citations. includeImages (default: false) controls inline images. shortenBase64Images replaces long base64 data URIs with short references, which can save thousands of tokens per page."}},{"@type":"Question","name":"How is this different from Jina Reader or Firecrawl?","acceptedAnswer":{"@type":"Answer","text":"Same idea — URL in, Markdown out — but Context.dev bundles it with the rest of the brand-data stack (logos, colors, NAICS/SIC, transaction enrichment) on a single key. Pricing is per-call with a real free tier; bot-protection bypass is automatic, not a paid add-on."}},{"@type":"Question","name":"Does it work on JavaScript-heavy sites?","acceptedAnswer":{"@type":"Answer","text":"Yes. The fetcher renders JavaScript when the target is a single-page app, then converts the post-render DOM to Markdown. You don't pick a mode — the API picks the right strategy based on the URL."}},{"@type":"Question","name":"Is it free for AI agent use?","acceptedAnswer":{"@type":"Answer","text":"Yes. Work-email signups get 500 API credits at 30 req/min, enough for 500 one-credit Markdown conversions; free-email signups get 250 credits at 10 req/min. Production volume scales linearly with no annual contract."}}]}