react-profiling 0 react-import-map react,react-dom,react-dom/client,react-dom/profiling,react-is,react-reconciler,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@d5750093facf route-pattern /:user_id/:repository/issues(.:format) route-controller issues route-action index fetch-nonce v2:49430cf0-b3c5-7645-73a5-88dd898d3090 current-catalog-service-hash 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 request-id 950C:1EB0:B893C2:F39246:6AEC0764 html-safe-nonce f2d5c26990e2dfea0976d14d339cfb88ed91c073ff116fad1f75aec79bb7348b visitor-payload eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5NTBDOjFFQjA6Qjg5M0MyOkYzOTI0Njo2QUVDMDc2NCIsInZpc2l0b3JfaWQiOiI3MTUwNjI1Mjc5Nzc1MDgyMzQwIiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0= visitor-hmac 2c5335ca30ec6293ac35d782c74d37b196225a7d59bd4c2da617f453f416ca8e hovercard-subject-tag repository:798201435 github-keyboard-shortcuts repository,issues,copilot google-site-verification Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I octolytics-url https://collector.github.com/github/collect analytics-location ///issues/index fb:app_id 1401488693436528 apple-itunes-app app-id=1477376905, app-argument=https://github.com/unclecode/crawl4ai/issues twitter:image https://repository-images.githubusercontent.com/798201435/243182ed-680b-4a99-8c9d-7a0506494419 twitter:card summary_large_image og:image https://repository-images.githubusercontent.com/798201435/243182ed-680b-4a99-8c9d-7a0506494419 og:image:alt Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that p... og:site_name GitHub og:type object hostname github.com expected-hostname github.com None d063d52022f5f270ef55a70761d126c8085d492d3c251084b07781784c02dad4 turbo-cache-control no-cache go-import github.com/unclecode/crawl4ai git https://github.com/unclecode/crawl4ai.git octolytics-dimension-user_id 12494079 octolytics-dimension-user_login unclecode octolytics-dimension-repository_id 798201435 octolytics-dimension-repository_nwo unclecode/crawl4ai octolytics-dimension-repository_public true octolytics-dimension-repository_is_fork false octolytics-dimension-repository_network_root_id 798201435 octolytics-dimension-repository_network_root_nwo unclecode/crawl4ai turbo-body-classes logged-out env-production page-responsive disable-turbo false browser-stats-url https://api.github.com/_private/browser/stats browser-errors-url https://api.github.com/_private/browser/errors release 56e59340194011ba3cb6809acfa979ccbd174288 ui-target full theme-color #1e2327 color-scheme light dark react-app-name issues
Skip to content https://github.com/unclecode/crawl4ai/issues#start-of-content https://github.com/ Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Funclecode%2Fcrawl4ai%2Fissues GitHubRepository hosting, code review, and collaboration https://github.com/platform CopilotAI coding agent for tasks, projects and automated work https://github.com/features/copilot ActionsCI/CD and automation https://github.com/features/actions Code QualityQuality analysis, fixes, and enforcement https://github.com/features/code-quality CodespacesCloud development environments https://github.com/features/codespaces Code SecurityVulnerability detection and remediation https://github.com/security/advanced-security/code-security Secret ProtectionSecret scanning and leak prevention https://github.com/security/advanced-security/secret-protection All Features https://github.com/features Documentation https://docs.github.com/en Training https://learn.github.com/skills Certifications https://learn.github.com/credentials Build with Copilot https://github.com/features/ai Customize Copilot https://docs.github.com/en/copilot/how-tos/copilot-on-github/customize-copilot/customize-copilot-overview Integrations https://github.com/marketplace Trending repos https://github.com/trending GitHub Sponsors https://github.com/open-source/sponsors Developer articles https://github.com/resources/articles ChangelogYour source for the latest features, improvements, and fixes across GitHub products, all in one place. https://github.blog/changelog/ Enterprises https://github.com/enterprise Team https://github.com/team Startups https://github.com/enterprise/startups Nonprofits https://github.com/solutions/industry/nonprofits Healthcare https://github.com/solutions/industry/healthcare Financial services https://github.com/solutions/industry/financial-services Manufacturing https://github.com/solutions/industry/manufacturing Government https://github.com/solutions/industry/government See all industries https://github.com/solutions/industry Why GitHub https://github.com/why-github Customer Stories https://github.com/customer-stories Business insights https://github.com/solutions/executive-insights Trust Center https://github.com/trust-center GitHub Advanced SecurityEnterprise-grade code security https://github.com/security/advanced-security Copilot for businessEnterprise-grade AI features https://github.com/features/copilot/copilot-business Premium SupportEnterprise-grade 24/7 support https://github.com/enterprise/premium-support Documentation https://docs.github.com/en Resource center https://github.com/resources Blog https://github.blog/ Events & webinars https://github.com/resources/events Community Forum https://github.com/orgs/community/discussions Customer Stories https://github.com/customer-stories Integrations https://github.com/marketplace Customer support https://help.github.com/ Training https://learn.github.com/skills GitHub Status https://www.githubstatus.com/ About https://github.com/about Partners https://github.com/partners Changelog https://github.blog/changelog/ GitHub UniverseThe event for developers, by developers — talks, workshops, and what’s next for GitHub. https://githubuniverse.com/ Pricing https://github.com/pricing Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Funclecode%2Fcrawl4ai%2Fissues Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Fissues%2Findex&source=header-repo&source_repo=unclecode%2Fcrawl4ai Reload https://github.com/unclecode/crawl4ai/issues Reload https://github.com/unclecode/crawl4ai/issues Reload https://github.com/unclecode/crawl4ai/issues unclecode https://github.com/unclecode crawl4ai https://github.com/unclecode/crawl4ai Code https://github.com/unclecode/crawl4ai Issues56 (56) https://github.com/unclecode/crawl4ai/issues Pull requests255 (255) https://github.com/unclecode/crawl4ai/pulls Discussions https://github.com/unclecode/crawl4ai/discussions Actions https://github.com/unclecode/crawl4ai/actions Projects https://github.com/unclecode/crawl4ai/projects Security and quality25 (25) https://github.com/unclecode/crawl4ai/security Insights https://github.com/unclecode/crawl4ai/pulse https://github.com/unclecode/crawl4ai Issues https://github.com/unclecode/crawl4ai/issues?q=is%3Aissue+state%3Aopen Assigned to me https://github.com/unclecode/crawl4ai/issues?q=is%3Aissue+state%3Aopen+assignee%3A%40me Created by me https://github.com/unclecode/crawl4ai/issues?q=is%3Aissue+state%3Aopen+author%3A%40me Mentioned https://github.com/unclecode/crawl4ai/issues?q=is%3Aissue+state%3Aopen+mentions%3A%40me Recent activity https://github.com/unclecode/crawl4ai/issues?q=is%3Aissue+updated%3A%3E%40today-1w+sort%3Aupdated-desc Views https://github.com/unclecode/crawl4ai/issues/views Projects https://github.com/unclecode/crawl4ai/projects Milestones https://github.com/unclecode/crawl4ai/milestones Labels https://github.com/unclecode/crawl4ai/labels FeedbackPreview https://gh.io/issues-sidebar-feedback New issue https://github.com/login?return_to=https://github.com/unclecode/crawl4ai/issues Open56 (56) https://github.com/unclecode/crawl4ai/issues Closed https://github.com/unclecode/crawl4ai/issues [Bug]: Hardened docker-compose (read_only) keeps full Chromium from starting: crashpad needs a writable ~/.config https://github.com/unclecode/crawl4ai/issues/2494 [Bug]: Default user agent is a stale Chrome/116 string that contradicts the bundled Chromium https://github.com/unclecode/crawl4ai/issues/2493 [Bug]: Wrong error message on failed crawling with CacheMode.ENABLED https://github.com/unclecode/crawl4ai/issues/2490 [Bug]: Crawl4aiDockerClient cannot send 0.9 declarative hooks, and returns result.pdf as base64 text https://github.com/unclecode/crawl4ai/issues/2483 [Feature]: Crawl4aiDockerClient has no public option for the API token the 0.9 server requires https://github.com/unclecode/crawl4ai/issues/2474 Bug]: Crawl4aiDockerClient gets 400 with any BrowserConfig: dump() always sends the generated headers https://github.com/unclecode/crawl4ai/issues/2472 [Bug]: PDF images saved with save_images_locally=True come back with an empty src in result.media https://github.com/unclecode/crawl4ai/issues/2469 RFC: optional actionable-snapshot ExtractionStrategy — elements + selectors + state, ~68% lighter than raw_markdown for action-selection https://github.com/unclecode/crawl4ai/issues/2463 [Bug]: PDF scrape thread outlives Docker crawl deadline; no total download/parse timeout https://github.com/unclecode/crawl4ai/issues/2460 [Bug]: deep crawl configs from dump() are rejected by the server (logger: null) and DFS strategies dump empty https://github.com/unclecode/crawl4ai/issues/2450 [Bug]: SEOFilter drops keywords and weights in dump()/load() https://github.com/unclecode/crawl4ai/issues/2441 Locale-dependent text IO: tasklist probe and browser launch diagnostics crash under UTF-8 mode; Common Crawl URL cache fails on non-ASCII URLs https://github.com/unclecode/crawl4ai/issues/2439 Discussion: migrate BrowserConfig.ignore_https_errors default to False (deprecation path) https://github.com/unclecode/crawl4ai/issues/2437 [Bug]: FreshnessScorer defaults to current_year=2024, so this year's URLs score like undated ones https://github.com/unclecode/crawl4ai/issues/2426 [Bug]: CrawlerRunConfig.dump()/load() drops deep-crawl filter and scorer arguments, so a DomainFilter allows every domain https://github.com/unclecode/crawl4ai/issues/2424 [Bug]: Docker server egress proxy resolves DNS synchronously on the event loop, stalling the whole server under load https://github.com/unclecode/crawl4ai/issues/2423 [Bug]: Docker server deadlocks on browser recycle: get_page() leaks context refcounts on cancellation, then waits forever for a drain slot https://github.com/unclecode/crawl4ai/issues/2419 [Bug]: PruningContentFilter cuts inline spans out of sentences it keeps (e.g. "renamed Tokyo (lit. '')") https://github.com/unclecode/crawl4ai/issues/2417 [Bug]: Text after an inline