René's URL Explorer Experiment


Title: crawlee-python/.github at master · darksoftinc/crawlee-python · GitHub

Open Graph Title: crawlee-python/.github at master · darksoftinc/crawlee-python

X Title: crawlee-python/.github at master · darksoftinc/crawlee-python

Description: Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation. - crawlee-python/.github at master · darksoftinc/crawlee-python

Open Graph Description: Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo...

X Description: Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo...

Opengraph URL: https://github.com/darksoftinc/crawlee-python/tree/master/.github

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository/tree/*name(/*path)
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:47bc9112-e059-12b8-e0c9-3cfa0ebb76c5
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id9698:1D1DA6:1C03C88:254C68B:6A5BCC1E
html-safe-noncee4aa92e1a29d2b11daa6bd427c1f99b17cefe99554cc4e665129bcf8b7ff4c9a
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5Njk4OjFEMURBNjoxQzAzQzg4OjI1NEM2OEI6NkE1QkNDMUUiLCJ2aXNpdG9yX2lkIjoiMTk0MTI0NTA1ODMwNjc4ODM4MiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac2122a82e0004189c4c781ceeeaf0361b7aebff976e79ba586e833c5f25c838a0
hovercard-subject-tagrepository:885196631
github-keyboard-shortcutsrepository,source-code,file-tree,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location///files/disambiguate
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/darksoftinc/crawlee-python/tree/master/.github
twitter:imagehttps://opengraph.githubassets.com/eda6bd17aae0261639a84116da3bb9b94c65b852ca21b30bdb987b6c63a12671/darksoftinc/crawlee-python
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/eda6bd17aae0261639a84116da3bb9b94c65b852ca21b30bdb987b6c63a12671/darksoftinc/crawlee-python
og:image:altCrawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None5290d7e14309ad1e76106a9c4237bd1041517e83ea182c8ab756752cb0c6940b
turbo-cache-controlno-cache
go-importgithub.com/darksoftinc/crawlee-python git https://github.com/darksoftinc/crawlee-python.git
octolytics-dimension-user_id9470730
octolytics-dimension-user_logindarksoftinc
octolytics-dimension-repository_id885196631
octolytics-dimension-repository_nwodarksoftinc/crawlee-python
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id741365632
octolytics-dimension-repository_parent_nwoapify/crawlee-python
octolytics-dimension-repository_network_root_id741365632
octolytics-dimension-repository_network_root_nwoapify/crawlee-python
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release9c975978430e9ad293956f2bbdaf153b1bd84a99
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/darksoftinc/crawlee-python/tree/master/.github#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdarksoftinc%2Fcrawlee-python%2Ftree%2Fmaster%2F.github
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/open-source/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/open-source/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/enterprise/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fdarksoftinc%2Fcrawlee-python%2Ftree%2Fmaster%2F.github
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E%2Ffiles%2Fdisambiguate&source=header-repo&source_repo=darksoftinc%2Fcrawlee-python
Reloadhttps://github.com/darksoftinc/crawlee-python/tree/master/.github
Reloadhttps://github.com/darksoftinc/crawlee-python/tree/master/.github
Reloadhttps://github.com/darksoftinc/crawlee-python/tree/master/.github
darksoftinc https://github.com/darksoftinc
crawlee-pythonhttps://github.com/darksoftinc/crawlee-python
apify/crawlee-pythonhttps://github.com/apify/crawlee-python
Notifications https://github.com/login?return_to=%2Fdarksoftinc%2Fcrawlee-python
Fork 0 https://github.com/login?return_to=%2Fdarksoftinc%2Fcrawlee-python
Star 0 https://github.com/login?return_to=%2Fdarksoftinc%2Fcrawlee-python
Code https://github.com/darksoftinc/crawlee-python
Pull requests 0 https://github.com/darksoftinc/crawlee-python/pulls
Actions https://github.com/darksoftinc/crawlee-python/actions
Projects https://github.com/darksoftinc/crawlee-python/projects
Security and quality 0 https://github.com/darksoftinc/crawlee-python/security
Insights https://github.com/darksoftinc/crawlee-python/pulse
Code https://github.com/darksoftinc/crawlee-python
Pull requests https://github.com/darksoftinc/crawlee-python/pulls
Actions https://github.com/darksoftinc/crawlee-python/actions
Projects https://github.com/darksoftinc/crawlee-python/projects
Security and quality https://github.com/darksoftinc/crawlee-python/security
Insights https://github.com/darksoftinc/crawlee-python/pulse
https://github.com/darksoftinc/crawlee-python
crawlee-pythonhttps://github.com/darksoftinc/crawlee-python/tree/master
Historyhttps://github.com/darksoftinc/crawlee-python/commits/master/.github
https://github.com/darksoftinc/crawlee-python/commits/master/.github
crawlee-pythonhttps://github.com/darksoftinc/crawlee-python/tree/master
..https://github.com/darksoftinc/crawlee-python/tree/master
workflowshttps://github.com/darksoftinc/crawlee-python/tree/master/.github/workflows
workflowshttps://github.com/darksoftinc/crawlee-python/tree/master/.github/workflows
CODEOWNERShttps://github.com/darksoftinc/crawlee-python/blob/master/.github/CODEOWNERS
CODEOWNERShttps://github.com/darksoftinc/crawlee-python/blob/master/.github/CODEOWNERS
pull_request_template.mdhttps://github.com/darksoftinc/crawlee-python/blob/master/.github/pull_request_template.md
pull_request_template.mdhttps://github.com/darksoftinc/crawlee-python/blob/master/.github/pull_request_template.md
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.