René's URL Explorer Experiment


Title: GitHub - jasnaturecode/DotnetSpider: DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

Open Graph Title: GitHub - jasnaturecode/DotnetSpider: DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

X Title: GitHub - jasnaturecode/DotnetSpider: DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

Description: DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework - jasnaturecode/DotnetSpider

Open Graph Description: DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework - jasnaturecode/DotnetSpider

X Description: DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework - jasnaturecode/DotnetSpider

Mail addresses
zlzforever@163.com

Opengraph URL: https://github.com/jasnaturecode/DotnetSpider

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:664307a4-2e27-9853-047c-a21f30af85f1
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idE8F2:150367:131E0E8:1824566:697F21A6
html-safe-nonce2710dd21d809749fb7993ce7b1a6ee3cf98164080a89f657265d12cfa8039245
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFOEYyOjE1MDM2NzoxMzFFMEU4OjE4MjQ1NjY6Njk3RjIxQTYiLCJ2aXNpdG9yX2lkIjoiNzM4NzQ1MzA5MjE2NzM2MDkzNCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac253ac7b05749910b8e584f682100052e779618e73b08b4eab83d81f46b5c95a9
hovercard-subject-tagrepository:807398543
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/jasnaturecode/DotnetSpider
twitter:imagehttps://opengraph.githubassets.com/a74deec77b5231f17914ab42ad5a22e30d03271c1df044cbe3fdbc3d4097b558/jasnaturecode/DotnetSpider
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/a74deec77b5231f17914ab42ad5a22e30d03271c1df044cbe3fdbc3d4097b558/jasnaturecode/DotnetSpider
og:image:altDotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework - jasnaturecode/DotnetSpider
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None60279d4097367e16897439d16d6bbe4180663db828c666eeed2656988ffe59f6
turbo-cache-controlno-preview
go-importgithub.com/jasnaturecode/DotnetSpider git https://github.com/jasnaturecode/DotnetSpider.git
octolytics-dimension-user_id12742808
octolytics-dimension-user_loginjasnaturecode
octolytics-dimension-repository_id807398543
octolytics-dimension-repository_nwojasnaturecode/DotnetSpider
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id54357610
octolytics-dimension-repository_parent_nwodotnetcore/DotnetSpider
octolytics-dimension-repository_network_root_id54357610
octolytics-dimension-repository_network_root_nwodotnetcore/DotnetSpider
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release7c85641c598ad130c74f7bcc27f58575cac69551
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fjasnaturecode%2FDotnetSpider
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fjasnaturecode%2FDotnetSpider
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=jasnaturecode%2FDotnetSpider
Reloadhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
Reloadhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
Reloadhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
jasnaturecode https://patch-diff.githubusercontent.com/jasnaturecode
DotnetSpiderhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
dotnetcore/DotnetSpiderhttps://patch-diff.githubusercontent.com/dotnetcore/DotnetSpider
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fjasnaturecode%2FDotnetSpider
Fork 0 https://patch-diff.githubusercontent.com/login?return_to=%2Fjasnaturecode%2FDotnetSpider
Star 0 https://patch-diff.githubusercontent.com/login?return_to=%2Fjasnaturecode%2FDotnetSpider
MIT license https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/LICENSE.txt
0 stars https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/stargazers
1.1k forks https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/forks
Branches https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/branches
Tags https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tags
Activity https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2Fjasnaturecode%2FDotnetSpider
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fjasnaturecode%2FDotnetSpider
Code https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
Pull requests 0 https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/pulls
Actions https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/actions
Projects 0 https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/projects
Security 0 https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/security
Insights https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/pulse
Code https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
Pull requests https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/pulls
Actions https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/actions
Projects https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/projects
Security https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/security
Insights https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/pulse
Brancheshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/branches
Tagshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tags
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/branches
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tags
125 Commitshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/commits/master/
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/commits/master/
docker-composehttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tree/master/docker-compose
docker-composehttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tree/master/docker-compose
dockerfilehttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tree/master/dockerfile
dockerfilehttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tree/master/dockerfile
imageshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tree/master/images
imageshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tree/master/images
srchttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tree/master/src
srchttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/tree/master/src
.editorconfighttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/.editorconfig
.editorconfighttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/.editorconfig
.gitignorehttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/.gitignore
.gitignorehttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/.gitignore
Directory.Build.propshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/Directory.Build.props
Directory.Build.propshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/Directory.Build.props
DotnetSpider.slnhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/DotnetSpider.sln
DotnetSpider.slnhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/DotnetSpider.sln
LICENSE.txthttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/LICENSE.txt
LICENSE.txthttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/LICENSE.txt
README.mdhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/README.md
README.mdhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/README.md
azure-pipelines.ymlhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/azure-pipelines.yml
azure-pipelines.ymlhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/azure-pipelines.yml
build.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/build.sh
build.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/build.sh
build_agent.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/build_agent.sh
build_agent.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/build_agent.sh
build_portal.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/build_portal.sh
build_portal.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/build_portal.sh
build_spiders.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/build_spiders.sh
build_spiders.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/build_spiders.sh
package.propshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/package.props
package.propshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/package.props
publish.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish.sh
publish.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish.sh
publish_agent.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_agent.sh
publish_agent.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_agent.sh
publish_myget.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_myget.sh
publish_myget.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_myget.sh
publish_nuget.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_nuget.sh
publish_nuget.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_nuget.sh
publish_package.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_package.sh
publish_package.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_package.sh
publish_portal.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_portal.sh
publish_portal.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_portal.sh
publish_spiders.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_spiders.sh
publish_spiders.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_spiders.sh
publish_startup.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_startup.sh
publish_startup.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/publish_startup.sh
runtests.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/runtests.sh
runtests.shhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/blob/master/runtests.sh
READMEhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
Licensehttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#dotnetspider
https://dev.azure.com/zlzforever/DotnetSpider/_build/latest?definitionId=3&branchName=master
https://www.nuget.org/packages/DotnetSpider
https://github.com/dotnetcore
https://github.com/dotnetcore/DotnetSpider/blob/master/LICENSE.txt
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#design
https://github.com/dotnetcore/DotnetSpider/blob/master/images/%E6%95%B0%E6%8D%AE%E9%87%87%E9%9B%86%E7%B3%BB%E7%BB%9F.png?raw=true
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#develop-enviroment
.NET Core 2.2 or laterhttps://www.microsoft.com/net/download/windows
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#more-documents
https://github.com/dotnetcore/DotnetSpider/wikihttps://github.com/dotnetcore/DotnetSpider/wiki
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#samples
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#base-usage
Base usage Codeshttps://github.com/zlzforever/DotnetSpider/blob/master/src/DotnetSpider.Sample/samples/BaseUsage.cs
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#additional-usage-configurable-entity-spider
View complete Codeshttps://github.com/zlzforever/DotnetSpider/blob/master/src/DotnetSpider.Sample/samples/EntitySpider.cs
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#distributed-spider
Read this documenthttps://github.com/dotnetcore/DotnetSpider/wiki/3-Distributed-Spider
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#puppeteer-downloader
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#notice
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#when-you-use-redis-scheduler-please-update-your-redis-config
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#dependencies
https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#areas-for-improvements
Readme https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#readme-ov-file
MIT license https://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider#MIT-1-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider
Activityhttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/activity
Custom propertieshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/custom-properties
0 starshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/stargazers
0 watchinghttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/watchers
0 forkshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fjasnaturecode%2FDotnetSpider&report=jasnaturecode+%28user%29
Releaseshttps://patch-diff.githubusercontent.com/jasnaturecode/DotnetSpider/releases
Packages 0https://patch-diff.githubusercontent.com/orgs/jasnaturecode/packages?repo_name=DotnetSpider
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.