René's URL Explorer Experiment


Title: GitHub - apache/stormcrawler: A scalable, mature and versatile web crawler based on Apache Storm

Open Graph Title: GitHub - apache/stormcrawler: A scalable, mature and versatile web crawler based on Apache Storm

X Title: GitHub - apache/stormcrawler: A scalable, mature and versatile web crawler based on Apache Storm

Description: A scalable, mature and versatile web crawler based on Apache Storm - apache/stormcrawler

Open Graph Description: A scalable, mature and versatile web crawler based on Apache Storm - apache/stormcrawler

X Description: A scalable, mature and versatile web crawler based on Apache Storm - apache/stormcrawler

Opengraph URL: https://github.com/apache/stormcrawler

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:62e4ce90-34fe-5ceb-80cf-7595a638bbf2
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idEA3E:212BD5:32495A:43325F:6969C2D3
html-safe-nonce5f91572bb08e0673d55f90a510ac3974faa3f109d933881df31bfb9e9f96e571
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFQTNFOjIxMkJENTozMjQ5NUE6NDMzMjVGOjY5NjlDMkQzIiwidmlzaXRvcl9pZCI6IjMyMzMwNDIwMzI2MDY0Mjk5MDciLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmaca587f4eb295974924224d8ac23c626731ef10c575ea0d292fd529c1a528dff87
hovercard-subject-tagrepository:9395761
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/apache/stormcrawler
twitter:imagehttps://opengraph.githubassets.com/4b6b8f4a14d72e24831a8c2cf84587e82c8a2b154738387d37b81d4e45d60e39/apache/stormcrawler
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/4b6b8f4a14d72e24831a8c2cf84587e82c8a2b154738387d37b81d4e45d60e39/apache/stormcrawler
og:image:altA scalable, mature and versatile web crawler based on Apache Storm - apache/stormcrawler
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneacedec8b5f975d9e3d494ddd8f949b0b8a0de59d393901e26f73df9dcba80056
turbo-cache-controlno-preview
go-importgithub.com/apache/stormcrawler git https://github.com/apache/stormcrawler.git
octolytics-dimension-user_id47359
octolytics-dimension-user_loginapache
octolytics-dimension-repository_id9395761
octolytics-dimension-repository_nwoapache/stormcrawler
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id9395761
octolytics-dimension-repository_network_root_nwoapache/stormcrawler
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release83c08c21cdda978090dc44364b71aa5bc6dcea79
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/apache/stormcrawler#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapache%2Fstormcrawler
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fapache%2Fstormcrawler
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=apache%2Fstormcrawler
Reloadhttps://github.com/apache/stormcrawler
Reloadhttps://github.com/apache/stormcrawler
Reloadhttps://github.com/apache/stormcrawler
apache https://github.com/apache
stormcrawlerhttps://github.com/apache/stormcrawler
Notifications https://github.com/login?return_to=%2Fapache%2Fstormcrawler
Fork 269 https://github.com/login?return_to=%2Fapache%2Fstormcrawler
Star 956 https://github.com/login?return_to=%2Fapache%2Fstormcrawler
stormcrawler.apache.org/https://stormcrawler.apache.org/
Apache-2.0 license https://github.com/apache/stormcrawler/blob/main/LICENSE
956 stars https://github.com/apache/stormcrawler/stargazers
269 forks https://github.com/apache/stormcrawler/forks
Branches https://github.com/apache/stormcrawler/branches
Tags https://github.com/apache/stormcrawler/tags
Activity https://github.com/apache/stormcrawler/activity
Star https://github.com/login?return_to=%2Fapache%2Fstormcrawler
Notifications https://github.com/login?return_to=%2Fapache%2Fstormcrawler
Code https://github.com/apache/stormcrawler
Issues 27 https://github.com/apache/stormcrawler/issues
Pull requests 4 https://github.com/apache/stormcrawler/pulls
Discussions https://github.com/apache/stormcrawler/discussions
Actions https://github.com/apache/stormcrawler/actions
Projects 0 https://github.com/apache/stormcrawler/projects
Security Uh oh! There was an error while loading. Please reload this page. https://github.com/apache/stormcrawler/security
Please reload this pagehttps://github.com/apache/stormcrawler
Insights https://github.com/apache/stormcrawler/pulse
Code https://github.com/apache/stormcrawler
Issues https://github.com/apache/stormcrawler/issues
Pull requests https://github.com/apache/stormcrawler/pulls
Discussions https://github.com/apache/stormcrawler/discussions
Actions https://github.com/apache/stormcrawler/actions
Projects https://github.com/apache/stormcrawler/projects
Security https://github.com/apache/stormcrawler/security
Insights https://github.com/apache/stormcrawler/pulse
Brancheshttps://github.com/apache/stormcrawler/branches
Tagshttps://github.com/apache/stormcrawler/tags
https://github.com/apache/stormcrawler/branches
https://github.com/apache/stormcrawler/tags
2,427 Commitshttps://github.com/apache/stormcrawler/commits/main/
https://github.com/apache/stormcrawler/commits/main/
.githubhttps://github.com/apache/stormcrawler/tree/main/.github
.githubhttps://github.com/apache/stormcrawler/tree/main/.github
.mvnhttps://github.com/apache/stormcrawler/tree/main/.mvn
.mvnhttps://github.com/apache/stormcrawler/tree/main/.mvn
archetypehttps://github.com/apache/stormcrawler/tree/main/archetype
archetypehttps://github.com/apache/stormcrawler/tree/main/archetype
corehttps://github.com/apache/stormcrawler/tree/main/core
corehttps://github.com/apache/stormcrawler/tree/main/core
docshttps://github.com/apache/stormcrawler/tree/main/docs
docshttps://github.com/apache/stormcrawler/tree/main/docs
externalhttps://github.com/apache/stormcrawler/tree/main/external
externalhttps://github.com/apache/stormcrawler/tree/main/external
.asf.yamlhttps://github.com/apache/stormcrawler/blob/main/.asf.yaml
.asf.yamlhttps://github.com/apache/stormcrawler/blob/main/.asf.yaml
.gitattributeshttps://github.com/apache/stormcrawler/blob/main/.gitattributes
.gitattributeshttps://github.com/apache/stormcrawler/blob/main/.gitattributes
.gitignorehttps://github.com/apache/stormcrawler/blob/main/.gitignore
.gitignorehttps://github.com/apache/stormcrawler/blob/main/.gitignore
CONTRIBUTING.mdhttps://github.com/apache/stormcrawler/blob/main/CONTRIBUTING.md
CONTRIBUTING.mdhttps://github.com/apache/stormcrawler/blob/main/CONTRIBUTING.md
DISCLAIMER-BINARIES.txthttps://github.com/apache/stormcrawler/blob/main/DISCLAIMER-BINARIES.txt
DISCLAIMER-BINARIES.txthttps://github.com/apache/stormcrawler/blob/main/DISCLAIMER-BINARIES.txt
LICENSEhttps://github.com/apache/stormcrawler/blob/main/LICENSE
LICENSEhttps://github.com/apache/stormcrawler/blob/main/LICENSE
NOTICEhttps://github.com/apache/stormcrawler/blob/main/NOTICE
NOTICEhttps://github.com/apache/stormcrawler/blob/main/NOTICE
README.mdhttps://github.com/apache/stormcrawler/blob/main/README.md
README.mdhttps://github.com/apache/stormcrawler/blob/main/README.md
RELEASING.mdhttps://github.com/apache/stormcrawler/blob/main/RELEASING.md
RELEASING.mdhttps://github.com/apache/stormcrawler/blob/main/RELEASING.md
THIRD-PARTY.propertieshttps://github.com/apache/stormcrawler/blob/main/THIRD-PARTY.properties
THIRD-PARTY.propertieshttps://github.com/apache/stormcrawler/blob/main/THIRD-PARTY.properties
THIRD-PARTY.txthttps://github.com/apache/stormcrawler/blob/main/THIRD-PARTY.txt
THIRD-PARTY.txthttps://github.com/apache/stormcrawler/blob/main/THIRD-PARTY.txt
assembly.xmlhttps://github.com/apache/stormcrawler/blob/main/assembly.xml
assembly.xmlhttps://github.com/apache/stormcrawler/blob/main/assembly.xml
checkstyle.xmlhttps://github.com/apache/stormcrawler/blob/main/checkstyle.xml
checkstyle.xmlhttps://github.com/apache/stormcrawler/blob/main/checkstyle.xml
pom.xmlhttps://github.com/apache/stormcrawler/blob/main/pom.xml
pom.xmlhttps://github.com/apache/stormcrawler/blob/main/pom.xml
READMEhttps://github.com/apache/stormcrawler
Code of conducthttps://github.com/apache/stormcrawler
Contributinghttps://github.com/apache/stormcrawler
Apache-2.0 licensehttps://github.com/apache/stormcrawler
Securityhttps://github.com/apache/stormcrawler
https://stormcrawler.apache.org/
https://github.com/apache/stormcrawler
http://www.apache.org/licenses/LICENSE-2.0
https://github.com/apache/stormcrawler/actions/workflows/maven.yml/badge.svg
https://javadoc.io/doc/org.apache.stormcrawler/stormcrawler-core/
Apache Stormhttp://storm.apache.org/
Apache Licensehttp://www.apache.org/licenses/LICENSE-2.0
https://github.com/apache/stormcrawler#quickstart
Apache Mavenhttps://maven.apache.org/install.html
Apache Storm 2.8.3http://storm.apache.org/
archetype-resourceshttps://github.com/apache/stormcrawler/tree/master/archetype/src/main/resources/archetype-resources
crawler.fluxhttps://github.com/apache/stormcrawler/blob/master/archetype/src/main/resources/archetype-resources/crawler.flux
crawler-conf.yamlhttps://github.com/apache/stormcrawler/blob/master/archetype/src/main/resources/archetype-resources/crawler-conf.yaml
src/main/resources/https://github.com/apache/stormcrawler/tree/master/archetype/src/main/resources/archetype-resources/src/main/resources
https://github.com/apache/stormcrawler#getting-help
WIKIhttps://github.com/apache/stormcrawler/wiki
stormcrawlerhttp://stackoverflow.com/questions/tagged/stormcrawler
discussionshttps://github.com/apache/stormcrawler/discussions
commercial supporthttps://stormcrawler.apache.org/support/
https://github.com/apache/stormcrawler#note-for-developers
https://github.com/apache/stormcrawler#building-from-source
https://github.com/apache/stormcrawler#thanks
https://camo.githubusercontent.com/a5990ccfccc5178bb8f130666cc2d2b6faa481d42247a2158c144ed6c81b7846/68747470733a2f2f7777772e796f75726b69742e636f6d2f696d616765732f796b6c6f676f2e706e67
YourKit Java Profilerhttps://www.yourkit.com/java/profiler/index.jsp
YourKit .NET Profilerhttps://www.yourkit.com/.net/profiler/index.jsp
stormcrawler.apache.org/https://stormcrawler.apache.org/
java https://github.com/topics/java
crawler https://github.com/topics/crawler
web-crawler https://github.com/topics/web-crawler
distributed https://github.com/topics/distributed
apache-storm https://github.com/topics/apache-storm
stormcrawler https://github.com/topics/stormcrawler
Readme https://github.com/apache/stormcrawler#readme-ov-file
Apache-2.0 license https://github.com/apache/stormcrawler#Apache-2.0-1-ov-file
Code of conduct https://github.com/apache/stormcrawler#coc-ov-file
Contributing https://github.com/apache/stormcrawler#contributing-ov-file
Security policy https://github.com/apache/stormcrawler#security-ov-file
Please reload this pagehttps://github.com/apache/stormcrawler
Activityhttps://github.com/apache/stormcrawler/activity
Custom propertieshttps://github.com/apache/stormcrawler/custom-properties
956 starshttps://github.com/apache/stormcrawler/stargazers
61 watchinghttps://github.com/apache/stormcrawler/watchers
269 forkshttps://github.com/apache/stormcrawler/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fapache%2Fstormcrawler&report=apache+%28user%29
Releases 32https://github.com/apache/stormcrawler/releases
stormcrawler-3.5.0 Latest Sep 16, 2025 https://github.com/apache/stormcrawler/releases/tag/stormcrawler-3.5.0
+ 31 releaseshttps://github.com/apache/stormcrawler/releases
Please reload this pagehttps://github.com/apache/stormcrawler
Contributors 59https://github.com/apache/stormcrawler/graphs/contributors
https://github.com/jnioche
https://github.com/apps/dependabot
https://github.com/rzo1
https://github.com/sebastian-nagel
https://github.com/jniocheCF
https://github.com/apps/github-actions
https://github.com/mvolikas
https://github.com/jorgelbg
https://github.com/tballison
https://github.com/sigee
https://github.com/mattburns
https://github.com/Mikwiss
https://github.com/FelixEngl
https://github.com/pjfanning
+ 45 contributorshttps://github.com/apache/stormcrawler/graphs/contributors
Java 100.0% https://github.com/apache/stormcrawler/search?l=java
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.