René's URL Explorer Experiment


Title: GitHub - DFKI/leechcrawler: Incremental crawling capabilities for Apache Tika. Crawl content out of e.g. file systems, http(s) sources (webcrawling) imap(s) servers or your own arbitrary data sources. LeechCrawler offers additional Tika parsers providing these crawling capabilities.

Open Graph Title: GitHub - DFKI/leechcrawler: Incremental crawling capabilities for Apache Tika. Crawl content out of e.g. file systems, http(s) sources (webcrawling) imap(s) servers or your own arbitrary data sources. LeechCrawler offers additional Tika parsers providing these crawling capabilities.

X Title: GitHub - DFKI/leechcrawler: Incremental crawling capabilities for Apache Tika. Crawl content out of e.g. file systems, http(s) sources (webcrawling) imap(s) servers or your own arbitrary data sources. LeechCrawler offers additional Tika parsers providing these crawling capabilities.

Description: Incremental crawling capabilities for Apache Tika. Crawl content out of e.g. file systems, http(s) sources (webcrawling) imap(s) servers or your own arbitrary data sources. LeechCrawler offers additional Tika parsers providing these crawling capabilities. - DFKI/leechcrawler

Open Graph Description: Incremental crawling capabilities for Apache Tika. Crawl content out of e.g. file systems, http(s) sources (webcrawling) imap(s) servers or your own arbitrary data sources. LeechCrawler offers addi...

X Description: Incremental crawling capabilities for Apache Tika. Crawl content out of e.g. file systems, http(s) sources (webcrawling) imap(s) servers or your own arbitrary data sources. LeechCrawler offers addi...

Opengraph URL: https://github.com/DFKI/leechcrawler

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:613c477c-7e26-5f46-f70a-82de9e4d1f45
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idED82:A1401:530D18B:6E0A777:698C82E5
html-safe-nonce7c63558d5459d751e3758bc4337a1245a3f4ac59f81b814b5076c3f2af5b008d
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFRDgyOkExNDAxOjUzMEQxOEI6NkUwQTc3Nzo2OThDODJFNSIsInZpc2l0b3JfaWQiOiI4NDMwODc1OTM0NTcxOTIyMTQ5IiwicmVnaW9uX2VkZ2UiOiJpYWQiLCJyZWdpb25fcmVuZGVyIjoiaWFkIn0=
visitor-hmaccc6e8c99874b2c98859be9e481dfe020863e2c47e7cc41178f24b4a809c15691
hovercard-subject-tagrepository:4296332
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/DFKI/leechcrawler
twitter:imagehttps://opengraph.githubassets.com/7bcba20a37bd7a8014eab7a7aa58f5d01eeeaf6883ed1bd02e1bfa7a4590f001/DFKI/leechcrawler
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/7bcba20a37bd7a8014eab7a7aa58f5d01eeeaf6883ed1bd02e1bfa7a4590f001/DFKI/leechcrawler
og:image:altIncremental crawling capabilities for Apache Tika. Crawl content out of e.g. file systems, http(s) sources (webcrawling) imap(s) servers or your own arbitrary data sources. LeechCrawler offers addi...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None640eeb7b6ff4d8d106235d228c0c286e82592d4d2403227b5b2b4fc5832297a4
turbo-cache-controlno-preview
go-importgithub.com/DFKI/leechcrawler git https://github.com/DFKI/leechcrawler.git
octolytics-dimension-user_id31480769
octolytics-dimension-user_loginDFKI
octolytics-dimension-repository_id4296332
octolytics-dimension-repository_nwoDFKI/leechcrawler
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id4296332
octolytics-dimension-repository_network_root_nwoDFKI/leechcrawler
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release3d444f0a47beeeac94cddbb51c91ab408befe8d4
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/DFKI/leechcrawler#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FDFKI%2Fleechcrawler
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FDFKI%2Fleechcrawler
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=DFKI%2Fleechcrawler
Reloadhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
Reloadhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
Reloadhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
DFKI https://patch-diff.githubusercontent.com/DFKI
leechcrawlerhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FDFKI%2Fleechcrawler
Fork 5 https://patch-diff.githubusercontent.com/login?return_to=%2FDFKI%2Fleechcrawler
Star 8 https://patch-diff.githubusercontent.com/login?return_to=%2FDFKI%2Fleechcrawler
github.com/DFKI/leechcrawlerhttps://github.com/DFKI/leechcrawler
BSD-3-Clause license https://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/LICENSE
8 stars https://patch-diff.githubusercontent.com/DFKI/leechcrawler/stargazers
5 forks https://patch-diff.githubusercontent.com/DFKI/leechcrawler/forks
Branches https://patch-diff.githubusercontent.com/DFKI/leechcrawler/branches
Tags https://patch-diff.githubusercontent.com/DFKI/leechcrawler/tags
Activity https://patch-diff.githubusercontent.com/DFKI/leechcrawler/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2FDFKI%2Fleechcrawler
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FDFKI%2Fleechcrawler
Code https://patch-diff.githubusercontent.com/DFKI/leechcrawler
Issues 0 https://patch-diff.githubusercontent.com/DFKI/leechcrawler/issues
Pull requests 3 https://patch-diff.githubusercontent.com/DFKI/leechcrawler/pulls
Discussions https://patch-diff.githubusercontent.com/DFKI/leechcrawler/discussions
Actions https://patch-diff.githubusercontent.com/DFKI/leechcrawler/actions
Projects 0 https://patch-diff.githubusercontent.com/DFKI/leechcrawler/projects
Wiki https://patch-diff.githubusercontent.com/DFKI/leechcrawler/wiki
Security 0 https://patch-diff.githubusercontent.com/DFKI/leechcrawler/security
Insights https://patch-diff.githubusercontent.com/DFKI/leechcrawler/pulse
Code https://patch-diff.githubusercontent.com/DFKI/leechcrawler
Issues https://patch-diff.githubusercontent.com/DFKI/leechcrawler/issues
Pull requests https://patch-diff.githubusercontent.com/DFKI/leechcrawler/pulls
Discussions https://patch-diff.githubusercontent.com/DFKI/leechcrawler/discussions
Actions https://patch-diff.githubusercontent.com/DFKI/leechcrawler/actions
Projects https://patch-diff.githubusercontent.com/DFKI/leechcrawler/projects
Wiki https://patch-diff.githubusercontent.com/DFKI/leechcrawler/wiki
Security https://patch-diff.githubusercontent.com/DFKI/leechcrawler/security
Insights https://patch-diff.githubusercontent.com/DFKI/leechcrawler/pulse
Brancheshttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/branches
Tagshttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/tags
https://patch-diff.githubusercontent.com/DFKI/leechcrawler/branches
https://patch-diff.githubusercontent.com/DFKI/leechcrawler/tags
235 Commitshttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/commits/master/
https://patch-diff.githubusercontent.com/DFKI/leechcrawler/commits/master/
srchttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/tree/master/src
srchttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/tree/master/src
.gitignorehttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/.gitignore
.gitignorehttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/.gitignore
LICENSEhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/LICENSE
LICENSEhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/LICENSE
README.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/README.md
README.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/README.md
codeSnippets.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/codeSnippets.md
codeSnippets.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/codeSnippets.md
dataprotection.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/dataprotection.md
dataprotection.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/dataprotection.md
extending.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/extending.md
extending.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/extending.md
how2build.txthttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/how2build.txt
how2build.txthttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/how2build.txt
how2start.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/how2start.md
how2start.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/how2start.md
mailinglist.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/mailinglist.md
mailinglist.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/mailinglist.md
people.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/people.md
people.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/people.md
pom.xmlhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/pom.xml
pom.xmlhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/pom.xml
supporters.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/supporters.md
supporters.mdhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/blob/master/supporters.md
READMEhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
Licensehttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
https://patch-diff.githubusercontent.com/DFKI/leechcrawler#leechcrawler
contact ushttps://github.com/leechcrawler/leech/blob/master/people.md
3-Clause BSD Licensehttp://opensource.org/licenses/BSD-3-Clause
DFKI GmbHhttp://www.dfki.de
How to starthttps://github.com/leechcrawler/leech/blob/master/how2start.md
Code snippets / Exampleshttps://github.com/leechcrawler/leech/blob/master/codeSnippets.md
Extending LeechCrawlerhttps://github.com/leechcrawler/leech/blob/master/extending.md
Mailing listhttps://github.com/leechcrawler/leech/blob/master/mailinglist.md
People/Legal Informationhttps://github.com/leechcrawler/leech/blob/master/people.md
Supportershttps://github.com/leechcrawler/leech/blob/master/supporters.md
Data Protectionhttps://github.com/leechcrawler/leech/blob/master/dataprotection.md
github.com/DFKI/leechcrawlerhttps://github.com/DFKI/leechcrawler
metadata https://patch-diff.githubusercontent.com/topics/metadata
incremental https://patch-diff.githubusercontent.com/topics/incremental
tika https://patch-diff.githubusercontent.com/topics/tika
crawling https://patch-diff.githubusercontent.com/topics/crawling
extraction https://patch-diff.githubusercontent.com/topics/extraction
Readme https://patch-diff.githubusercontent.com/DFKI/leechcrawler#readme-ov-file
BSD-3-Clause license https://patch-diff.githubusercontent.com/DFKI/leechcrawler#BSD-3-Clause-1-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
Activityhttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/activity
Custom propertieshttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/custom-properties
8 starshttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/stargazers
6 watchinghttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/watchers
5 forkshttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FDFKI%2Fleechcrawler&report=DFKI+%28user%29
Releaseshttps://patch-diff.githubusercontent.com/DFKI/leechcrawler/releases
Packages 0https://patch-diff.githubusercontent.com/orgs/DFKI/packages?repo_name=leechcrawler
Please reload this pagehttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
Contributors 3https://patch-diff.githubusercontent.com/DFKI/leechcrawler/graphs/contributors
Please reload this pagehttps://patch-diff.githubusercontent.com/DFKI/leechcrawler
Java 99.7% https://patch-diff.githubusercontent.com/DFKI/leechcrawler/search?l=java
Groovy 0.3% https://patch-diff.githubusercontent.com/DFKI/leechcrawler/search?l=groovy
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width


URLs of crawlers that visited me.