René's URL Explorer Experiment


Title: GitHub - Oliverwebdev/WebCrawler: My first start was to build my own comparison portal with Basic GUI. If desired, we scrape data from several sites in order to be able to find the best price directly

Open Graph Title: GitHub - Oliverwebdev/WebCrawler: My first start was to build my own comparison portal with Basic GUI. If desired, we scrape data from several sites in order to be able to find the best price directly

X Title: GitHub - Oliverwebdev/WebCrawler: My first start was to build my own comparison portal with Basic GUI. If desired, we scrape data from several sites in order to be able to find the best price directly

Description: My first start was to build my own comparison portal with Basic GUI. If desired, we scrape data from several sites in order to be able to find the best price directly - Oliverwebdev/WebCrawler

Open Graph Description: My first start was to build my own comparison portal with Basic GUI. If desired, we scrape data from several sites in order to be able to find the best price directly - Oliverwebdev/WebCrawler

X Description: My first start was to build my own comparison portal with Basic GUI. If desired, we scrape data from several sites in order to be able to find the best price directly - Oliverwebdev/WebCrawler

Opengraph URL: https://github.com/Oliverwebdev/WebCrawler

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:1e45c908-a785-a2b9-d752-51eb36c9365c
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-id9072:2A73DB:18101A5:204DC74:698064F3
html-safe-noncee102e00742d14b4bb24e47aefe3067aacb6dfe3f3b023f1d3b5460f392ecf3d5
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI5MDcyOjJBNzNEQjoxODEwMUE1OjIwNERDNzQ6Njk4MDY0RjMiLCJ2aXNpdG9yX2lkIjoiMzkxMTEyNTQ0Nzc1NjI0NDIxMSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac16f3db40629a6834cf6aff337b66d050d41905da98ec897a5ea205be76fb2308
hovercard-subject-tagrepository:887153971
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/Oliverwebdev/WebCrawler
twitter:imagehttps://opengraph.githubassets.com/9e00da26004953aea9feb89401493e19ecbc07f8eba3a46b9b5384b831ccf94b/Oliverwebdev/WebCrawler
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/9e00da26004953aea9feb89401493e19ecbc07f8eba3a46b9b5384b831ccf94b/Oliverwebdev/WebCrawler
og:image:altMy first start was to build my own comparison portal with Basic GUI. If desired, we scrape data from several sites in order to be able to find the best price directly - Oliverwebdev/WebCrawler
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None60279d4097367e16897439d16d6bbe4180663db828c666eeed2656988ffe59f6
turbo-cache-controlno-preview
go-importgithub.com/Oliverwebdev/WebCrawler git https://github.com/Oliverwebdev/WebCrawler.git
octolytics-dimension-user_id135714453
octolytics-dimension-user_loginOliverwebdev
octolytics-dimension-repository_id887153971
octolytics-dimension-repository_nwoOliverwebdev/WebCrawler
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id887153971
octolytics-dimension-repository_network_root_nwoOliverwebdev/WebCrawler
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releasec6a96cd078b54261c0aaa028bdbf4beca00718d1
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FOliverwebdev%2FWebCrawler
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FOliverwebdev%2FWebCrawler
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=Oliverwebdev%2FWebCrawler
Reloadhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
Reloadhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
Reloadhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
Oliverwebdev https://patch-diff.githubusercontent.com/Oliverwebdev
WebCrawlerhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FOliverwebdev%2FWebCrawler
Fork 1 https://patch-diff.githubusercontent.com/login?return_to=%2FOliverwebdev%2FWebCrawler
Star 1 https://patch-diff.githubusercontent.com/login?return_to=%2FOliverwebdev%2FWebCrawler
1 star https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/stargazers
1 fork https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/forks
Branches https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/branches
Tags https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tags
Activity https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2FOliverwebdev%2FWebCrawler
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FOliverwebdev%2FWebCrawler
Code https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
Issues 0 https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/issues
Pull requests 0 https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/pulls
Actions https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/actions
Projects 0 https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/projects
Security 0 https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/security
Insights https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/pulse
Code https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
Issues https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/issues
Pull requests https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/pulls
Actions https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/actions
Projects https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/projects
Security https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/security
Insights https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/pulse
Brancheshttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/branches
Tagshttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tags
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/branches
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tags
27 Commitshttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/commits/main/
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/commits/main/
__pycache__https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/__pycache__
__pycache__https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/__pycache__
databasehttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/database
databasehttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/database
guihttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/gui
guihttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/gui
scrapershttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/scrapers
scrapershttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/scrapers
testshttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/tests
testshttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/tests
utilshttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/utils
utilshttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/utils
venvhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/venv
venvhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/tree/main/venv
.gitignorehttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/.gitignore
.gitignorehttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/.gitignore
README.mdhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/README.md
README.mdhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/README.md
config.pyhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/config.py
config.pyhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/config.py
debug.loghttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/debug.log
debug.loghttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/debug.log
main.pyhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/main.py
main.pyhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/main.py
x11_config.pyhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/x11_config.py
x11_config.pyhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/x11_config.py
READMEhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#smart-shopping-assistant-️
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#-features
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#aktuelle-funktionen
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#-installation
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#️-technische-anforderungen
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#-projektstruktur
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#-roadmap
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#kurzfristige-ziele
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#mittelfristige-ziele
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#langfristige-vision
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#-beitragen
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#️-rechtliche-hinweise
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#-lizenz
LICENSEhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/blob/main/LICENSE
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#-danksagung
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#to-do
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#ebay-amazon-otto-gehen
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#kaufland-zu-starke-anti-bot-maßnahmen
https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#idealo-kleinanzeigen-saturn-zalando-fehlen-noch
Readme https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler#readme-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
Activityhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/activity
1 starhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/stargazers
1 watchinghttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/watchers
1 forkhttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FOliverwebdev%2FWebCrawler&report=Oliverwebdev+%28user%29
Releaseshttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/releases
Packages 0https://patch-diff.githubusercontent.com/users/Oliverwebdev/packages?repo_name=WebCrawler
Please reload this pagehttps://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler
Python 94.5% https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/search?l=python
C 2.2% https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/search?l=c
Cython 2.0% https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/search?l=cython
Tcl 0.7% https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/search?l=tcl
XSLT 0.3% https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/search?l=xslt
C++ 0.2% https://patch-diff.githubusercontent.com/Oliverwebdev/WebCrawler/search?l=c%2B%2B
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.