René's URL Explorer Experiment


Title: GitHub - UWCSESecurityLab/adscraper: A web crawler for scraping online ad content

Open Graph Title: GitHub - UWCSESecurityLab/adscraper: A web crawler for scraping online ad content

X Title: GitHub - UWCSESecurityLab/adscraper: A web crawler for scraping online ad content

Description: A web crawler for scraping online ad content. Contribute to UWCSESecurityLab/adscraper development by creating an account on GitHub.

Open Graph Description: A web crawler for scraping online ad content. Contribute to UWCSESecurityLab/adscraper development by creating an account on GitHub.

X Description: A web crawler for scraping online ad content. Contribute to UWCSESecurityLab/adscraper development by creating an account on GitHub.

Opengraph URL: https://github.com/UWCSESecurityLab/adscraper

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:12401471-e047-fef2-bf61-6c8a19925973
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idC2C0:126A3:4E9E7C:6AC8E4:6981DF13
html-safe-noncefdcc279e9f8a9791c3d2e97d6f5edb3513c100a00c894236967206fd5649b42a
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJDMkMwOjEyNkEzOjRFOUU3Qzo2QUM4RTQ6Njk4MURGMTMiLCJ2aXNpdG9yX2lkIjoiMjUyMDEyNDAyNzUwNzQzMzIzNSIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac0818e08dac082aa4001db8e7bc44a12ded685911761ef57e51981fe5df6adce3
hovercard-subject-tagrepository:374033126
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/UWCSESecurityLab/adscraper
twitter:imagehttps://opengraph.githubassets.com/c57a371c2648483fbbc327d40add649b5f409fe2242996700dc9e0e8dcbd45ec/UWCSESecurityLab/adscraper
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/c57a371c2648483fbbc327d40add649b5f409fe2242996700dc9e0e8dcbd45ec/UWCSESecurityLab/adscraper
og:image:altA web crawler for scraping online ad content. Contribute to UWCSESecurityLab/adscraper development by creating an account on GitHub.
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneebfdf8d3e0fd17b103f41cc6696d84938694ebebdfecaf11fe00dbe4a9785801
turbo-cache-controlno-preview
go-importgithub.com/UWCSESecurityLab/adscraper git https://github.com/UWCSESecurityLab/adscraper.git
octolytics-dimension-user_id8323478
octolytics-dimension-user_loginUWCSESecurityLab
octolytics-dimension-repository_id374033126
octolytics-dimension-repository_nwoUWCSESecurityLab/adscraper
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id374033126
octolytics-dimension-repository_network_root_nwoUWCSESecurityLab/adscraper
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release471ae8701b77c1bf177c58019d2e6fd65ae89141
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FUWCSESecurityLab%2Fadscraper
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2FUWCSESecurityLab%2Fadscraper
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=UWCSESecurityLab%2Fadscraper
Reloadhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
Reloadhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
Reloadhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
UWCSESecurityLab https://patch-diff.githubusercontent.com/UWCSESecurityLab
adscraperhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FUWCSESecurityLab%2Fadscraper
Fork 12 https://patch-diff.githubusercontent.com/login?return_to=%2FUWCSESecurityLab%2Fadscraper
Star 40 https://patch-diff.githubusercontent.com/login?return_to=%2FUWCSESecurityLab%2Fadscraper
MIT license https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/LICENSE.md
40 stars https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/stargazers
12 forks https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/forks
Branches https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/branches
Tags https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/tags
Activity https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2FUWCSESecurityLab%2Fadscraper
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2FUWCSESecurityLab%2Fadscraper
Code https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
Issues 1 https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/issues
Pull requests 0 https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/pulls
Actions https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/actions
Projects 0 https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/projects
Security 0 https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/security
Insights https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/pulse
Code https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
Issues https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/issues
Pull requests https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/pulls
Actions https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/actions
Projects https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/projects
Security https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/security
Insights https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/pulse
Brancheshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/branches
Tagshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/tags
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/branches
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/tags
181 Commitshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/commits/main/
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/commits/main/
crawl-clusterhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/tree/main/crawl-cluster
crawl-clusterhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/tree/main/crawl-cluster
crawlerhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/tree/main/crawler
crawlerhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/tree/main/crawler
.gitignorehttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/.gitignore
.gitignorehttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/.gitignore
CITATION.cffhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/CITATION.cff
CITATION.cffhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/CITATION.cff
LICENSE.mdhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/LICENSE.md
LICENSE.mdhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/LICENSE.md
README.mdhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/README.md
README.mdhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/README.md
adscraper.sqlhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/adscraper.sql
adscraper.sqlhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/adscraper.sql
READMEhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
MIT licensehttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#adscraper-a-web-crawler-for-measuring-online-ad-content
Adscraper: A Web Crawler for Measuring Online Ad Contenthttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#adscraper-a-web-crawler-for-measuring-online-ad-content
About Adscraperhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#about-adscraper
Research using Adscraperhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#research-using-adscraper
Citationshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#citations
Warning: Research Code!https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#warning-research-code
Quick Start (basic crawls)https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#quick-start-basic-crawls
Pre-requisiteshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#pre-requisites
Installationhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#installation
Creating a crawl listhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#creating-a-crawl-list
Running crawlshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#running-crawls
Detailed instructions and advanced usagehttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#detailed-instructions-and-advanced-usage
Quick Start (distributed crawls)https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#quick-start-distributed-crawls
Pre-requisiteshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#pre-requisites-1
Creating input fileshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#creating-input-files
Running a crawlhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#running-a-crawl
Detailed instructions and advanced usagehttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#detailed-instructions-and-advanced-usage-1
Viewing and analyzing datahttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#viewing-and-analyzing-data
Acknowledgementshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#acknowledgements
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#about-adscraper
Puppeteerhttps://github.com/puppeteer/puppeteer
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#research-using-adscraper
(Paper) Measuring Risks to Users' Health Privacy Posed by Third-Party Web Tracking and Targeted Advertisinghttps://doi.org/10.1145/3706598.3714318
(Paper) Analyzing the (In)Accessibility of Online Advertisementshttps://dl.acm.org/doi/10.1145/3646547.3688427
(Paper) Polls, Clickbait, and Commemorative $2 Bills: Problematic Political Advertising on News and Media Websites Around the 2020 U.S. Electionshttps://badads.cs.washington.edu/political.html
(Project website) Bad Ads: Problematic Content in Online Advertisinghttps://badads.cs.washington.edu
(Paper) What Makes a "Bad" Ad? User Perceptions of Problematic Online Advertisinghttps://badads.cs.washington.edu/files/Zeng-CHI2021-BadAds.pdf
(Paper) Bad News: Clickbait and Deceptive Ads on News and Misinformation Websiteshttps://badads.cs.washington.edu/files/Zeng-ConPro2020-BadNews.pdf
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#citations
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#warning-research-code
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#quick-start-basic-crawls
crawler/README.mdhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/crawler/README.md
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#pre-requisites
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#installation
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#creating-a-crawl-list
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#running-crawls
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#detailed-instructions-and-advanced-usage
crawler/README.mdhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/crawler/README.md
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#quick-start-distributed-crawls
crawl-cluster/README.mdhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/crawl-cluster/README.md
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#pre-requisites-1
k3shttps://k3s.io/
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#creating-input-files
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#running-a-crawl
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#detailed-instructions-and-advanced-usage-1
crawl-cluster/README.mdhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/blob/main/crawl-cluster/README.md
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#viewing-and-analyzing-data
Label Studiohttps://labelstud.io/
https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#acknowledgements
Readme https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#readme-ov-file
MIT license https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper#MIT-1-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
Activityhttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/activity
Custom propertieshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/custom-properties
40 starshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/stargazers
8 watchinghttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/watchers
12 forkshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2FUWCSESecurityLab%2Fadscraper&report=UWCSESecurityLab+%28user%29
Releaseshttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/releases
Packages 0https://patch-diff.githubusercontent.com/orgs/UWCSESecurityLab/packages?repo_name=adscraper
Please reload this pagehttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
Contributors 3https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/graphs/contributors
Please reload this pagehttps://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper
TypeScript 98.4% https://patch-diff.githubusercontent.com/UWCSESecurityLab/adscraper/search?l=typescript
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.