René's URL Explorer Experiment


Title: GitHub - airscholar/e2e-data-engineering: An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability. · GitHub

Open Graph Title: GitHub - airscholar/e2e-data-engineering: An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

X Title: GitHub - airscholar/e2e-data-engineering: An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

Description: An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability. - airscholar/e2e-data-engineering

Open Graph Description: An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All comp...

X Description: An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All comp...

Opengraph URL: https://github.com/airscholar/e2e-data-engineering

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:55f06f53-a681-e7f4-ba17-20414ef893c5
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idDB6A:22EDEC:24A09D:33EBB3:6A4BC34D
html-safe-nonce8f6e9169741afda632812f0f50ee18ac1a10b1d25f29942bc783bebcac89ce76
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEQjZBOjIyRURFQzoyNEEwOUQ6MzNFQkIzOjZBNEJDMzREIiwidmlzaXRvcl9pZCI6IjM4MDM5NzQxNjU1ODIyOTk5ODIiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmaca66fdbea18006c9439f0a6291910d0635005dd5321fdc04eaf18aa4984f3996e
hovercard-subject-tagrepository:687878380
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/airscholar/e2e-data-engineering
twitter:imagehttps://opengraph.githubassets.com/2640be28c58f03c17043db86535795ed4197f7bc262704a0ff067dcc52d54b8a/airscholar/e2e-data-engineering
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/2640be28c58f03c17043db86535795ed4197f7bc262704a0ff067dcc52d54b8a/airscholar/e2e-data-engineering
og:image:altAn end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All comp...
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None14aa00ce5bdb34d0eefb5facbffd7de9e144c688d8a93ef8df902d5f94b51dd7
turbo-cache-controlno-cache
go-importgithub.com/airscholar/e2e-data-engineering git https://github.com/airscholar/e2e-data-engineering.git
octolytics-dimension-user_id12203990
octolytics-dimension-user_loginairscholar
octolytics-dimension-repository_id687878380
octolytics-dimension-repository_nwoairscholar/e2e-data-engineering
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id687878380
octolytics-dimension-repository_network_root_nwoairscholar/e2e-data-engineering
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release58b8f89190447502561829f30862aa0a99d53367
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/airscholar/e2e-data-engineering#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fairscholar%2Fe2e-data-engineering
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fairscholar%2Fe2e-data-engineering
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=airscholar%2Fe2e-data-engineering
Reloadhttps://github.com/airscholar/e2e-data-engineering
Reloadhttps://github.com/airscholar/e2e-data-engineering
Reloadhttps://github.com/airscholar/e2e-data-engineering
airscholar https://github.com/airscholar
e2e-data-engineeringhttps://github.com/airscholar/e2e-data-engineering
Notifications https://github.com/login?return_to=%2Fairscholar%2Fe2e-data-engineering
Fork 152 https://github.com/login?return_to=%2Fairscholar%2Fe2e-data-engineering
Star 333 https://github.com/login?return_to=%2Fairscholar%2Fe2e-data-engineering
Code https://github.com/airscholar/e2e-data-engineering
Issues 5 https://github.com/airscholar/e2e-data-engineering/issues
Pull requests 0 https://github.com/airscholar/e2e-data-engineering/pulls
Actions https://github.com/airscholar/e2e-data-engineering/actions
Projects https://github.com/airscholar/e2e-data-engineering/projects
Security and quality 0 https://github.com/airscholar/e2e-data-engineering/security
Insights https://github.com/airscholar/e2e-data-engineering/pulse
Code https://github.com/airscholar/e2e-data-engineering
Issues https://github.com/airscholar/e2e-data-engineering/issues
Pull requests https://github.com/airscholar/e2e-data-engineering/pulls
Actions https://github.com/airscholar/e2e-data-engineering/actions
Projects https://github.com/airscholar/e2e-data-engineering/projects
Security and quality https://github.com/airscholar/e2e-data-engineering/security
Insights https://github.com/airscholar/e2e-data-engineering/pulse
https://github.com/airscholar/e2e-data-engineering
Brancheshttps://github.com/airscholar/e2e-data-engineering/branches
Tagshttps://github.com/airscholar/e2e-data-engineering/tags
https://github.com/airscholar/e2e-data-engineering/branches
https://github.com/airscholar/e2e-data-engineering/tags
5 Commitshttps://github.com/airscholar/e2e-data-engineering/commits/main/
https://github.com/airscholar/e2e-data-engineering/commits/main/
dagshttps://github.com/airscholar/e2e-data-engineering/tree/main/dags
dagshttps://github.com/airscholar/e2e-data-engineering/tree/main/dags
scripthttps://github.com/airscholar/e2e-data-engineering/tree/main/script
scripthttps://github.com/airscholar/e2e-data-engineering/tree/main/script
.gitignorehttps://github.com/airscholar/e2e-data-engineering/blob/main/.gitignore
.gitignorehttps://github.com/airscholar/e2e-data-engineering/blob/main/.gitignore
Data engineering architecture.pnghttps://github.com/airscholar/e2e-data-engineering/blob/main/Data%20engineering%20architecture.png
Data engineering architecture.pnghttps://github.com/airscholar/e2e-data-engineering/blob/main/Data%20engineering%20architecture.png
README.mdhttps://github.com/airscholar/e2e-data-engineering/blob/main/README.md
README.mdhttps://github.com/airscholar/e2e-data-engineering/blob/main/README.md
docker-compose.ymlhttps://github.com/airscholar/e2e-data-engineering/blob/main/docker-compose.yml
docker-compose.ymlhttps://github.com/airscholar/e2e-data-engineering/blob/main/docker-compose.yml
requirements.txthttps://github.com/airscholar/e2e-data-engineering/blob/main/requirements.txt
requirements.txthttps://github.com/airscholar/e2e-data-engineering/blob/main/requirements.txt
spark_stream.pyhttps://github.com/airscholar/e2e-data-engineering/blob/main/spark_stream.py
spark_stream.pyhttps://github.com/airscholar/e2e-data-engineering/blob/main/spark_stream.py
READMEhttps://github.com/airscholar/e2e-data-engineering
https://github.com/airscholar/e2e-data-engineering#realtime-data-streaming--end-to-end-data-engineering-project
https://github.com/airscholar/e2e-data-engineering#table-of-contents
Introductionhttps://github.com/airscholar/e2e-data-engineering#introduction
System Architecturehttps://github.com/airscholar/e2e-data-engineering#system-architecture
What You'll Learnhttps://github.com/airscholar/e2e-data-engineering#what-youll-learn
Technologieshttps://github.com/airscholar/e2e-data-engineering#technologies
Getting Startedhttps://github.com/airscholar/e2e-data-engineering#getting-started
Watch the Video Tutorialhttps://github.com/airscholar/e2e-data-engineering#watch-the-video-tutorial
https://github.com/airscholar/e2e-data-engineering#introduction
https://github.com/airscholar/e2e-data-engineering#system-architecture
https://github.com/airscholar/e2e-data-engineering/blob/main/Data%20engineering%20architecture.png
https://github.com/airscholar/e2e-data-engineering#what-youll-learn
https://github.com/airscholar/e2e-data-engineering#technologies
https://github.com/airscholar/e2e-data-engineering#getting-started
https://github.com/airscholar/e2e-data-engineering#watch-the-video-tutorial
YouTube Video Tutorialhttps://www.youtube.com/watch?v=GqAcTrqKcrY
www.youtube.com/watch?v=GqAcTrqKcrYhttps://www.youtube.com/watch?v=GqAcTrqKcrY
docker https://github.com/topics/docker
big-data https://github.com/topics/big-data
cassandra https://github.com/topics/cassandra
apache-spark https://github.com/topics/apache-spark
data-storage https://github.com/topics/data-storage
postgresql https://github.com/topics/postgresql
data-engineering https://github.com/topics/data-engineering
apache-kafka https://github.com/topics/apache-kafka
data-processing https://github.com/topics/data-processing
data-pipeline https://github.com/topics/data-pipeline
real-time-analytics https://github.com/topics/real-time-analytics
containerization https://github.com/topics/containerization
apache-zookeeper https://github.com/topics/apache-zookeeper
apache-airflow https://github.com/topics/apache-airflow
etl-pipeline https://github.com/topics/etl-pipeline
Readme https://github.com/airscholar/e2e-data-engineering#readme-ov-file
Please reload this pagehttps://github.com/airscholar/e2e-data-engineering
Activityhttps://github.com/airscholar/e2e-data-engineering/activity
152 forkshttps://github.com/airscholar/e2e-data-engineering/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fairscholar%2Fe2e-data-engineering&report=airscholar+%28user%29
Releaseshttps://github.com/airscholar/e2e-data-engineering/releases
Packages 0https://github.com/users/airscholar/packages?repo_name=e2e-data-engineering
Please reload this pagehttps://github.com/airscholar/e2e-data-engineering
Please reload this pagehttps://github.com/airscholar/e2e-data-engineering
Contributorshttps://github.com/airscholar/e2e-data-engineering/graphs/contributors
Please reload this pagehttps://github.com/airscholar/e2e-data-engineering
Python 93.9% https://github.com/airscholar/e2e-data-engineering/search?l=python
Shell 6.1% https://github.com/airscholar/e2e-data-engineering/search?l=shell
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.