René's URL Explorer Experiment


Title: GitHub - sqlqry/Data-Engineering-HowTo: A list of useful resources to learn Data Engineering from scratch

Open Graph Title: GitHub - sqlqry/Data-Engineering-HowTo: A list of useful resources to learn Data Engineering from scratch

X Title: GitHub - sqlqry/Data-Engineering-HowTo: A list of useful resources to learn Data Engineering from scratch

Description: A list of useful resources to learn Data Engineering from scratch - sqlqry/Data-Engineering-HowTo

Open Graph Description: A list of useful resources to learn Data Engineering from scratch - sqlqry/Data-Engineering-HowTo

X Description: A list of useful resources to learn Data Engineering from scratch - sqlqry/Data-Engineering-HowTo

Opengraph URL: https://github.com/sqlqry/Data-Engineering-HowTo

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:473a1d22-7eb8-59a3-b3c2-58f877d06118
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idDA04:3379E0:3F6A71:570A62:697C5A96
html-safe-nonceb9b0ee4aebdca3aa62c38b2f0ac5a85f6978beb0c92f8650bfb8baff43fccce7
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEQTA0OjMzNzlFMDozRjZBNzE6NTcwQTYyOjY5N0M1QTk2IiwidmlzaXRvcl9pZCI6IjE1ODc0NDE3NjcxNjQ5NTkzODIiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmac53ce2362b561d82c94f22f8e8a5f2c309cc894f84a1483f024d199abcfb454e6
hovercard-subject-tagrepository:240611532
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/sqlqry/Data-Engineering-HowTo
twitter:imagehttps://opengraph.githubassets.com/ba9f355277908578166befed719fc5cbfb5526e8f08f4355d13e50c2489c0258/sqlqry/Data-Engineering-HowTo
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/ba9f355277908578166befed719fc5cbfb5526e8f08f4355d13e50c2489c0258/sqlqry/Data-Engineering-HowTo
og:image:altA list of useful resources to learn Data Engineering from scratch - sqlqry/Data-Engineering-HowTo
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
Noneda4f0ee56809799586f8ee546b27f94fe9b5893edfbf87732e82be45be013b52
turbo-cache-controlno-preview
go-importgithub.com/sqlqry/Data-Engineering-HowTo git https://github.com/sqlqry/Data-Engineering-HowTo.git
octolytics-dimension-user_id54558474
octolytics-dimension-user_loginsqlqry
octolytics-dimension-repository_id240611532
octolytics-dimension-repository_nwosqlqry/Data-Engineering-HowTo
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id178151956
octolytics-dimension-repository_parent_nwoadilkhash/Data-Engineering-HowTo
octolytics-dimension-repository_network_root_id178151956
octolytics-dimension-repository_network_root_nwoadilkhash/Data-Engineering-HowTo
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release787d8d274e314f52ce6d846c7581f9476d8dc736
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsqlqry%2FData-Engineering-HowTo
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsqlqry%2FData-Engineering-HowTo
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=sqlqry%2FData-Engineering-HowTo
Reloadhttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo
Reloadhttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo
Reloadhttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo
sqlqry https://patch-diff.githubusercontent.com/sqlqry
Data-Engineering-HowTohttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo
adilkhash/Data-Engineering-HowTohttps://patch-diff.githubusercontent.com/adilkhash/Data-Engineering-HowTo
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fsqlqry%2FData-Engineering-HowTo
Fork 0 https://patch-diff.githubusercontent.com/login?return_to=%2Fsqlqry%2FData-Engineering-HowTo
Star 0 https://patch-diff.githubusercontent.com/login?return_to=%2Fsqlqry%2FData-Engineering-HowTo
0 stars https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/stargazers
565 forks https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/forks
Branches https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/branches
Tags https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/tags
Activity https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2Fsqlqry%2FData-Engineering-HowTo
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fsqlqry%2FData-Engineering-HowTo
Code https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo
Pull requests 0 https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/pulls
Actions https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/actions
Projects 0 https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/projects
Security 0 https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/security
Insights https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/pulse
Code https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo
Pull requests https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/pulls
Actions https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/actions
Projects https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/projects
Security https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/security
Insights https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/pulse
Brancheshttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/branches
Tagshttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/tags
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/branches
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/tags
25 Commitshttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/commits/master/
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/commits/master/
README.mdhttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/blob/master/README.md
README.mdhttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/blob/master/README.md
READMEhttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#how-to-become-a-data-engineer
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#useful-articles
The AI Hierarchy of Needshttps://hackernoon.com/the-ai-hierarchy-of-needs-18f111fcc007
The Rise of Data Engineerhttps://medium.freecodecamp.org/the-rise-of-the-data-engineer-91be18f1e603
The Downfall of the Data Engineerhttps://medium.com/@maximebeauchemin/the-downfall-of-the-data-engineer-5bfb701e5d6b
Part Ihttps://medium.com/@rchang/a-beginners-guide-to-data-engineering-part-i-4227c5c457d7
Part IIhttps://medium.com/@rchang/a-beginners-guide-to-data-engineering-part-ii-47c4e7cbda71?source=---------5------------------
Part IIIhttps://medium.com/@rchang/a-beginners-guide-to-data-engineering-the-series-finale-2cc92ff14b0?source=---------4------------------
Functional Data Engineering — a modern paradigm for batch data processinghttps://medium.com/@maximebeauchemin/functional-data-engineering-a-modern-paradigm-for-batch-data-processing-2327ec32c42a
How to become a Data Engineer (in Russian)https://khashtamov.com/ru/data-engineer/
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#talks
Data Engineering Principles - Build frameworks not pipelineshttps://www.youtube.com/watch?v=pzfgbSfzhXg
Functional Data Engineering - A Set of Best Practiceshttps://www.youtube.com/watch?v=4Spo2QRTz1k
Advanced Data Engineering Patterns with Apache Airflowhttps://www.youtube.com/watch?v=Fvu2oFyFCT0
Creating a Data Engineering Culturehttps://www.youtube.com/watch?v=VkeleGIUSM8
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#algorithms--data-structures
Algorithmic Toolboxhttps://stepik.org/course/217
Data Structureshttps://stepik.org/course/1547
Data Structures & Algorithms Specializationhttps://www.coursera.org/specializations/data-structures-algorithms
Algorithms Specializationhttps://www.coursera.org/specializations/algorithms
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#sql
Comprehensive SQL Tutorialhttps://mode.com/sql-tutorial/introduction-to-sql/
SQL Practicehttps://leetcode.com/problemset/database/
Modern SQLhttps://modern-sql.com/
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#programming
Scala Schoolhttps://twitter.github.io/scala_school/
Fluent Pythonhttps://www.amazon.com/gp/product/1491946008/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=1491946008&linkCode=as2&tag=adilkhash-20&linkId=8a663e966770c24874e323133cc7a005
Intro to Scalahttps://stepik.org/course/16243
The Hitchhiker’s Guide to Pythonhttps://docs.python-guide.org/
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#databases
Intro to Database Systemshttps://www.youtube.com/playlist?list=PLSE8ODhjZXjYutVzTeAds8xUt1rcmyT7x
Advanced Database Systemshttps://www.youtube.com/playlist?list=PLSE8ODhjZXja7K1hjZ01UTVDnGQdx5v5U
Flavors of IOhttps://medium.com/databasss/on-disk-io-part-1-flavours-of-io-8e1ace1de017
More Flavours of IOhttps://medium.com/databasss/on-disk-io-part-2-more-flavours-of-io-c945db3edb13
LSM Treeshttps://medium.com/databasss/on-disk-io-part-3-lsm-trees-8b2da218496f
B-Trees and RUM Conjecturehttps://medium.com/databasss/on-disk-storage-part-4-b-trees-30791060741
Access Patterns in LSM Treeshttps://medium.com/databasss/on-disk-io-access-patterns-in-lsm-trees-2ba8dffc05f9
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#distributed-systems
Distributed systems for fun and profithttp://book.mixu.net/distsys/
Distributed Systemshttps://www.amazon.com/gp/product/1543057381/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=1543057381&linkCode=as2&tag=adilkhash-20&linkId=721aedeb23c313bc46a92c134c5baafa
CS 436: Distributed Computer Systemshttps://www.youtube.com/watch?v=w8KFPWkK0bI&list=PLawkBQ15NDEkDJ5IyLIJUTZ1rRM9YQq6N&index=2
Distributed consensus reading listhttps://github.com/heidi-ann/distributed-consensus-reading-list
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#books
Design Data-Intensive Applicationshttps://www.amazon.com/gp/product/1449373321/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=1449373321&linkCode=as2&tag=adilkhash-20&linkId=e7e0e096aa5761066245eb90965ac849
Introduction to Algorithmshttps://www.amazon.com/gp/product/0262033844/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=0262033844&linkCode=as2&tag=adilkhash-20&linkId=74742875db503b1a899ca35159749067
The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modelinghttps://www.amazon.com/gp/product/1118530802/ref=as_li_tl?ie=UTF8&tag=adilkhash-20&camp=1789&creative=9325&linkCode=as2&creativeASIN=1118530802&linkId=6ca865e8e9817dca57718bdbe5e52cd5
Star Schema The Complete Referencehttps://www.amazon.com/gp/product/0071744320/ref=as_li_tl?ie=UTF8&tag=adilkhash-20&camp=1789&creative=9325&linkCode=as2&creativeASIN=0071744320&linkId=2abf9ef1d327071f74f59c3659ed6223
Database Internals: A Deep Dive into How Distributed Data Systems Workhttps://www.amazon.com/gp/product/1492040347/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=1492040347&linkCode=as2&tag=adilkhash-20&linkId=4a23dead1aeb11fd4debffb36487aa14
Streaming Systems: The What, Where, When, and How of Large-Scale Data Processinghttps://www.amazon.com/gp/product/1491983876/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=1491983876&linkCode=as2&tag=adilkhash-20&linkId=9869047f1ac02b597d8a0e67fd29ad68
A Philosophy of Software Designhttps://www.amazon.com/gp/product/1732102201/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=1732102201&linkCode=as2&tag=adilkhash-20&linkId=b020fab52fa5f1fed2191ea12e824468
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#courses
Big Data for Data Engineers Specializationhttps://www.coursera.org/specializations/big-data-engineering
Data Engineering on Google Cloud Platform Specializationhttps://www.coursera.org/specializations/gcp-data-machine-learning
Data Engineer Nanodegreehttps://udacity.com/course/data-engineer-nanodegree--nd027
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#blogs
Martin Kleppmannhttps://martin.kleppmann.com/
BaseDShttps://medium.com/baseds
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#tools
Apache Airflowhttps://airflow.apache.org/
Apache Sparkhttps://spark.apache.org/
Apache Kafkahttps://kafka.apache.org/
Luigihttps://luigi.readthedocs.io
Dagster.iohttps://dagster.readthedocs.io/en/stable/index.html
Prefecthttps://prefect.io
Metaflowhttps://github.com/Netflix/metaflow
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#cloud-platforms
Amazon Web Serviceshttps://aws.amazon.com/
Google Cloud Platformhttps://cloud.google.com/gcp/
Microsoft Azurehttps://azure.microsoft.com
Yandex Cloudhttps://cloud.yandex.ru/
DigitalOceanhttps://m.do.co/c/e92056c9e79b
IBM Cloudhttps://www.ibm.com/cloud/
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#communities
data Engineeringhttps://t.me/dataeng_chat
Data Engineering Subreddithttps://www.reddit.com/r/dataengineering/
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#data-engineering-jobs
Data Engineering jobshttp://bit.ly/2vk0R86
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#other
Data Engineering Podcasthttps://www.dataengineeringpodcast.com/
Insight Data Engineering Ecosystem Maphttp://xyz.insightdataengineering.com/blog/pipeline_map/
https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#newsletters--digests
DataEng Telegram channelhttps://t.me/dataeng
Data Eng Weeklyhttps://dataengweekly.com/
SF Data Weeklyhttp://weekly.sfdata.io
Data Elixirhttps://dataelixir.com/
Readme https://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo#readme-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo
Activityhttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/activity
0 starshttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/stargazers
0 watchinghttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/watchers
0 forkshttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fsqlqry%2FData-Engineering-HowTo&report=sqlqry+%28user%29
Releaseshttps://patch-diff.githubusercontent.com/sqlqry/Data-Engineering-HowTo/releases
Packages 0https://patch-diff.githubusercontent.com/users/sqlqry/packages?repo_name=Data-Engineering-HowTo
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.