René's URL Explorer Experiment


Title: GitHub - saurzcode/awesome-data-engineering: A curated list of data engineering tools for software developers

Open Graph Title: GitHub - saurzcode/awesome-data-engineering: A curated list of data engineering tools for software developers

X Title: GitHub - saurzcode/awesome-data-engineering: A curated list of data engineering tools for software developers

Description: A curated list of data engineering tools for software developers - saurzcode/awesome-data-engineering

Open Graph Description: A curated list of data engineering tools for software developers - saurzcode/awesome-data-engineering

X Description: A curated list of data engineering tools for software developers - saurzcode/awesome-data-engineering

Opengraph URL: https://github.com/saurzcode/awesome-data-engineering

X: @github

direct link

Domain: patch-diff.githubusercontent.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:b1956aca-37e8-b551-c1a7-51a100774a7c
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idA472:11A8B3:155092F:1E38010:6978CBD3
html-safe-nonce09a424ec8bb6cd5713304476734e5633248c367784ee704968ed7d0a10efc47b
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBNDcyOjExQThCMzoxNTUwOTJGOjFFMzgwMTA6Njk3OENCRDMiLCJ2aXNpdG9yX2lkIjoiODExNzk3NTM2MDc1OTk3NDg2NyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9
visitor-hmac6815b6d4d1f352f0cfb591f1238959ed81c7cf2f984351379c88d68f55f43ab5
hovercard-subject-tagrepository:303045223
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/saurzcode/awesome-data-engineering
twitter:imagehttps://opengraph.githubassets.com/b67b9147652d9c102e8b0f241d91fc96d37a831dd22df8c56d67eeb0b4bcdfb5/saurzcode/awesome-data-engineering
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/b67b9147652d9c102e8b0f241d91fc96d37a831dd22df8c56d67eeb0b4bcdfb5/saurzcode/awesome-data-engineering
og:image:altA curated list of data engineering tools for software developers - saurzcode/awesome-data-engineering
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None8a71ca1f7ab5436216e1df86f398ef7a51ed3152c90e3f7332fc70cf97fcb9d6
turbo-cache-controlno-preview
go-importgithub.com/saurzcode/awesome-data-engineering git https://github.com/saurzcode/awesome-data-engineering.git
octolytics-dimension-user_id7669344
octolytics-dimension-user_loginsaurzcode
octolytics-dimension-repository_id303045223
octolytics-dimension-repository_nwosaurzcode/awesome-data-engineering
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forktrue
octolytics-dimension-repository_parent_id37680686
octolytics-dimension-repository_parent_nwoigorbarinov/awesome-data-engineering
octolytics-dimension-repository_network_root_id37680686
octolytics-dimension-repository_network_root_nwoigorbarinov/awesome-data-engineering
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
releaseeaed570eead52a9920afef75dc3eb6d826fdc5ef
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#start-of-content
https://patch-diff.githubusercontent.com/
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsaurzcode%2Fawesome-data-engineering
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub SparkBuild and deploy intelligent appshttps://github.com/features/spark
GitHub ModelsManage and compare promptshttps://github.com/features/models
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://patch-diff.githubusercontent.com/login?return_to=https%3A%2F%2Fgithub.com%2Fsaurzcode%2Fawesome-data-engineering
Sign up https://patch-diff.githubusercontent.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=saurzcode%2Fawesome-data-engineering
Reloadhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
Reloadhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
Reloadhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
saurzcode https://patch-diff.githubusercontent.com/saurzcode
awesome-data-engineeringhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
igorbarinov/awesome-data-engineeringhttps://patch-diff.githubusercontent.com/igorbarinov/awesome-data-engineering
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fsaurzcode%2Fawesome-data-engineering
Fork 0 https://patch-diff.githubusercontent.com/login?return_to=%2Fsaurzcode%2Fawesome-data-engineering
Star 0 https://patch-diff.githubusercontent.com/login?return_to=%2Fsaurzcode%2Fawesome-data-engineering
CC0-1.0 license https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/blob/master/license
0 stars https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/stargazers
1.4k forks https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/forks
Branches https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/branches
Tags https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/tags
Activity https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/activity
Star https://patch-diff.githubusercontent.com/login?return_to=%2Fsaurzcode%2Fawesome-data-engineering
Notifications https://patch-diff.githubusercontent.com/login?return_to=%2Fsaurzcode%2Fawesome-data-engineering
Code https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
Pull requests 0 https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/pulls
Actions https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/actions
Projects 0 https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/projects
Security 0 https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/security
Insights https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/pulse
Code https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
Pull requests https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/pulls
Actions https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/actions
Projects https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/projects
Security https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/security
Insights https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/pulse
Brancheshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/branches
Tagshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/tags
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/branches
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/tags
321 Commitshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/commits/master/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/commits/master/
.github/workflowshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/tree/master/.github/workflows
.github/workflowshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/tree/master/.github/workflows
README.mdhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/blob/master/README.md
README.mdhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/blob/master/README.md
contributing.mdhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/blob/master/contributing.md
contributing.mdhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/blob/master/contributing.md
licensehttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/blob/master/license
licensehttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/blob/master/license
READMEhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
Contributinghttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
CC0-1.0 licensehttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
https://github.com/sindresorhus/awesome
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#awesome-data-engineering-
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#contents
Databaseshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#databases
Data Comparisonhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-comparison
Data Ingestionhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-ingestion
File Systemhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#file-system
Serialization formathttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#serialization-format
Stream Processinghttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#stream-processing
Batch Processinghttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#batch-processing
Charts and Dashboardshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#charts-and-dashboards
Workflowhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#workflow
Data Lake Managementhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-lake-management
ELK Elastic Logstash Kibanahttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#elk-elastic-logstash-kibana
Dockerhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#docker
Datasetshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#datasets
Realtimehttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#realtime
Data Dumpshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-dumps
Monitoringhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#monitoring
Prometheushttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#prometheus
Profilinghttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#profiling
Data Profilerhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-profiler
Testinghttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#testing
Communityhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#community
Forumshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#forums
Conferenceshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#conferences
Podcastshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#podcasts
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#databases
RQLitehttps://github.com/rqlite/rqlite
MySQLhttps://www.mysql.com/
TiDBhttps://github.com/pingcap/tidb
Percona XtraBackuphttps://www.percona.com/software/mysql-database/percona-xtrabackup
mysql_utilshttps://github.com/pinterest/mysql_utils
MariaDBhttps://mariadb.org/
PostgreSQLhttps://www.postgresql.org/
Amazon RDShttps://aws.amazon.com/rds/
Crate.IOhttps://crate.io/
Redishttps://redis.io/
Riakhttps://docs.basho.com/riak/kv/
AWS DynamoDBhttps://aws.amazon.com/dynamodb/
HyperDexhttps://github.com/rescrv/HyperDex
SSDBhttps://ssdb.io
Kyoto Tycoonhttps://github.com/alticelabs/kyoto
IonDBhttps://github.com/iondbproject/iondb
Cassandrahttps://cassandra.apache.org/
Cassandra Calculatorhttps://www.ecyrd.com/cassandracalculator/
CCMhttps://github.com/pcmanus/ccm
ScyllaDBhttps://github.com/scylladb/scylla
HBasehttps://hbase.apache.org/
AWS Redshifthttps://aws.amazon.com/redshift/
FiloDBhttps://github.com/filodb/FiloDB
Verticahttps://www.vertica.com
ClickHousehttps://clickhouse.tech
MongoDBhttps://www.mongodb.com
Percona Server for MongoDBhttps://www.percona.com/software/mongo-database/percona-server-for-mongodb
MemDBhttps://github.com/rain1017/memdb
Elasticsearchhttps://www.elastic.co/
Couchbasehttps://www.couchbase.com/
RethinkDBhttps://rethinkdb.com/
RavenDBhttps://ravendb.net/
Neo4jhttps://neo4j.com/
OrientDBhttps://orientdb.com
ArangoDBhttps://www.arangodb.com/
Titanhttps://titan.thinkaurelius.com
FlockDBhttps://github.com/twitter-archive/flockdb
DAtomichttps://www.datomic.com
Apache Geodehttps://geode.apache.org/
Gafferhttps://github.com/gchq/Gaffer
InfluxDBhttps://github.com/influxdata/influxdb
OpenTSDBhttps://github.com/OpenTSDB/opentsdb
QuestDBhttps://questdb.io/
kairosdbhttps://github.com/kairosdb/kairosdb
Heroichttps://github.com/spotify/heroic
Druidhttps://github.com/apache/incubator-druid
Riak-TShttps://basho.com/products/riak-ts/
Akumulihttps://github.com/akumuli/Akumuli
Rhombushttps://github.com/Pardot/Rhombus
Dalmatiner DBhttps://github.com/dalmatinerdb/dalmatinerdb
Bluefloodhttps://github.com/rackerlabs/blueflood
Timelyhttps://github.com/NationalSecurityAgency/timely
Tarantoolhttps://github.com/tarantool/tarantool/
GreenPlumhttps://github.com/greenplum-db/gpdb
cayleyhttps://github.com/cayleygraph/cayley
Snappydatahttps://github.com/SnappyDataInc/snappydata
TimescaleDBhttps://www.timescale.com/
DuckDBhttps://duckdb.org/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-comparison
datacompyhttps://github.com/capitalone/datacompy
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-ingestion
Kafkahttps://kafka.apache.org/
BottledWaterhttps://github.com/confluentinc/bottledwater-pg
kafkathttps://github.com/airbnb/kafkat
kafkacathttps://github.com/edenhill/kafkacat
pg-kafkahttps://github.com/xstevens/pg_kafka
librdkafkahttps://github.com/edenhill/librdkafka
kafka-dockerhttps://github.com/wurstmeister/kafka-docker
kafka-managerhttps://github.com/yahoo/kafka-manager
kafka-nodehttps://github.com/SOHU-Co/kafka-node
Secorhttps://github.com/pinterest/secor
Kafka-loggerhttps://github.com/uber/kafka-logger
AWS Kinesishttps://aws.amazon.com/kinesis/
RabbitMQhttps://www.rabbitmq.com/
dlthttps://www.dlthub.com
FluentDhttps://www.fluentd.org
Embulkhttps://www.embulk.org
Apache Sqoophttps://sqoop.apache.org
Hekahttps://github.com/mozilla-services/heka
Gobblinhttps://github.com/apache/incubator-gobblin
Nakadihttps://nakadi.io
Pravegahttps://www.pravega.io
Apache Pulsarhttps://pulsar.apache.org/
AWS Data Wranglerhttps://github.com/awslabs/aws-data-wrangler
Airbytehttps://airbyte.io/
Slinghttps://slingdata.io/
Meltanohttps://meltano.com/
Singer SDKhttps://sdk.meltano.com
Google Sheets ETLhttps://github.com/fulldecent/google-sheets-etl
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#file-system
HDFShttps://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html
Snakebitehttps://github.com/spotify/snakebite
AWS S3https://aws.amazon.com/s3/
smart_openhttps://github.com/RaRe-Technologies/smart_open
Alluxiohttps://www.alluxio.org/
CEPHhttps://ceph.com/
JuiceFShttps://github.com/juicedata/juicefs
OrangeFShttps://www.orangefs.org/
SnackFShttps://github.com/tuplejump/snackfs-release
GlusterFShttps://www.gluster.org/
XtreemFShttps://www.xtreemfs.org/
SeaweedFShttps://github.com/chrislusf/seaweedfs
S3QLhttps://github.com/s3ql/s3ql/
LizardFShttps://lizardfs.com/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#serialization-format
Apache Avrohttps://avro.apache.org
Apache Parquethttps://parquet.apache.org
Snappyhttps://github.com/google/snappy
PigZhttps://zlib.net/pigz/
Apache ORChttps://orc.apache.org/
Apache Thrifthttps://thrift.apache.org
ProtoBufhttps://github.com/protocolbuffers/protobuf
SequenceFilehttps://wiki.apache.org/hadoop/SequenceFile
Kryohttps://github.com/EsotericSoftware/kryo
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#stream-processing
Apache Beamhttps://beam.apache.org/
Spark Streaminghttps://spark.apache.org/streaming/
Apache Flinkhttps://flink.apache.org/
Apache Stormhttps://storm.apache.org
Apache Samzahttps://samza.apache.org
Apache NiFihttps://nifi.apache.org/
Apache Hudihttps://hudi.apache.org/
VoltDBhttps://voltdb.com/
shared nothing architecturehttps://en.wikipedia.org/wiki/Shared-nothing_architecture
PipelineDBhttps://github.com/pipelinedb/pipelinedb
Spring Cloud Dataflowhttps://cloud.spring.io/spring-cloud-dataflow/
Bonobohttps://www.bonobo-project.org/
Robinhood's Fausthttps://github.com/faust-streaming/faust
HStreamDBhttps://github.com/hstreamdb/hstream
Kuiperhttps://github.com/emqx/kuiper
Zillahttps://github.com/aklivity/zilla
SwimOShttps://github.com/swimos/swim-rust
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#batch-processing
Hadoop MapReducehttps://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html
Sparkhttps://spark.apache.org/
Spark Packageshttps://spark-packages.org
Deep Sparkhttps://github.com/Stratio/deep-spark
Spark RDD API Exampleshttps://homepage.cs.latrobe.edu.au/zhe/ZhenHeSparkRDDAPIExamples.html
Livyhttps://livy.incubator.apache.org
Delighthttps://github.com/datamechanics/delight
AWS EMRhttps://aws.amazon.com/emr/
Data Mechanicshttps://www.datamechanics.co
Tezhttps://tez.apache.org/
Bistrohttps://github.com/asavinov/bistro
H2Ohttps://www.h2o.ai/
Mahouthttps://mahout.apache.org/
Spark MLlibhttps://spark.apache.org/docs/latest/ml-guide.html
GraphLab Createhttps://turi.com/products/create/docs/
Giraphhttps://giraph.apache.org/
Spark GraphXhttps://spark.apache.org/graphx/
Prestohttps://prestodb.github.io/docs/current/index.html
Hivehttps://hive.apache.org
Hivemallhttps://github.com/apache/incubator-hivemall
PyHivehttps://github.com/dropbox/PyHive
Drillhttps://drill.apache.org/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#charts-and-dashboards
Highchartshttps://www.highcharts.com/
ZingCharthttps://www.zingchart.com/
C3.jshttps://c3js.org
D3.jshttps://d3js.org/
D3Plushttps://d3plus.org
SmoothieChartshttps://smoothiecharts.org
PyXleyhttps://github.com/stitchfix/pyxley
Plotlyhttps://github.com/plotly/dash
Apache Supersethttps://github.com/apache/incubator-superset
Redashhttps://redash.io/
Metabasehttps://github.com/metabase/metabase
PyQtGraphhttps://www.pyqtgraph.org/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#workflow
Luigihttps://github.com/spotify/luigi
CronQhttps://github.com/seatgeek/cronq
Usedhttps://chairnerd.seatgeek.com/building-out-the-seatgeek-data-pipeline/
Cascadinghttps://www.cascading.org/
Airflowhttps://github.com/apache/airflow
Azkabanhttps://azkaban.github.io/
Ooziehttps://oozie.apache.org/
Pinballhttps://github.com/pinterest/pinball
Dagsterhttps://github.com/dagster-io/dagster
Kedrohttps://kedro.readthedocs.io/en/latest/
Dataformhttps://dataform.co/
Censushttps://getcensus.com/
dbthttps://getdbt.com/
Kestrahttps://kestra.io/
RudderStackhttps://github.com/rudderlabs/rudder-server
PACEhttps://github.com/getstrm/pace
Prefecthttps://prefect.io/
Multiwovenhttps://github.com/Multiwoven/multiwoven
SuprSendhttps://www.suprsend.com/products/workflows
Kestrahttps://github.com/kestra-io/kestra
Magehttps://www.mage.ai
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-lake-management
lakeFShttps://github.com/treeverse/lakeFS
Project Nessiehttps://github.com/projectnessie/nessie
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#elk-elastic-logstash-kibana
docker-logstashhttps://github.com/pblittle/docker-logstash
elasticsearch-jdbchttps://github.com/jprante/elasticsearch-jdbc
ZomboDBhttps://github.com/zombodb/zombodb
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#docker
Gockerizehttps://github.com/redbooth/gockerize
Flockerhttps://github.com/ClusterHQ/flocker
Rancherhttps://rancher.com/rancher-os/
Kontenahttps://www.kontena.io/
Weavehttps://github.com/weaveworks/weave
Zodiachttps://github.com/CenturyLinkLabs/zodiac
cAdvisorhttps://github.com/google/cadvisor
Micro S3 persistencehttps://github.com/figadore/micro-s3-persistence
Rocker-composehttps://github.com/grammarly/rocker-compose
Nomadhttps://github.com/hashicorp/nomad
ImageLayershttps://imagelayers.io/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#datasets
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#realtime
Twitter Realtimehttps://developer.twitter.com/en/docs/tweets/filter-realtime/overview
Eventsimhttps://github.com/Interana/eventsim
Reddithttps://www.reddit.com/r/datasets/comments/3mk1vg/realtime_data_is_available_including_comments/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-dumps
GitHub Archivehttps://www.gharchive.org/
Common Crawlhttps://commoncrawl.org/
Wikipediahttps://dumps.wikimedia.org/enwiki/latest/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#monitoring
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#prometheus
Prometheus.iohttps://github.com/prometheus/prometheus
HAProxy Exporterhttps://github.com/prometheus/haproxy_exporter
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#profiling
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#data-profiler
Data Profilerhttps://github.com/capitalone/dataprofiler
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#testing
Graihttps://github.com/grai-io/grai-core/
DQOpshttps://github.com/dqops/dqo
DataKitchenhttps://datakitchen.io/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#community
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#forums
/r/dataengineeringhttps://www.reddit.com/r/dataengineering/
/r/etlhttps://www.reddit.com/r/ETL/
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#conferences
Data Councilhttps://www.datacouncil.ai/about
https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#podcasts
Data Engineering Podcasthttps://www.dataengineeringpodcast.com/
The Data Stack Showhttps://datastackshow.com/
Readme https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#readme-ov-file
CC0-1.0 license https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#CC0-1.0-1-ov-file
Contributing https://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering#contributing-ov-file
Please reload this pagehttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering
Activityhttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/activity
0 starshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/stargazers
0 watchinghttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/watchers
0 forkshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/forks
Report repository https://patch-diff.githubusercontent.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fsaurzcode%2Fawesome-data-engineering&report=saurzcode+%28user%29
Releaseshttps://patch-diff.githubusercontent.com/saurzcode/awesome-data-engineering/releases
Packages 0https://patch-diff.githubusercontent.com/users/saurzcode/packages?repo_name=awesome-data-engineering
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.