René's URL Explorer Experiment


Title: GitHub - pracdata/awesome-open-source-data-engineering: A curated list of open source tools used in analytics platforms and data engineering ecosystem · GitHub

Open Graph Title: GitHub - pracdata/awesome-open-source-data-engineering: A curated list of open source tools used in analytics platforms and data engineering ecosystem

X Title: GitHub - pracdata/awesome-open-source-data-engineering: A curated list of open source tools used in analytics platforms and data engineering ecosystem

Description: A curated list of open source tools used in analytics platforms and data engineering ecosystem - pracdata/awesome-open-source-data-engineering

Open Graph Description: A curated list of open source tools used in analytics platforms and data engineering ecosystem - pracdata/awesome-open-source-data-engineering

X Description: A curated list of open source tools used in analytics platforms and data engineering ecosystem - pracdata/awesome-open-source-data-engineering

Opengraph URL: https://github.com/pracdata/awesome-open-source-data-engineering

X: @github

direct link

Domain: github.com

route-pattern/:user_id/:repository
route-controllerfiles
route-actiondisambiguate
fetch-noncev2:bb49a9be-73a7-a1e2-240b-8b233a3ab3c5
current-catalog-service-hashf3abb0cc802f3d7b95fc8762b94bdcb13bf39634c40c357301c4aa1d67a256fb
request-idAAE2:21A061:CF6E9E:1154234:6A4C48B9
html-safe-nonce0f2a8bf321dad57b46153c4e35e362a31502deecce196c84194804cca51b4cad
visitor-payloadeyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBQUUyOjIxQTA2MTpDRjZFOUU6MTE1NDIzNDo2QTRDNDhCOSIsInZpc2l0b3JfaWQiOiI1MDAzOTEwODA3NzM4MzA4NDEiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ==
visitor-hmaca0744c4d0016093b4337c4b04f5a9ba6eecf4de2d40ba6e7d1ea634fd71216b4
hovercard-subject-tagrepository:761689368
github-keyboard-shortcutsrepository,copilot
google-site-verificationApib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I
octolytics-urlhttps://collector.github.com/github/collect
analytics-location//
fb:app_id1401488693436528
apple-itunes-appapp-id=1477376905, app-argument=https://github.com/pracdata/awesome-open-source-data-engineering
twitter:imagehttps://opengraph.githubassets.com/d3ec26fe805f8549edd3474be8dd2e0385dfa8c8102e22c8c433294890c6910d/pracdata/awesome-open-source-data-engineering
twitter:cardsummary_large_image
og:imagehttps://opengraph.githubassets.com/d3ec26fe805f8549edd3474be8dd2e0385dfa8c8102e22c8c433294890c6910d/pracdata/awesome-open-source-data-engineering
og:image:altA curated list of open source tools used in analytics platforms and data engineering ecosystem - pracdata/awesome-open-source-data-engineering
og:image:width1200
og:image:height600
og:site_nameGitHub
og:typeobject
hostnamegithub.com
expected-hostnamegithub.com
None3d11bb817438277de2a940854450e83a7d32b6aeb5014e9e6b00a6423900251c
turbo-cache-controlno-cache
go-importgithub.com/pracdata/awesome-open-source-data-engineering git https://github.com/pracdata/awesome-open-source-data-engineering.git
octolytics-dimension-user_id160737156
octolytics-dimension-user_loginpracdata
octolytics-dimension-repository_id761689368
octolytics-dimension-repository_nwopracdata/awesome-open-source-data-engineering
octolytics-dimension-repository_publictrue
octolytics-dimension-repository_is_forkfalse
octolytics-dimension-repository_network_root_id761689368
octolytics-dimension-repository_network_root_nwopracdata/awesome-open-source-data-engineering
turbo-body-classeslogged-out env-production page-responsive
disable-turbofalse
browser-stats-urlhttps://api.github.com/_private/browser/stats
browser-errors-urlhttps://api.github.com/_private/browser/errors
release3996b3b83990e134be6c099ab9a7f48f140ae80f
ui-targetfull
theme-color#1e2327
color-schemelight dark

Links:

Skip to contenthttps://github.com/pracdata/awesome-open-source-data-engineering#start-of-content
https://github.com/
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpracdata%2Fawesome-open-source-data-engineering
GitHub CopilotWrite better code with AIhttps://github.com/features/copilot
GitHub Copilot appDirect agents from issue to mergehttps://github.com/features/ai/github-app
MCP RegistryNewIntegrate external toolshttps://github.com/mcp
ActionsAutomate any workflowhttps://github.com/features/actions
CodespacesInstant dev environmentshttps://github.com/features/codespaces
IssuesPlan and track workhttps://github.com/features/issues
Code ReviewManage code changeshttps://github.com/features/code-review
GitHub Advanced SecurityFind and fix vulnerabilitieshttps://github.com/security/advanced-security
Code securitySecure your code as you buildhttps://github.com/security/advanced-security/code-security
Secret protectionStop leaks before they starthttps://github.com/security/advanced-security/secret-protection
Why GitHubhttps://github.com/why-github
Documentationhttps://docs.github.com
Bloghttps://github.blog
Changeloghttps://github.blog/changelog
Marketplacehttps://github.com/marketplace
View all featureshttps://github.com/features
Enterpriseshttps://github.com/enterprise
Small and medium teamshttps://github.com/team
Startupshttps://github.com/enterprise/startups
Nonprofitshttps://github.com/solutions/industry/nonprofits
App Modernizationhttps://github.com/solutions/use-case/app-modernization
DevSecOpshttps://github.com/solutions/use-case/devsecops
DevOpshttps://github.com/solutions/use-case/devops
CI/CDhttps://github.com/solutions/use-case/ci-cd
View all use caseshttps://github.com/solutions/use-case
Healthcarehttps://github.com/solutions/industry/healthcare
Financial serviceshttps://github.com/solutions/industry/financial-services
Manufacturinghttps://github.com/solutions/industry/manufacturing
Governmenthttps://github.com/solutions/industry/government
View all industrieshttps://github.com/solutions/industry
View all solutionshttps://github.com/solutions
AIhttps://github.com/resources/articles?topic=ai
Software Developmenthttps://github.com/resources/articles?topic=software-development
DevOpshttps://github.com/resources/articles?topic=devops
Securityhttps://github.com/resources/articles?topic=security
View all topicshttps://github.com/resources/articles
Customer storieshttps://github.com/customer-stories
Events & webinarshttps://github.com/resources/events
Ebooks & reportshttps://github.com/resources/whitepapers
Business insightshttps://github.com/solutions/executive-insights
GitHub Skillshttps://skills.github.com
Documentationhttps://docs.github.com
Customer supporthttps://support.github.com
Community forumhttps://github.com/orgs/community/discussions
Trust centerhttps://github.com/trust-center
Partnershttps://github.com/partners
View all resourceshttps://github.com/resources
GitHub SponsorsFund open source developershttps://github.com/sponsors
Security Labhttps://securitylab.github.com
Maintainer Communityhttps://maintainers.github.com
Acceleratorhttps://github.com/accelerator
GitHub Starshttps://stars.github.com
Archive Programhttps://archiveprogram.github.com
Topicshttps://github.com/topics
Trendinghttps://github.com/trending
Collectionshttps://github.com/collections
Enterprise platformAI-powered developer platformhttps://github.com/enterprise
GitHub Advanced SecurityEnterprise-grade security featureshttps://github.com/security/advanced-security
Copilot for BusinessEnterprise-grade AI featureshttps://github.com/features/copilot/copilot-business
Premium SupportEnterprise-grade 24/7 supporthttps://github.com/premium-support
Pricinghttps://github.com/pricing
Search syntax tipshttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
documentationhttps://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax
Sign in https://github.com/login?return_to=https%3A%2F%2Fgithub.com%2Fpracdata%2Fawesome-open-source-data-engineering
Sign up https://github.com/signup?ref_cta=Sign+up&ref_loc=header+logged+out&ref_page=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source_repo=pracdata%2Fawesome-open-source-data-engineering
Reloadhttps://github.com/pracdata/awesome-open-source-data-engineering
Reloadhttps://github.com/pracdata/awesome-open-source-data-engineering
Reloadhttps://github.com/pracdata/awesome-open-source-data-engineering
Please reload this pagehttps://github.com/pracdata/awesome-open-source-data-engineering
pracdata https://github.com/pracdata
awesome-open-source-data-engineeringhttps://github.com/pracdata/awesome-open-source-data-engineering
Notifications https://github.com/login?return_to=%2Fpracdata%2Fawesome-open-source-data-engineering
Fork 74 https://github.com/login?return_to=%2Fpracdata%2Fawesome-open-source-data-engineering
Star 581 https://github.com/login?return_to=%2Fpracdata%2Fawesome-open-source-data-engineering
Code https://github.com/pracdata/awesome-open-source-data-engineering
Issues 1 https://github.com/pracdata/awesome-open-source-data-engineering/issues
Pull requests 9 https://github.com/pracdata/awesome-open-source-data-engineering/pulls
Actions https://github.com/pracdata/awesome-open-source-data-engineering/actions
Projects https://github.com/pracdata/awesome-open-source-data-engineering/projects
Security and quality 0 https://github.com/pracdata/awesome-open-source-data-engineering/security
Insights https://github.com/pracdata/awesome-open-source-data-engineering/pulse
Code https://github.com/pracdata/awesome-open-source-data-engineering
Issues https://github.com/pracdata/awesome-open-source-data-engineering/issues
Pull requests https://github.com/pracdata/awesome-open-source-data-engineering/pulls
Actions https://github.com/pracdata/awesome-open-source-data-engineering/actions
Projects https://github.com/pracdata/awesome-open-source-data-engineering/projects
Security and quality https://github.com/pracdata/awesome-open-source-data-engineering/security
Insights https://github.com/pracdata/awesome-open-source-data-engineering/pulse
https://github.com/pracdata/awesome-open-source-data-engineering
Brancheshttps://github.com/pracdata/awesome-open-source-data-engineering/branches
Tagshttps://github.com/pracdata/awesome-open-source-data-engineering/tags
https://github.com/pracdata/awesome-open-source-data-engineering/branches
https://github.com/pracdata/awesome-open-source-data-engineering/tags
23 Commitshttps://github.com/pracdata/awesome-open-source-data-engineering/commits/main/
https://github.com/pracdata/awesome-open-source-data-engineering/commits/main/
README.mdhttps://github.com/pracdata/awesome-open-source-data-engineering/blob/main/README.md
README.mdhttps://github.com/pracdata/awesome-open-source-data-engineering/blob/main/README.md
READMEhttps://github.com/pracdata/awesome-open-source-data-engineering
https://github.com/sindresorhus/awesome
https://github.com/pracdata/awesome-open-source-data-engineering#awesome-open-source-data-engineering-
https://private-user-images.githubusercontent.com/2711465/421744774-fe9e97a8-abd8-47a9-8429-15130055785c.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3ODMzODQ1NDksIm5iZiI6MTc4MzM4NDI0OSwicGF0aCI6Ii8yNzExNDY1LzQyMTc0NDc3NC1mZTllOTdhOC1hYmQ4LTQ3YTktODQyOS0xNTEzMDA1NTc4NWMucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI2MDcwNyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNjA3MDdUMDAzMDQ5WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MTUxNzY2MTdhMmY1MzA1YTA4ZjYzNWY2MzcyM2UxYWZkZjNmZjg1Mjk1MGIzOWM3NGIzNTcxZDIwZTNiNTE4NiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmcmVzcG9uc2UtY29udGVudC10eXBlPWltYWdlJTJGcG5nIn0.ijN8skkdYhtXMHXsttLv7LhqaNfVxxgKu-Hh5sNrf_w
Pracdata.iohttps://www.pracdata.io/p/open-source-data-engineering-landscape-2025
https://github.com/pracdata/awesome-open-source-data-engineering#table-of-contents
Storage Systemshttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#storage-systems
Data Lake Platformhttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#data-lake-platform
Data Integrationhttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#data-integration
Data Processing & Computationhttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#data-processing-and-computation
Workflow Management & DataOpshttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#workflow-management--dataops
Data Infrastructurehttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#data-infrastructure
Metadata Managementhttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#metadata-management
Analytics & Visualisationhttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#analytics--visualisation
ML/AI Platformhttps://github.com/pracdata/awesome-open-source-data-engineering?tab=readme-ov-file#mlai-platform
https://github.com/pracdata/awesome-open-source-data-engineering#storage-systems
https://github.com/pracdata/awesome-open-source-data-engineering#relational-dbms
PostgreSQLhttps://github.com/postgres/postgres
MySQLhttps://github.com/mysql/mysql-server
MariaDBhttps://github.com/MariaDB/server
Supabasehttps://github.com/supabase/supabase
SQlitehttps://github.com/sqlite/sqlite
https://github.com/pracdata/awesome-open-source-data-engineering#distributed-sql-dbms
Citushttps://github.com/citusdata/citus
CockroachDBhttps://github.com/cockroachdb/cockroach
YugabyteDBhttps://github.com/yugabyte/yugabyte-db
TiDBhttps://github.com/pingcap/tidb
OceanBasehttps://github.com/oceanbase/oceanbase
ShardingSpherehttps://github.com/apache/shardingsphere
Neonhttps://github.com/neondatabase/neon
CrateDBhttps://github.com/crate/crate
https://github.com/pracdata/awesome-open-source-data-engineering#cache-store
Redishttps://github.com/redis/redis
Memcachedhttps://github.com/memcached/memcached
Dragonflyhttps://github.com/dragonflydb/dragonfly
https://github.com/pracdata/awesome-open-source-data-engineering#in-memory-sql-database
Apache Ignitehttps://github.com/apache/ignite
ReadySethttps://github.com/readysettech/readyset
VoltDBhttps://github.com/voltdb/
https://github.com/pracdata/awesome-open-source-data-engineering#document-store
MongoDBhttps://github.com/mongodb/mongo
RavenDBhttps://github.com/ravendb/ravendb
RethinkDBhttps://github.com/rethinkdb/rethinkdb
CouchDBhttps://github.com/apache/couchdb
Couchbasehttps://github.com/couchbase
FerretDBhttps://github.com/FerretDB/FerretDB
LowDBhttps://github.com/typicode/lowdb
https://github.com/pracdata/awesome-open-source-data-engineering#nosql-multi-model
OrientDBhttps://github.com/orientechnologies/orientdb
ArrangoDBhttps://github.com/arangodb/arangodb
SurrealDBhttps://github.com/surrealdb/surrealdb
EdgeDBhttps://github.com/edgedb/edgedb
https://github.com/pracdata/awesome-open-source-data-engineering#graph-database
Neo4jhttps://github.com/neo4j/neo4j
JunasGraphhttps://github.com/JanusGraph/janusgraph
HugeGraphhttps://github.com/apache/incubator-hugegraph
NebulaGraphhttps://github.com/vesoft-inc/nebula
Cayleyhttps://github.com/cayleygraph/cayley
Dgraphhttps://github.com/dgraph-io/dgraph
Apache Agehttps://github.com/apache/age
FalkorDBhttps://github.com/FalkorDB/falkordb
https://github.com/pracdata/awesome-open-source-data-engineering#distributed-key-value-store
Riakhttps://github.com/basho/riak
FoundationDBhttps://github.com/apple/foundationdb
etcdhttps://github.com/etcd-io/etcd
TiKVhttps://github.com/tikv/tikv
Immudbhttps://github.com/codenotary/immudb
Valkeyhttps://github.com/valkey-io/valkey
Apache Kvrockshttps://github.com/apache/kvrocks
https://github.com/pracdata/awesome-open-source-data-engineering#wide-column-key-value-store
Apache Cassandrahttps://github.com/apache/cassandra
Apache Hbasehttps://github.com/apache/hbase
Scyllahttps://github.com/scylladb/scylladb
Apache Accumulohttps://github.com/apache/accumulo
https://github.com/pracdata/awesome-open-source-data-engineering#embedded-key-value-store
LevelDBhttps://github.com/google/leveldb
RocksDBhttps://github.com/facebook/rocksdb
MyRockshttps://github.com/facebook/mysql-5.6
BadgerDBhttps://github.com/dgraph-io/badger
https://github.com/pracdata/awesome-open-source-data-engineering#search-engine
Apache Solrhttps://github.com/apache/solr
Elastic Searchhttps://github.com/elastic/elasticsearch
Sphinxhttps://github.com/sphinxsearch/sphinx
Meilisearchhttps://github.com/meilisearch/meilisearch
OpenSearchhttps://github.com/opensearch-project/OpenSearch
Quickwithttps://github.com/quickwit-oss/quickwit
ParadeDBhttps://github.com/paradedb/paradedb
https://github.com/pracdata/awesome-open-source-data-engineering#streaming-database
RisingWavehttps://github.com/risingwavelabs/risingwave
Materializehttps://github.com/MaterializeInc/materialize
EventStoreDBhttps://github.com/EventStore/EventStore
KsqlDBhttps://github.com/confluentinc/ksql
Timeplus Protonhttps://github.com/timeplus-io/proton
Flusshttps://github.com/alibaba/fluss
https://github.com/pracdata/awesome-open-source-data-engineering#time-series-database
Influxdbhttps://github.com/influxdata/influxdb
TimeScaleDBhttps://github.com/timescale/timescaledb
Apache IoTDBhttps://github.com/apache/iotdb
Netflix Atlashttps://github.com/Netflix/atlas
QuestDBhttps://github.com/questdb/questdb
TDEnginehttps://github.com/taosdata/TDengine
KairosDBhttps://github.com/kairosdb/kairosdb
GreptimeDBhttps://github.com/GreptimeTeam/greptimedb
HoraeDBhttps://github.com/apache/horaedb
https://github.com/pracdata/awesome-open-source-data-engineering#columnar-olap-database
Apache Kuduhttps://github.com/apache/kudu
Greeenplumhttps://github.com/greenplum-db/gpdb-archive
MonetDBhttps://github.com/MonetDB/MonetDB
Databendhttps://github.com/datafuselabs/databend
ByConityhttps://github.com/ByConity/ByConity
Hydrahttps://github.com/hydradatabase/hydra
https://github.com/pracdata/awesome-open-source-data-engineering#real-time-olap-engine
ClickHousehttps://github.com/ClickHouse/ClickHouse
Apache Pinothttps://github.com/apache/pinot
Apache Druidhttps://github.com/apache/druid
Apache Kylinhttps://github.com/apache/kylin
Apache Dorishttps://github.com/apache/doris
StarRockshttps://github.com/StarRocks/StarRocks
https://github.com/pracdata/awesome-open-source-data-engineering#in-process-olap-engine
DuckDBhttps://github.com/duckdb/duckdb
GlareDBhttps://github.com/GlareDB/glaredb
Apache DataFusionhttps://github.com/apache/datafusion
chdbhttps://github.com/chdb-io/chdb
SlateDBhttps://github.com/slatedb/slatedb
https://github.com/pracdata/awesome-open-source-data-engineering#olap-extensions
pg_duckdbhttps://github.com/duckdb/pg_duckdb
pg_analyticshttps://github.com/paradedb/pg_analytics
pg_mooncakehttps://github.com/Mooncake-Labs/pg_mooncake
pg_parquethttps://github.com/CrunchyData/pg_parquet
https://github.com/pracdata/awesome-open-source-data-engineering#data-lake-platform
https://github.com/pracdata/awesome-open-source-data-engineering#distributed-file-system
Apache Hadoop HDFShttps://github.com/apache/hadoop
GlusterFShttps://github.com/gluster/glusterfs
JuiceFShttps://github.com/juicedata/juicefs
Lustrehttps://github.com/lustre
https://github.com/pracdata/awesome-open-source-data-engineering#distributed-object-store
Apache Ozonehttps://github.com/apache/ozone
Cephhttps://github.com/ceph/ceph
Miniohttps://github.com/minio/minio
Garagehttps://git.deuxfleurs.fr/Deuxfleurs/garage
https://github.com/pracdata/awesome-open-source-data-engineering#serialisation-framework
Apache Parquethttps://github.com/apache/parquet-format
Apache Avrohttps://github.com/apache/avro
Apache ORChttps://github.com/apache/orc
Lancehttps://github.com/lancedb/lance
Vortexhttps://github.com/spiraldb/vortex
Arrow Featherhttps://github.com/apache/arrow
https://github.com/pracdata/awesome-open-source-data-engineering#open-table-format
Apache Hudihttps://github.com/apache/hudi
Apache Iceberghttps://github.com/apache/iceberg
Delta Lakehttps://github.com/delta-io/delta
Apache Paimonhttps://github.com/apache/incubator-paimon
OpenHousehttps://github.com/linkedin/openhouse
https://github.com/pracdata/awesome-open-source-data-engineering#native-open-table-format-library
Delta-rshttps://github.com/delta-io/delta-rs
PyIceberghttps://github.com/apache/iceberg-python
Hudi-rshttps://github.com/apache/hudi-rs
https://github.com/pracdata/awesome-open-source-data-engineering#universal-lakehouse
Apache XTablehttps://github.com/apache/incubator-xtable
Apache Amorohttps://github.com/apache/amoro
https://github.com/pracdata/awesome-open-source-data-engineering#data-integration
https://github.com/pracdata/awesome-open-source-data-engineering#data-integration-platform
Airbytehttps://github.com/airbytehq/airbyte
Apache Nifihttps://github.com/apache/nifi
Apache Camelhttps://github.com/apache/camel
Apache Gobblinhttps://github.com/apache/gobblin
Apache Inlonghttps://github.com/apache/Inlong
Meltanohttps://github.com/meltano/meltano
Apache SeaTunnelhttps://github.com/apache/seatunnel
Estuary Flowhttps://github.com/estuary/flow
dlthttps://github.com/dlt-hub/dlt
https://github.com/pracdata/awesome-open-source-data-engineering#cdc-tool
Debeziumhttps://github.com/debezium/debezium
Kafka Connecthttps://github.com/apache/kafka
Redpanda Conencthttps://github.com/redpanda-data/connect
Flink CDChttps://github.com/apache/flink-cdc
Brooklinhttps://github.com/linkedin/brooklin
RudderStackhttps://github.com/rudderlabs/rudder-server
Artie Transferhttps://github.com/artie-labs/transfer
Dozerhttps://github.com/getdozer/dozer
PeerDBhttps://github.com/PeerDB-io/peerdb
https://github.com/pracdata/awesome-open-source-data-engineering#data-migration
DBmatehttps://github.com/amacneil/dbmate
Ingestrhttps://github.com/bruin-data/ingestr
Slinghttps://github.com/slingdata-io/sling-cli
https://github.com/pracdata/awesome-open-source-data-engineering#log--event-collection
CloudQueryhttps://github.com/cloudquery/cloudquery
Snowplowhttps://github.com/snowplow/snowplow
EventMeshhttps://github.com/apache/eventmesh
Apache Flumehttps://github.com/apache/flume
Steampipehttps://github.com/turbot/steampipe
Jitsuhttps://github.com/jitsucom/jitsu
https://github.com/pracdata/awesome-open-source-data-engineering#event-hub
Apache Kafkahttps://github.com/apache/kafka
NSQhttps://github.com/nsqio/nsq
Apache Pulsarhttps://github.com/apache/pulsar
Apache RocketMQhttps://github.com/apache/rocketmq
Redpandahttps://github.com/redpanda-data/redpanda
Memphishttps://github.com/memphisdev/memphis
AutoMQhttps://github.com/AutoMQ/automq
https://github.com/pracdata/awesome-open-source-data-engineering#reverse-etl
Multiwovenhttps://github.com/Multiwoven/multiwoven
https://github.com/pracdata/awesome-open-source-data-engineering#data-processing-and-computation
https://github.com/pracdata/awesome-open-source-data-engineering#unified-processing
Apache Beamhttps://github.com/apache/beam
Apache Sparkhttps://github.com/apache/spark
Dinkyhttps://github.com/DataLinkDC/dinky
Feldorahttps://github.com/feldera/feldera
https://github.com/pracdata/awesome-open-source-data-engineering#batch-processing
Hadoop MapReducehttps://github.com/apache/hadoop
Apache Tezhttps://github.com/apache/tez
https://github.com/pracdata/awesome-open-source-data-engineering#stream-processing
Apache Flinkhttps://github.com/apache/flink
Apache Samzahttps://github.com/apache/samza
Apache Stormhttps://github.com/apache/storm
Akkahttps://github.com/akka/akka
Bytewaxhttps://github.com/bytewax/bytewax
Timeplus Protonhttps://github.com/timeplus-io/proton
FastStreamhttps://github.com/airtai/faststream
Bentohttps://github.com/warpstreamlabs/bento
Fluviohttps://github.com/infinyon/fluvio
Arroyohttps://github.com/ArroyoSystems/arroyo
https://github.com/pracdata/awesome-open-source-data-engineering#python-processing-framework
Polarshttps://github.com/pola-rs/polars
PySparkhttps://github.com/apache/spark
Vaexhttps://github.com/vaexio/vaex
Apache Arrowhttps://github.com/apache/arrow
Ibishttps://github.com/ibis-project/ibis
SQLFramehttps://github.com/eakmanrq/sqlframe
Dafthttps://github.com/Eventual-Inc/Daft
cuDFhttps://github.com/rapidsai/cudf
https://github.com/pracdata/awesome-open-source-data-engineering#python-workflow-scaling
Daskhttps://github.com/dask/dask
RAYhttps://github.com/ray-project/ray
Modinhttps://github.com/modin-project/modin
Pandaral·lelhttps://github.com/nalepae/pandarallel
https://github.com/pracdata/awesome-open-source-data-engineering#sql-toolkit
SQLAlchemyhttps://github.com/sqlalchemy/sqlalchemy
SQLGlothttps://github.com/tobymao/sqlglot
https://github.com/pracdata/awesome-open-source-data-engineering#workflow-management--dataops
https://github.com/pracdata/awesome-open-source-data-engineering#workflow-orchestration
Apache Airflowhttps://github.com/apache/airflow
Prefecthttps://github.com/PrefectHQ/prefect
Argohttps://github.com/argoproj/argo-workflows
Azkabanhttps://github.com/azkaban/azkaban
Cadencehttps://github.com/uber/cadence
Dagsterhttps://github.com/dagster-io/dagster
Apache DolpinSchedulerhttps://github.com/apache/dolphinscheduler
Luigihttps://github.com/spotify/luigi
Flytehttps://github.com/flyteorg/flyte
Kestrahttps://github.com/kestra-io/kestra
Mage.aihttps://github.com/mage-ai/mage-ai
Temporalhttps://github.com/temporalio/temporal
Windmillhttps://github.com/windmill-labs/windmill
Maestrohttps://github.com/Netflix/maestro
https://github.com/pracdata/awesome-open-source-data-engineering#job-scheduling
Celeryhttps://github.com/celery/celery
DKronhttps://github.com/distribworks/dkron
ApSchedulerhttps://github.com/agronholm/apscheduler/
https://github.com/pracdata/awesome-open-source-data-engineering#data-quality
Data-diffhttps://github.com/datafold/data-diff
Great Expectationshttps://github.com/great-expectations/great_expectations
Deequehttps://github.com/awslabs/deequ
Panderahttps://github.com/unionai-oss/pandera
Sodahttps://github.com/sodadata/soda-core
Pydantichttps://github.com/pydantic/pydantic
https://github.com/pracdata/awesome-open-source-data-engineering#data-versioning
LakeFShttps://github.com/treeverse/lakeFS
Project Nessiehttps://github.com/projectnessie/nessie
DVChttps://github.com/iterative/dvc
Dolthttps://github.com/dolthub/dolt
Git-lfshttps://github.com/git-lfs/git-lfs
Datachainhttps://github.com/iterative/datachain
https://github.com/pracdata/awesome-open-source-data-engineering#data-modeling
dbthttps://github.com/dbt-labs/dbt-core
SQLMeshhttps://github.com/TobikoData/sqlmesh
https://github.com/pracdata/awesome-open-source-data-engineering#pipeline-observability
Elementryhttps://github.com/elementary-data/elementary
https://github.com/pracdata/awesome-open-source-data-engineering#data-infrastructure
https://github.com/pracdata/awesome-open-source-data-engineering#resource-scheduling
Apache Yarnhttps://github.com/apache/hadoop
Apache Mesoshttps://github.com/apache/mesos
Kuberneteshttps://github.com/kubernetes/kubernetes
Apache YuniKornhttps://github.com/apache/yunikorn-core
Dockerhttps://github.com/docker
https://github.com/pracdata/awesome-open-source-data-engineering#cluster-administration
Apache Ambarihttps://github.com/apache/ambari
Apache Helixhttps://github.com/apache/helix
https://github.com/pracdata/awesome-open-source-data-engineering#security
Apache Knoxhttps://github.com/apache/knox
Apache Rangerhttps://github.com/apache/ranger
Kerberoshttps://github.com/krb5/krb5
https://github.com/pracdata/awesome-open-source-data-engineering#metrics-store
Influxdbhttps://github.com/influxdata/influxdb
Mimirhttps://github.com/grafana/mimir
OpenTSDBhttps://github.com/OpenTSDB/opentsdb
M3https://github.com/m3db/m3
https://github.com/pracdata/awesome-open-source-data-engineering#observability-framework
Prometheushttps://github.com/prometheus/prometheus
ELKhttps://www.elastic.co/elastic-stack
Graphitehttps://github.com/graphite-project
OpenTelemetryhttps://github.com/open-telemetry
VictoriaMetricshttps://github.com/VictoriaMetrics/VictoriaMetrics/
Zabbixhttps://github.com/zabbix/zabbix
https://github.com/pracdata/awesome-open-source-data-engineering#monitoring-dashboard
Grafanahttps://github.com/grafana/grafana
Kibanahttps://github.com/elastic/kibana
Redpanda Consolehttps://github.com/redpanda-data/console
https://github.com/pracdata/awesome-open-source-data-engineering#log--metrics-pipeline
Fluentdhttps://github.com/fluent/fluentd
Fluent Bithttps://github.com/fluent/fluent-bit
Logstashhttps://github.com/elastic/logstash
Telegrafhttps://github.com/influxdata/telegraf
Vectorhttps://github.com/vectordotdev/vector
StatsDhttps://github.com/statsd/statsd
https://github.com/pracdata/awesome-open-source-data-engineering#cost-management
OpenCosthttps://github.com/opencost/opencost
https://github.com/pracdata/awesome-open-source-data-engineering#metadata-management
https://github.com/pracdata/awesome-open-source-data-engineering#metadata-platform
Amundsenhttps://github.com/amundsen-io/amundsen
Apache Atlashttps://github.com/apache/atlas
DataHubhttps://github.com/datahub-project/datahub
Marquezhttps://github.com/MarquezProject/marquez
ckanhttps://github.com/ckan/ckan
Open Metadatahttps://github.com/open-metadata/OpenMetadata
ODD Platformhttps://github.com/opendatadiscovery/odd-platform
https://github.com/pracdata/awesome-open-source-data-engineering#open-standards
Open Lineagehttps://github.com/OpenLineage/OpenLineage
Open Metadatahttps://github.com/open-metadata/OpenMetadata
Egeriahttps://github.com/odpi/egeria
https://github.com/pracdata/awesome-open-source-data-engineering#schema--catalog-service
Hive Metastorehttps://github.com/apache/hive
Confluent Schema Registryhttps://github.com/confluentinc/schema-registry
Apache Polarishttps://github.com/apache/polaris
Unity Cataloghttps://github.com/unitycatalog/unitycatalog
Lakekeeperhttps://github.com/lakekeeper/lakekeeper
Apache Gravitinohttps://github.com/apache/gravitino
https://github.com/pracdata/awesome-open-source-data-engineering#analytics--visualisation
https://github.com/pracdata/awesome-open-source-data-engineering#bi--dashboard
Apache Supersethttps://github.com/apache/superset
Metabasehttps://github.com/metabase/metabase
Redashhttps://github.com/getredash/redash
Lightdashhttps://github.com/lightdash/lightdash
https://github.com/pracdata/awesome-open-source-data-engineering#bi-as-code-web-app
Streamlithttps://github.com/streamlit/streamlit
Evidencehttps://github.com/evidence-dev/evidence
dashhttps://github.com/plotly/dash
Vizrohttps://github.com/mckinsey/vizro
Mercuryhttps://github.com/mljar/mercury
Quaryhttps://github.com/quarylabs/quary
https://github.com/pracdata/awesome-open-source-data-engineering#query--collaboration
Huehttps://github.com/cloudera/hue
Apache Zeppelinhttps://github.com/apache/zeppelin
Querybookhttps://github.com/pinterest/querybook
Jupyterhttps://github.com/jupyter/notebook
IPythonhttps://github.com/ipython/ipython
Datasettehttps://github.com/simonw/datasette
https://github.com/pracdata/awesome-open-source-data-engineering#mpp-query-engine
Apache Hivehttps://github.com/apache/hive
Apache Implalahttps://github.com/apache/impala
Prestohttps://github.com/prestodb/presto
Trinohttps://github.com/trinodb/trino
Apache Drillhttps://github.com/apache/drill
DataFusion Ballistahttps://github.com/apache/datafusion-ballista
https://github.com/pracdata/awesome-open-source-data-engineering#semantic--middleware-layer
Alluxiohttps://github.com/Alluxio/alluxio
Cubehttps://github.com/cube-js/cube
Apache Linkishttps://github.com/apache/linkis
Apache Glutenhttps://github.com/apache/incubator-gluten
Apache OpenDALhttps://github.com/apache/opendal
https://github.com/pracdata/awesome-open-source-data-engineering#data-sharing
delta-sharinghttps://github.com/delta-io/delta-sharing
https://github.com/pracdata/awesome-open-source-data-engineering#mlai-platform
https://github.com/pracdata/awesome-open-source-data-engineering#vector-storage
milvushttps://github.com/milvus-io/milvus
qdranthttps://github.com/qdrant/qdrant
chromahttps://github.com/chroma-core/chroma
marqohttps://github.com/marqo-ai/marqo
LanceDBhttps://github.com/lancedb/lancedb
weaviatehttps://github.com/weaviate/weaviate
deeplakehttps://github.com/activeloopai/deeplake
Vespahttps://github.com/vespa-engine/vespa
valdhttps://github.com/vdaas/vald
pgvectorhttps://github.com/pgvector/pgvector
https://github.com/pracdata/awesome-open-source-data-engineering#mlops
mlflowhttps://github.com/mlflow/mlflow
Metaflowhttps://github.com/Netflix/metaflow
SkyPilothttps://github.com/skypilot-org/skypilot
Jinahttps://github.com/jina-ai/jina
NNIhttps://github.com/microsoft/nni
BentoMLhttps://github.com/bentoml/BentoML
Determined AIhttps://github.com/determined-ai/determined
RAYhttps://github.com/ray-project/ray
kubeflowhttps://github.com/kubeflow/kubeflow
Kedrohttps://github.com/kedro-org/kedro
Pachydermhttps://github.com/pachyderm/pachyderm
https://github.com/pracdata/awesome-open-source-data-engineering#llmops
Difyhttps://github.com/langgenius/dify
Haystackhttps://github.com/deepset-ai/haystack
Superduperhttps://github.com/superduper-io/superduper
Cogneehttps://github.com/topoteretes/cognee
vLLMhttps://github.com/vllm-project/vllm
data https://github.com/topics/data
awesome https://github.com/topics/awesome
database https://github.com/topics/database
etl https://github.com/topics/etl
analytics https://github.com/topics/analytics
workflow-engine https://github.com/topics/workflow-engine
data-storage https://github.com/topics/data-storage
self-hosted https://github.com/topics/self-hosted
data-warehouse https://github.com/topics/data-warehouse
data-engineering https://github.com/topics/data-engineering
data-analytics https://github.com/topics/data-analytics
data-platform https://github.com/topics/data-platform
awesome-list https://github.com/topics/awesome-list
data-integration https://github.com/topics/data-integration
observability https://github.com/topics/observability
data-pipeline https://github.com/topics/data-pipeline
datalake https://github.com/topics/datalake
mlops https://github.com/topics/mlops
lakehouse https://github.com/topics/lakehouse
data-lakehouse https://github.com/topics/data-lakehouse
Readme https://github.com/pracdata/awesome-open-source-data-engineering#readme-ov-file
Please reload this pagehttps://github.com/pracdata/awesome-open-source-data-engineering
Activityhttps://github.com/pracdata/awesome-open-source-data-engineering/activity
Custom propertieshttps://github.com/pracdata/awesome-open-source-data-engineering/custom-properties
74 forkshttps://github.com/pracdata/awesome-open-source-data-engineering/forks
Report repository https://github.com/contact/report-content?content_url=https%3A%2F%2Fgithub.com%2Fpracdata%2Fawesome-open-source-data-engineering&report=pracdata+%28user%29
Contributorshttps://github.com/pracdata/awesome-open-source-data-engineering/graphs/contributors
Please reload this pagehttps://github.com/pracdata/awesome-open-source-data-engineering
https://github.com
Termshttps://docs.github.com/site-policy/github-terms/github-terms-of-service
Privacyhttps://docs.github.com/site-policy/privacy-policies/github-privacy-statement
Securityhttps://github.com/security
Statushttps://www.githubstatus.com/
Communityhttps://github.community/
Docshttps://docs.github.com/
Contacthttps://support.github.com?tags=dotcom-footer

Viewport: width=device-width

URLs of crawlers that visited me.