Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
kestra-io/kestra
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
AI dev
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2019-08-13
- License
- Apache-2.0
- Issues
- 888 open
29,650
stars
- Forks
- 3,405
- Commits
- 13,021 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/druid
Apache Druid: a high performance real-time analytics database.
AI dev
- Updated
- 2026-10-17
- Lists
- 4 list mentions
- First commit
- 2012-10-23
- License
- Apache-2.0
- Issues
- 777 open
14,088
stars
- Forks
- 3,802
- Commits
- 16,747 commits
- Star growth, last 7 days
- +26 +0.2%
- Commit velocity, last 7 days
- +44 +0.3%
OpenTSDB/opentsdb
A scalable, distributed Time Series Database.
Stack
- Updated
- 2024-12-12
- Lists
- 2 list mentions
- First commit
- 2010-04-11
- License
- LGPL-2.1
- Issues
- 541 open
5,065
stars
- Forks
- 1,230
- Commits
- 1,712 commits
- Star growth, last 7 days
- +1 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/gravitino
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 1 list mention
- First commit
- 2023-04-23
- License
- Apache-2.0
- Issues
- 1,099 open
3,249
stars
- Forks
- 957
- Commits
- 4,671 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
jprante/elasticsearch-jdbc
JDBC importer for Elasticsearch *** THIS REPOSITORY WILL BE DELETED WITHOUT ANY FURTHER NOTICE AFTER AUG 1 2026 ***
Archived
- Updated
- 2026-06-03
- Lists
- 1 list mention
- First commit
- 2012-06-02
- License
- Apache-2.0
- Issues
- 1 open
2,805
stars
- Forks
- 693
- Commits
- 453 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/gobblin
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
GitHub topics
- Updated
- 2026-10-15
- Lists
- 2 list mentions
- First commit
- 2014-02-04
- License
- Apache-2.0
- Issues
- Disabled
2,270
stars
- Forks
- 749
- Commits
- 6,560 commits
- Star growth, last 7 days
- +1 0.0%
- Commit velocity, last 7 days
- +1 0.0%
pinterest/secor
Secor is a service implementing Kafka log persistence
Archived
AI dev
- Updated
- 2026-10-04
- Lists
- 2 list mentions
- First commit
- 2014-04-15
- License
- Apache-2.0
- Issues
- 284 open
1,858
stars
- Forks
- 536
- Commits
- 3,340 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
gchq/Gaffer
A large-scale entity and relation database supporting aggregation of properties
Archived
Stack
GitHub topics
- Updated
- 2025-06-06
- Lists
- 2 list mentions
- First commit
- 2015-12-14
- License
- Apache-2.0
- Issues
- 138 open
1,787
stars
- Forks
- 363
- Commits
- 7,332 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
kairosdb/kairosdb
Fast scalable time series database
GitHub topics
- Updated
- 2026-03-05
- Lists
- 3 list mentions
- First commit
- 2013-02-05
- License
- Apache-2.0
- Issues
- 141 open
1,760
stars
- Forks
- 341
- Commits
- 1,479 commits
- Star growth, last 7 days
- -1 -0.1%
- Commit velocity, last 7 days
- 0 0.0%
aklivity/zilla
🦎 A lightweight, multi-protocol gateway for event-driven applications and AI agents. Expose and govern Kafka, MQTT, APIs, and MCP through one high-performance engine with shared routing, security, schema, and observability.
AI dev
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2021-12-07
- License
- NOASSERTION
- Issues
- 241 open
1,710
stars
- Forks
- 147
- Commits
- 4,224 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- +7 +0.2%
projectnessie/nessie
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
AI dev
- Updated
- 2026-10-16
- Lists
- 1 list mention
- First commit
- 2020-04-07
- License
- Apache-2.0
- Issues
- 169 open
1,520
stars
- Forks
- 198
- Commits
- 11,882 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
spotify/heroic
The Heroic Time Series Database
Archived
GitHub topics
- Updated
- 2021-03-26
- Lists
- 1 list mention
- First commit
- 2015-06-03
- License
- Apache-2.0
- Issues
- 70 open
845
stars
- Forks
- 105
- Commits
- 1,296 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
rax-maas/blueflood
A distributed system designed to ingest and process time series data
- Updated
- 2024-08-19
- Lists
- 2 list mentions
- First commit
- 2013-08-19
- License
- Apache-2.0
- Issues
- 54 open
598
stars
- Forks
- 102
- Commits
- 3,152 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
NationalSecurityAgency/timely
Accumulo backed time series database
Stack
GitHub topics
- Updated
- 2026-10-02
- Lists
- 2 list mentions
- First commit
- 2016-04-21
- License
- Apache-2.0
- Issues
- 20 open
- Forks
- 109
- Commits
- 490 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
kroxylicious/kroxylicious
Kroxylicious, the snappy open source proxy for Apache Kafka®
AI dev
- Updated
- 2026-10-16
- Lists
- 1 list mention
- First commit
- 2021-09-14
- License
- Apache-2.0
- Issues
- 377 open
- Forks
- 136
- Commits
- 5,930 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/incubator-hivemall
Mirror of Apache Hivemall (incubating)
Archived
- Updated
- 2022-09-06
- Lists
- 1 list mention
- First commit
- 2013-09-26
- License
- Apache-2.0
- Issues
- Disabled
- Forks
- 112
- Commits
- 2,037 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
Stratio/deep-spark
Connecting Apache Spark with different data stores [DEPRECATED]
Archived
- Updated
- 2016-07-04
- Lists
- 1 list mention
- First commit
- 2014-02-18
- License
- Apache-2.0
- Issues
- 0 open
197
stars
- Forks
- 43
- Commits
- 1,084 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dqops/dqo
Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.
Stack
- Updated
- 2026-01-05
- Lists
- 1 list mention
- First commit
- 2022-03-08
- License
- NOASSERTION
- Issues
- 9 open
194
stars
- Forks
- 38
- Commits
- 11,669 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
scriptella/scriptella-etl
Scriptella is an open source ETL (Extract-Transform-Load) and script execution tool written in Java.
GitHub topics
- Updated
- 2026-10-15
- Lists
- 1 list mention
- First commit
- 2006-04-17
- License
- Apache-2.0
- Issues
- 18 open
- Forks
- 50
- Commits
- 895 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
asavinov/bistro
A general-purpose data analysis engine radically changing the way batch and stream data is processed
- Updated
- 2018-09-07
- Lists
- 1 list mention
- First commit
- 2017-09-03
- License
- MIT
- Issues
- 1 open
8
stars
- Forks
- 0
- Commits
- 141 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%