Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 7 list mentions
- First commit
- 2015-07-02
- License
- Apache-2.0
- Issues
- 586 open
75,176
stars
- Forks
- 18,481
- Commits
- 23,792 commits
- Star growth, last 7 days
- +74 +0.1%
- Commit velocity, last 7 days
- +153 +0.6%
prometheus/prometheus
The Prometheus monitoring system and time series database.
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 6 list mentions
- First commit
- 2012-11-24
- License
- Apache-2.0
- Issues
- 983 open
66,598
stars
- Forks
- 10,917
- Commits
- 18,958 commits
- Star growth, last 7 days
- +136 +0.2%
- Commit velocity, last 7 days
- +117 +0.6%
pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
GitHub topics
- Updated
- 2026-10-16
- Lists
- 5 list mentions
- First commit
- 2023-07-21
- License
- NOASSERTION
- Issues
- 37 open
62,113
stars
- Forks
- 1,683
- Commits
- 2,312 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
metabase/metabase
The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 6 list mentions
- First commit
- 2015-02-02
- License
- NOASSERTION
- Issues
- 4,549 open
49,706
stars
- Forks
- 6,910
- Commits
- 45,700 commits
- Star growth, last 7 days
- +99 +0.2%
- Commit velocity, last 7 days
- +205 +0.5%
kestra-io/kestra
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
AI dev
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2019-08-13
- License
- Apache-2.0
- Issues
- 888 open
29,650
stars
- Forks
- 3,405
- Commits
- 13,021 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
plotly/dash
Data Apps & Dashboards for Python. No JavaScript Required.
AI dev
GitHub topics
- Updated
- 2026-10-15
- Lists
- 4 list mentions
- First commit
- 2015-04-10
- License
- MIT
- Issues
- 433 open
24,456
stars
- Forks
- 2,329
- Commits
- 10,295 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
AI dev
- Updated
- 2026-10-12
- Lists
- 5 list mentions
- First commit
- 2018-04-30
- License
- Apache-2.0
- Issues
- 2,590 open
16,282
stars
- Forks
- 2,354
- Commits
- 28,117 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/druid
Apache Druid: a high performance real-time analytics database.
AI dev
- Updated
- 2026-10-17
- Lists
- 4 list mentions
- First commit
- 2012-10-23
- License
- Apache-2.0
- Issues
- 777 open
14,088
stars
- Forks
- 3,802
- Commits
- 16,747 commits
- Star growth, last 7 days
- +26 +0.2%
- Commit velocity, last 7 days
- +44 +0.3%
cocoindex-io/cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
AI dev
- Updated
- 2026-10-16
- Lists
- 3 list mentions
- First commit
- 2025-03-03
- License
- Apache-2.0
- Issues
- 103 open
11,710
stars
- Forks
- 919
- Commits
- 2,168 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
treeverse/lakeFS
lakeFS - Data version control for your data lake | Git for data
- Updated
- 2026-10-07
- Lists
- 2 list mentions
- First commit
- 2019-09-12
- License
- NOASSERTION
- Issues
- 450 open
5,557
stars
- Forks
- 485
- Commits
- 6,569 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
jitsucom/jitsu
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
AI dev
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 3 list mentions
- First commit
- 2022-06-22
- License
- MIT
- Issues
- 44 open
5,107
stars
- Forks
- 402
- Commits
- 3,939 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
GitHub topics
- Updated
- 2026-10-14
- Lists
- 3 list mentions
- First commit
- 2019-07-25
- License
- Apache-2.0
- Issues
- 178 open
2,610
stars
- Forks
- 221
- Commits
- 2,116 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
stitchfix/pyxley
Python helpers for building dashboards using Flask and React
Archived
Stack
- Updated
- 2026-08-06
- Lists
- 1 list mention
- First commit
- 2015-06-22
- License
- MIT
- Issues
- 0 open
2,262
stars
- Forks
- 256
- Commits
- 156 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
Multiwoven/multiwoven
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
- Updated
- 2026-10-15
- Lists
- 3 list mentions
- First commit
- 2023-10-20
- License
- AGPL-3.0
- Issues
- 199 open
1,680
stars
- Forks
- 96
- Commits
- 1,888 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
slothflowlabs/duckle
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- Updated
- 2026-10-14
- Lists
- 3 list mentions
- First commit
- 2026-05-21
- License
- Apache-2.0
- Issues
- 73 open
1,508
stars
- Forks
- 120
- Commits
- 1,751 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dekart-xyz/dekart
Open-source backend for Kepler.gl. Self-hosted alternative to CARTO and Foursquare Studio.
AI dev
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2020-12-11
- License
- AGPL-3.0
- Issues
- 35 open
434
stars
- Forks
- 62
- Commits
- 1,868 commits
- Star growth, last 7 days
- +2 +0.5%
- Commit velocity, last 7 days
- 0 0.0%
NationalSecurityAgency/timely
Accumulo backed time series database
Stack
GitHub topics
- Updated
- 2026-10-02
- Lists
- 2 list mentions
- First commit
- 2016-04-21
- License
- Apache-2.0
- Issues
- 20 open
- Forks
- 109
- Commits
- 490 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
grai-io/grai-core
No description.
GitHub topics
- Updated
- 2026-01-30
- Lists
- 2 list mentions
- First commit
- 2022-06-09
- License
- MIT-0
- Issues
- 51 open
317
stars
- Forks
- 20
- Commits
- 1,085 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
kakao/actionbase
One database for user-user (follows), user-item (likes), and item-item (related items) interactions — precomputed at write time, served as simple lookups
GitHub topics
- Updated
- 2026-10-14
- Lists
- 2 list mentions
- First commit
- 2025-12-09
- License
- Apache-2.0
- Issues
- 0 open
227
stars
- Forks
- 18
- Commits
- 323 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dqops/dqo
Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.
Stack
- Updated
- 2026-01-05
- Lists
- 1 list mention
- First commit
- 2022-03-08
- License
- NOASSERTION
- Issues
- 9 open
194
stars
- Forks
- 38
- Commits
- 11,669 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
MoonMao42/ReceiptBI
Turn CSV, Excel, and read-only databases into verified, editable business reports.
- Updated
- 2026-10-16
- Lists
- 1 list mention
- First commit
- 2025-12-12
- License
- MIT
- Issues
- 0 open
39
stars
- Forks
- 0
- Commits
- 316 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
HMAKT99/AKF
Trust metadata for AI agents — a stamp costs ~15 tokens, re-verifying costs 15,000. Agents stamp what they verify; the next agent runs 'akf check' and builds on it. pip install akf
AI dev
GitHub topics
- Updated
- 2026-08-02
- Lists
- 1 list mention
- First commit
- 2026-02-28
- License
- MIT
- Issues
- 7 open
19
stars
- Forks
- 2
- Commits
- 234 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
wordbricks/onequery
One interface for your whole data stack, with built-in safeguards and a simpler workflow for your team. Written in Rust. Docker not needed.
AI dev
Stack
GitHub topics
- Updated
- 2026-07-30
- Lists
- 1 list mention
- First commit
- 2026-03-30
- License
- Apache-2.0
- Issues
- 5 open
17
stars
- Forks
- 2
- Commits
- 310 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%