Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
GitHub topics
- Updated
- 2026-10-16
- Lists
- 5 list mentions
- First commit
- 2023-07-21
- License
- NOASSERTION
- Issues
- 37 open
62,113
stars
- Forks
- 1,683
- Commits
- 2,312 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 7 list mentions
- First commit
- 2014-10-06
- License
- Apache-2.0
- Issues
- 1,932 open
47,194
stars
- Forks
- 18,051
- Commits
- 42,128 commits
- Star growth, last 7 days
- +49 +0.1%
- Commit velocity, last 7 days
- +168 +0.4%
plotly/dash
Data Apps & Dashboards for Python. No JavaScript Required.
AI dev
GitHub topics
- Updated
- 2026-10-15
- Lists
- 4 list mentions
- First commit
- 2015-04-10
- License
- MIT
- Issues
- 433 open
24,456
stars
- Forks
- 2,329
- Commits
- 10,295 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
AI dev
- Updated
- 2026-10-12
- Lists
- 5 list mentions
- First commit
- 2018-04-30
- License
- Apache-2.0
- Issues
- 2,590 open
16,282
stars
- Forks
- 2,354
- Commits
- 28,117 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
cocoindex-io/cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
AI dev
- Updated
- 2026-10-16
- Lists
- 3 list mentions
- First commit
- 2025-03-03
- License
- Apache-2.0
- Issues
- 103 open
11,710
stars
- Forks
- 919
- Commits
- 2,168 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
OpenDCAI/DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
GitHub topics
- Updated
- 2026-10-13
- Lists
- 3 list mentions
- First commit
- 2024-10-13
- License
- Apache-2.0
- Issues
- 24 open
8,209
stars
- Forks
- 1,196
- Commits
- 1,209 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
GitHub topics
- Updated
- 2026-10-14
- Lists
- 3 list mentions
- First commit
- 2019-07-25
- License
- Apache-2.0
- Issues
- 178 open
2,610
stars
- Forks
- 221
- Commits
- 2,116 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
faust-streaming/faust
Python Stream Processing. A Faust fork
GitHub topics
- Updated
- 2026-10-14
- Lists
- 1 list mention
- First commit
- 2017-03-08
- License
- NOASSERTION
- Issues
- 146 open
1,889
stars
- Forks
- 205
- Commits
- 4,707 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ralforion/orionbelt-semantic-layer
Source-available semantic and context layer, rule engine, and semantic sidecar for agentic AI and governed analytics. Compiles declarative YAML models into optimized SQL, KPIs, and semantic context across 8 SQL dialects.
AI dev
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2026-02-16
- License
- NOASSERTION
- Issues
- 1 open
- Forks
- 11
- Commits
- 742 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
flex-analytics/flexviz
Interactive data exploration that is extremely fast and agent-native
AI dev
GitHub topics
- Updated
- 2026-10-13
- Lists
- 1 list mention
- First commit
- 2026-08-21
- License
- Apache-2.0
- Issues
- 44 open
- Forks
- 2
- Commits
- 583 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
MoonMao42/ReceiptBI
Turn CSV, Excel, and read-only databases into verified, editable business reports.
- Updated
- 2026-10-16
- Lists
- 1 list mention
- First commit
- 2025-12-12
- License
- MIT
- Issues
- 0 open
39
stars
- Forks
- 0
- Commits
- 316 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
provero-org/provero
Declarative data quality engine. Define checks in YAML, run anywhere.
AI dev
- Updated
- 2026-10-12
- Lists
- 1 list mention
- First commit
- 2026-03-12
- License
- Apache-2.0
- Issues
- 11 open
17
stars
- Forks
- 3
- Commits
- 133 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
mirlan-irokez/rawbbit
No description.
- Updated
- 2026-10-14
- Lists
- 1 list mention
- First commit
- 2026-05-04
- License
- Apache-2.0
- Issues
- 0 open
- Forks
- 2
- Commits
- 37 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
aegis-dq/aegis-dq
Open, audit-grade agentic data quality framework with portable industry packs
GitHub topics
- Updated
- 2026-05-27
- Lists
- 2 list mentions
- First commit
- 2026-05-11
- License
- NOASSERTION
- Issues
- 10 open
- Forks
- 2
- Commits
- 76 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
whispering3/CARQ
Pipeline de ingestão e busca semântica de documentos para RAG — com rate limiting, circuit breaker e fila resiliente.
- Updated
- 2026-06-04
- Lists
- 1 list mention
- First commit
- 2026-05-11
- License
- MIT
- Issues
- 0 open
2
stars
- Forks
- 0
- Commits
- 9 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%