Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
prometheus/prometheus
The Prometheus monitoring system and time series database.
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 6 list mentions
- First commit
- 2012-11-24
- License
- Apache-2.0
- Issues
- 983 open
66,598
stars
- Forks
- 10,917
- Commits
- 18,958 commits
- Star growth, last 7 days
- +136 +0.2%
- Commit velocity, last 7 days
- +117 +0.6%
pingcap/tidb
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
AI dev
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2015-09-06
- License
- Apache-2.0
- Issues
- 7,367 open
40,645
stars
- Forks
- 6,266
- Commits
- 28,736 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
kestra-io/kestra
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
AI dev
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2019-08-13
- License
- Apache-2.0
- Issues
- 888 open
29,650
stars
- Forks
- 3,405
- Commits
- 13,021 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
manticoresoftware/manticoresearch
Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2003-11-19
- License
- GPL-3.0
- Issues
- 652 open
12,057
stars
- Forks
- 647
- Commits
- 14,097 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
piskvorky/smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
GitHub topics
- Updated
- 2026-10-12
- Lists
- 1 list mention
- First commit
- 2015-01-02
- License
- MIT
- Issues
- 14 open
3,464
stars
- Forks
- 395
- Commits
- 1,246 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
GitHub topics
- Updated
- 2026-10-14
- Lists
- 3 list mentions
- First commit
- 2019-07-25
- License
- Apache-2.0
- Issues
- 178 open
2,610
stars
- Forks
- 221
- Commits
- 2,116 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
lf-edge/ekuiper
Lightweight data stream processing engine for IoT edge
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2019-07-03
- License
- Apache-2.0
- Issues
- 47 open
1,739
stars
- Forks
- 464
- Commits
- 3,719 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
Multiwoven/multiwoven
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
- Updated
- 2026-10-15
- Lists
- 3 list mentions
- First commit
- 2023-10-20
- License
- AGPL-3.0
- Issues
- 199 open
1,680
stars
- Forks
- 96
- Commits
- 1,888 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
NationalSecurityAgency/timely
Accumulo backed time series database
Stack
GitHub topics
- Updated
- 2026-10-02
- Lists
- 2 list mentions
- First commit
- 2016-04-21
- License
- Apache-2.0
- Issues
- 20 open
- Forks
- 109
- Commits
- 490 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
grai-io/grai-core
No description.
GitHub topics
- Updated
- 2026-01-30
- Lists
- 2 list mentions
- First commit
- 2022-06-09
- License
- MIT-0
- Issues
- 51 open
317
stars
- Forks
- 20
- Commits
- 1,085 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%