Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
metabase/metabase
The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 6 list mentions
- First commit
- 2015-02-02
- License
- NOASSERTION
- Issues
- 4,549 open
49,706
stars
- Forks
- 6,910
- Commits
- 45,700 commits
- Star growth, last 7 days
- +99 +0.2%
- Commit velocity, last 7 days
- +205 +0.5%
pingcap/tidb
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
AI dev
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2015-09-06
- License
- Apache-2.0
- Issues
- 7,367 open
40,645
stars
- Forks
- 6,266
- Commits
- 28,736 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
influxdata/influxdb
Scalable datastore for metrics, events, and real-time analytics
AI dev
- Updated
- 2026-10-15
- Lists
- 3 list mentions
- First commit
- 2013-04-11
- License
- Apache-2.0
- Issues
- 2,179 open
31,766
stars
- Forks
- 3,722
- Commits
- 49,927 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
rqlite/rqlite
The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.
AI dev
Stack
- Updated
- 2026-10-15
- Lists
- 4 list mentions
- First commit
- 2014-08-23
- License
- MIT
- Issues
- 65 open
17,794
stars
- Forks
- 818
- Commits
- 8,689 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
scylladb/scylladb
NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 1 list mention
- First commit
- 2014-08-10
- License
- NOASSERTION
- Issues
- 3,825 open
15,790
stars
- Forks
- 1,526
- Commits
- 57,503 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
manticoresoftware/manticoresearch
Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2003-11-19
- License
- GPL-3.0
- Issues
- 652 open
12,057
stars
- Forks
- 647
- Commits
- 14,097 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
tarantool/tarantool
Get your data in RAM. Get compute close to data. Enjoy the performance.
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2010-08-12
- License
- NOASSERTION
- Issues
- 1,776 open
3,671
stars
- Forks
- 426
- Commits
- 20,214 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
filodb/FiloDB
Distributed Prometheus time series database
GitHub topics
- Updated
- 2026-10-13
- Lists
- 1 list mention
- First commit
- 2015-01-14
- License
- Apache-2.0
- Issues
- 72 open
1,468
stars
- Forks
- 239
- Commits
- 3,147 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
akumuli/Akumuli
Time-series database
Archived
GitHub topics
- Updated
- 2022-08-07
- Lists
- 2 list mentions
- First commit
- 2013-05-08
- License
- Apache-2.0
- Issues
- 63 open
838
stars
- Forks
- 85
- Commits
- 2,362 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
hstreamdb/hstream
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Stack
- Updated
- 2024-12-26
- Lists
- 1 list mention
- First commit
- 2020-09-01
- License
- BSD-3-Clause
- Issues
- 11 open
723
stars
- Forks
- 55
- Commits
- 1,726 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
SouravRoy-ETL/slothdb
An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.
GitHub topics
- Updated
- 2026-06-03
- Lists
- 1 list mention
- First commit
- 2026-04-15
- License
- MIT
- Issues
- 5 open
412
stars
- Forks
- 6
- Commits
- 573 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
kakao/actionbase
One database for user-user (follows), user-item (likes), and item-item (related items) interactions — precomputed at write time, served as simple lookups
GitHub topics
- Updated
- 2026-10-14
- Lists
- 2 list mentions
- First commit
- 2025-12-09
- License
- Apache-2.0
- Issues
- 0 open
227
stars
- Forks
- 18
- Commits
- 323 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
sealandseacat/dbmask
Discover, mask, and verify sensitive data in SQL databases — an auditable scan → mask → validate workflow for safe database copies.
GitHub topics
- Updated
- 2026-10-11
- Lists
- 2 list mentions
- First commit
- 2026-06-09
- License
- MIT
- Issues
- 3 open
149
stars
- Forks
- 22
- Commits
- 68 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
nnnkkk7/snowflake-emulator
A lightweight Snowflake emulator built with Go and DuckDB for local development and testing
Stack
- Updated
- 2026-08-17
- Lists
- 2 list mentions
- First commit
- 2025-12-29
- License
- MIT
- Issues
- 10 open
- Forks
- 14
- Commits
- 43 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
MindweaveTech/sme-sim-sample
Free sample: 42-table synthetic business dataset with double-entry accounting. AdventureWorks alternative. CSV + SQL + Parquet + SQLite. AU tax compliance (ATO/GST).
GitHub topics
- Updated
- 2026-04-10
- Lists
- 1 list mention
- First commit
- 2026-04-02
- License
- Unknown
- Issues
- 0 open
- Forks
- 0
- Commits
- 5 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%