Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
pingcap/tidb
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
AI dev
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2015-09-06
- License
- Apache-2.0
- Issues
- 7,367 open
40,645
stars
- Forks
- 6,266
- Commits
- 28,736 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
rqlite/rqlite
The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.
AI dev
Stack
- Updated
- 2026-10-15
- Lists
- 4 list mentions
- First commit
- 2014-08-23
- License
- MIT
- Issues
- 65 open
17,794
stars
- Forks
- 818
- Commits
- 8,689 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
manticoresoftware/manticoresearch
Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2003-11-19
- License
- GPL-3.0
- Issues
- 652 open
12,057
stars
- Forks
- 647
- Commits
- 14,097 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
zombodb/zombodb
Making Postgres and Elasticsearch work together like it's 2023
Archived
GitHub topics
- Updated
- 2025-03-01
- Lists
- 2 list mentions
- First commit
- 2015-07-17
- License
- NOASSERTION
- Issues
- 17 open
4,719
stars
- Forks
- 212
- Commits
- 1,653 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
pipelinedb/pipelinedb
High-performance time-series aggregation for PostgreSQL
GitHub topics
- Updated
- 2022-02-20
- Lists
- 1 list mention
- First commit
- 2015-07-07
- License
- Apache-2.0
- Issues
- 133 open
2,664
stars
- Forks
- 243
- Commits
- 1,023 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
bruin-data/bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
AI dev
- Updated
- 2026-10-15
- Lists
- 3 list mentions
- First commit
- 2023-07-25
- License
- Apache-2.0
- Issues
- 66 open
1,779
stars
- Forks
- 98
- Commits
- 8,629 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
lf-edge/ekuiper
Lightweight data stream processing engine for IoT edge
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2019-07-03
- License
- Apache-2.0
- Issues
- 47 open
1,739
stars
- Forks
- 464
- Commits
- 3,719 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
hstreamdb/hstream
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Stack
- Updated
- 2024-12-26
- Lists
- 1 list mention
- First commit
- 2020-09-01
- License
- BSD-3-Clause
- Issues
- 11 open
723
stars
- Forks
- 55
- Commits
- 1,726 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dekart-xyz/dekart
Open-source backend for Kepler.gl. Self-hosted alternative to CARTO and Foursquare Studio.
AI dev
Stack
GitHub topics
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2020-12-11
- License
- AGPL-3.0
- Issues
- 35 open
434
stars
- Forks
- 62
- Commits
- 1,868 commits
- Star growth, last 7 days
- +2 +0.5%
- Commit velocity, last 7 days
- 0 0.0%
SouravRoy-ETL/slothdb
An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.
GitHub topics
- Updated
- 2026-06-03
- Lists
- 1 list mention
- First commit
- 2026-04-15
- License
- MIT
- Issues
- 5 open
412
stars
- Forks
- 6
- Commits
- 573 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
scriptella/scriptella-etl
Scriptella is an open source ETL (Extract-Transform-Load) and script execution tool written in Java.
GitHub topics
- Updated
- 2026-10-15
- Lists
- 1 list mention
- First commit
- 2006-04-17
- License
- Apache-2.0
- Issues
- 18 open
- Forks
- 50
- Commits
- 895 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
nnnkkk7/snowflake-emulator
A lightweight Snowflake emulator built with Go and DuckDB for local development and testing
Stack
- Updated
- 2026-08-17
- Lists
- 2 list mentions
- First commit
- 2025-12-29
- License
- MIT
- Issues
- 10 open
- Forks
- 14
- Commits
- 43 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
MoonMao42/ReceiptBI
Turn CSV, Excel, and read-only databases into verified, editable business reports.
- Updated
- 2026-10-16
- Lists
- 1 list mention
- First commit
- 2025-12-12
- License
- MIT
- Issues
- 0 open
39
stars
- Forks
- 0
- Commits
- 316 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
MindweaveTech/sme-sim-sample
Free sample: 42-table synthetic business dataset with double-entry accounting. AdventureWorks alternative. CSV + SQL + Parquet + SQLite. AU tax compliance (ATO/GST).
GitHub topics
- Updated
- 2026-04-10
- Lists
- 1 list mention
- First commit
- 2026-04-02
- License
- Unknown
- Issues
- 0 open
- Forks
- 0
- Commits
- 5 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%