Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
gchq/Gaffer
A large-scale entity and relation database supporting aggregation of properties
Archived
Stack
GitHub topics
- Updated
- 2025-06-06
- Lists
- 2 list mentions
- First commit
- 2015-12-14
- License
- Apache-2.0
- Issues
- 138 open
1,787
stars
- Forks
- 363
- Commits
- 7,332 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
SouravRoy-ETL/slothdb
An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.
GitHub topics
- Updated
- 2026-06-03
- Lists
- 1 list mention
- First commit
- 2026-04-15
- License
- MIT
- Issues
- 5 open
412
stars
- Forks
- 6
- Commits
- 573 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
grai-io/grai-core
No description.
GitHub topics
- Updated
- 2026-01-30
- Lists
- 2 list mentions
- First commit
- 2022-06-09
- License
- MIT-0
- Issues
- 51 open
317
stars
- Forks
- 20
- Commits
- 1,085 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
faucet-hq/faucet-stream
The fast, config-driven way to move data in Rust — a native CLI and an embeddable Rust ETL library
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2026-03-23
- License
- NOASSERTION
- Issues
- 39 open
- Forks
- 8
- Commits
- 509 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
godalida/koala-diff
Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.
GitHub topics
- Updated
- 2026-02-25
- Lists
- 1 list mention
- First commit
- 2026-02-13
- License
- MIT
- Issues
- 0 open
- Forks
- 0
- Commits
- 33 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dataspoclab/dataspoc-pipe
Data ingestion engine — Singer taps to Parquet in cloud buckets
AI dev
GitHub topics
- Updated
- 2026-04-28
- Lists
- 1 list mention
- First commit
- 2026-03-24
- License
- Apache-2.0
- Issues
- 0 open
- Forks
- 0
- Commits
- 5 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
MindweaveTech/sme-sim-sample
Free sample: 42-table synthetic business dataset with double-entry accounting. AdventureWorks alternative. CSV + SQL + Parquet + SQLite. AU tax compliance (ATO/GST).
GitHub topics
- Updated
- 2026-04-10
- Lists
- 1 list mention
- First commit
- 2026-04-02
- License
- Unknown
- Issues
- 0 open
- Forks
- 0
- Commits
- 5 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%