Sign in
← All awesome lists Search these repos

Awesome List

Awesome Data Engineering

A curated list of data engineering tools for software developers

igorbarinov/awesome-data-engineering #awesome #awesome-list
Open GitHub
List stars
9,173
README repos
148
Indexed repos
142
List commits
438
Forks
1,651
Open issues
49

Tracked list growth

GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.

Latest scan 2026-10-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

3 repos matching these filters.

Topic: dataframe
Latest repo push 2026-10-17

Filter this list

Search within Awesome Data Engineering or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

apache/hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Stack
Jupyter Notebook Django FastAPI Jupyter LangChain npm PEP 517 pip
GitHub topics
#dag #data-analysis #data-engineering #data-science #dataframe #etl
Updated
2026-10-14
Lists
3 list mentions
First commit
2019-07-25
License
Apache-2.0
Issues
178 open
Sign in to like apache/hamilton
2,610
stars
Forks
221
Commits
2,116 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
SouravRoy-ETL/slothdb

An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.

Stack
C++ CMake npm PEP 517
GitHub topics
#analytics #arrow #avro #columnar-database #cplusplus #cpp
Updated
2026-06-03
Lists
1 list mention
First commit
2026-04-15
License
MIT
Issues
5 open
Sign in to like SouravRoy-ETL/slothdb
412
stars
Forks
6
Commits
573 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
vertti/daffy

Lightweight DataFrame validation decorators for Pandas, Polars, Modin, and PyArrow. No custom types required.

AI dev
Stack
Python pytest pip uv
GitHub topics
#data-quality #data-validation #dataframe #dataframe-schema #dataframe-validation #decorator
Updated
2026-10-15
Lists
1 list mention
First commit
2021-01-31
License
MIT
Issues
5 open
Sign in to like vertti/daffy
60
stars
Forks
5
Commits
1,121 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub