Sign in
← All awesome lists Search these repos

Awesome List

Awesome Data Engineering

A curated list of data engineering tools for software developers

igorbarinov/awesome-data-engineering #awesome #awesome-list
Open GitHub
List stars
9,173
README repos
148
Indexed repos
142
List commits
438
Forks
1,651
Open issues
49

Tracked list growth

GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.

Latest scan 2026-10-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

2 repos matching these filters.

Framework: tornado
Latest repo push 2026-10-17

Filter this list

Search within Awesome Data Engineering or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

spotify/luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Stack
Python pytest Tornado PEP 517 uv
GitHub topics
#hadoop #luigi #orchestration-framework #python #scheduling
Updated
2026-10-14
Lists
4 list mentions
First commit
2011-11-17
License
Apache-2.0
Issues
185 open
Sign in to like spotify/luigi
18,782
stars
Forks
2,471
Commits
4,323 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
GitHub