Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Data Engineering
A curated list of data engineering tools for software developers
igorbarinov/awesome-data-engineering
#awesome
#awesome-list
- List stars
- 9,173
- README repos
- 148
- Indexed repos
- 142
- List commits
- 438
- Forks
- 1,651
- Open issues
- 49
Tracked list growth
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 7 list mentions
- First commit
- 2015-07-02
- License
- Apache-2.0
- Issues
- 586 open
75,176
stars
- Forks
- 18,481
- Commits
- 23,792 commits
- Star growth, last 7 days
- +74 +0.1%
- Commit velocity, last 7 days
- +153 +0.6%
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 7 list mentions
- First commit
- 2014-10-06
- License
- Apache-2.0
- Issues
- 1,932 open
47,194
stars
- Forks
- 18,051
- Commits
- 42,128 commits
- Star growth, last 7 days
- +49 +0.1%
- Commit velocity, last 7 days
- +168 +0.4%
plotly/dash
Data Apps & Dashboards for Python. No JavaScript Required.
AI dev
GitHub topics
- Updated
- 2026-10-15
- Lists
- 4 list mentions
- First commit
- 2015-04-10
- License
- MIT
- Issues
- 433 open
24,456
stars
- Forks
- 2,329
- Commits
- 10,295 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
AI dev
- Updated
- 2026-10-12
- Lists
- 5 list mentions
- First commit
- 2018-04-30
- License
- Apache-2.0
- Issues
- 2,590 open
16,282
stars
- Forks
- 2,354
- Commits
- 28,117 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
OpenDCAI/DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
GitHub topics
- Updated
- 2026-10-13
- Lists
- 3 list mentions
- First commit
- 2024-10-13
- License
- Apache-2.0
- Issues
- 24 open
8,209
stars
- Forks
- 1,196
- Commits
- 1,209 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
aws/aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
- Updated
- 2026-10-15
- Lists
- 2 list mentions
- First commit
- 2019-02-26
- License
- Apache-2.0
- Issues
- 46 open
4,122
stars
- Forks
- 751
- Commits
- 2,842 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
GitHub topics
- Updated
- 2026-10-14
- Lists
- 3 list mentions
- First commit
- 2019-07-25
- License
- Apache-2.0
- Issues
- 178 open
2,610
stars
- Forks
- 221
- Commits
- 2,116 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
capitalone/DataProfiler
What's in your data? Extract schema, statistics and entities from datasets
GitHub topics
- Updated
- 2026-09-14
- Lists
- 1 list mention
- First commit
- 2020-11-09
- License
- Apache-2.0
- Issues
- 83 open
1,595
stars
- Forks
- 194
- Commits
- 619 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
capitalone/datacompy
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
AI dev
GitHub topics
- Updated
- 2026-10-13
- Lists
- 3 list mentions
- First commit
- 2018-03-27
- License
- Apache-2.0
- Issues
- 9 open
661
stars
- Forks
- 175
- Commits
- 363 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
Desbordante/desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
- Updated
- 2026-10-14
- Lists
- 2 list mentions
- First commit
- 2019-07-08
- License
- AGPL-3.0
- Issues
- 90 open
- Forks
- 108
- Commits
- 2,169 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
grai-io/grai-core
No description.
GitHub topics
- Updated
- 2026-01-30
- Lists
- 2 list mentions
- First commit
- 2022-06-09
- License
- MIT-0
- Issues
- 51 open
317
stars
- Forks
- 20
- Commits
- 1,085 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%