Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 21,464
Awesome lists tracked: 149
Current results: 68

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Unsure which signals matter? Read the repository shortlisting guide.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

68 repos shown

Topic: data-engineering

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

apache/superset

Apache Superset is a Data Visualization and Data Exploration Platform

AI dev

Stack

Python Celery Express Flask pytest npm PEP 517 pip

GitHub topics

#analytics #apache #apache-superset #asf #bi #business-analytics

Updated: 2026-10-17
Lists: 7 list mentions
First commit: 2015-07-02
History: 152 history points
License: Apache-2.0
Issues: 586 open

75,176

stars

Forks: 18,481
Commits: 23,792 commits
Star growth, last 7 days: +74 +0.1%
Commit velocity, last 7 days: +153 +0.6%

Website GitHub

GokuMohandas/Made-With-ML

Learn how to develop, deploy and iterate on production-grade ML applications.

Stack

Jupyter Notebook FastAPI pytest PEP 517 pip

GitHub topics

#data-engineering #data-quality #data-science #deep-learning #distributed-ml #distributed-training

Updated: 2026-03-04
Lists: 1 list mention
First commit: 2023-07-26
History: 7 history points
License: MIT
Issues: 25 open

49,398

stars

Forks: 7,753
Commits: 19 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-10-17
Lists: 7 list mentions
First commit: 2014-10-06
History: 154 history points
License: Apache-2.0
Issues: 1,932 open

47,194

stars

Forks: 18,051
Commits: 42,128 commits
Star growth, last 7 days: +49 +0.1%
Commit velocity, last 7 days: +168 +0.4%

Website GitHub

kestra-io/kestra

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

AI dev

Stack

Java Micronaut React Vite Vue Gradle npm

GitHub topics

#ai-agents #automation #control-plane #data-engineering #data-orchestration #data-orchestrator

Updated: 2026-10-16
Lists: 4 list mentions
First commit: 2019-08-13
History: 10 history points
License: Apache-2.0
Issues: 888 open

29,650

stars

Forks: 3,405
Commits: 13,021 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

PrefectHQ/prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

AI dev

Stack

Python FastAPI pytest React Starlette npm PEP 517 pip

GitHub topics

#automation #data #data-engineering #data-ops #data-science #infrastructure

Updated: 2026-10-16
Lists: 3 list mentions
First commit: 2021-07-12
History: 136 history points
License: Apache-2.0
Issues: 902 open

24,026

stars

Forks: 2,590
Commits: 22,190 commits
Star growth, last 7 days: +25 +0.1%
Commit velocity, last 7 days: +17 +0.1%

Website GitHub

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

AI dev

Stack

Python Micronaut pytest React Gradle pip pnpm

GitHub topics

#bigquery #change-data-capture #data #data-analysis #data-collection #data-engineering

Updated: 2026-10-17
Lists: 2 list mentions
First commit: 2020-07-28
History: 173 history points
License: NOASSERTION
Issues: 2,606 open

22,234

stars

Forks: 5,409
Commits: 54,602 commits
Star growth, last 7 days: +32 +0.1%
Commit velocity, last 7 days: +534 +1.0%

Website GitHub

argoproj/argo-workflows

Workflow Engine for Kubernetes

AI dev

Stack

Go Cobra Echo gRPC Go React Go modules Maven npm

GitHub topics

#airflow #argo #argo-workflows #batch-processing #cloud-native #cncf

Updated: 2026-09-19
Lists: 2 list mentions
First commit: 2017-10-17
History: 8 history points
License: Apache-2.0
Issues: 1,292 open

16,988

stars

Forks: 3,662
Commits: 6,813 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev

Stack

Python FastAPI Flask LangChain Next.js npm PEP 517 pip

GitHub topics

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines

Updated: 2026-10-12
Lists: 5 list mentions
First commit: 2018-04-30
History: 13 history points
License: Apache-2.0
Issues: 2,590 open

16,282

stars

Forks: 2,354
Commits: 28,117 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

andkret/Cookbook

The Data Engineering Cookbook

Stack

Python

GitHub topics

#best-practices #big-data #cookbook #data-engineer #data-engineering

Updated: 2026-10-16
Lists: 0 list mentions
First commit: 2019-03-10
History: 136 history points
License: Apache-2.0
Issues: 130 open

15,492

stars

Forks: 2,764
Commits: 408 commits
Star growth, last 7 days: +21 +0.1%
Commit velocity, last 7 days: +1 +0.2%

Website GitHub

semantica-agi/semantica

Graph-Native Infrastructure for Context and Accountable AI Systems

AI dev

Stack

Python Celery FastAPI Jupyter pytest npm pip uv

GitHub topics

#agent-memory #ai #ai-governance #ai-infrastructure #artificial-intelligence #context-engineering

Updated: 2026-10-16
Lists: 3 list mentions
First commit: 2025-06-25
History: 137 history points
License: MIT
Issues: 118 open

14,079

stars

Forks: 1,651
Commits: 3,158 commits
Star growth, last 7 days: +165 +1.2%
Commit velocity, last 7 days: +26 +0.8%

Website GitHub

fivetran/great_expectations

Always know what to expect from your data.

AI dev

Stack

Python pytest React npm PEP 517 pip

GitHub topics

#cleandata #data-engineering #data-profilers #data-profiling #data-quality #data-science

Updated: 2026-10-16
Lists: 1 list mention
First commit: 2017-06-06
History: 89 history points
License: Apache-2.0
Issues: 51 open

11,876

stars

Forks: 1,876
Commits: 13,869 commits
Star growth, last 7 days: +9 +0.1%
Commit velocity, last 7 days: +2 0.0%

Website GitHub

cocoindex-io/cocoindex

Incremental engine for long horizon agents 🌟 Star if you like it!

AI dev

Stack

Rust Astro Axum FastAPI pytest Cargo npm PEP 517

GitHub topics

#agentic-data-framework #ai #ai-agents #change-data-capture #codebase-intelligence #context-engineering

Updated: 2026-10-16
Lists: 3 list mentions
First commit: 2025-03-03
History: 2 history points
License: Apache-2.0
Issues: 103 open

11,710

stars

Forks: 919
Commits: 2,168 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

great-expectations/great_expectations

Always know what to expect from your data.

AI dev

Stack

Python pytest React npm PEP 517 pip

GitHub topics

#cleandata #data-engineering #data-profilers #data-profiling #data-quality #data-science

Updated: 2026-06-13
Lists: 2 list mentions
First commit: 2017-06-06
History: 5 history points
License: Apache-2.0
Issues: 50 open

11,556

stars

Forks: 1,760
Commits: 13,657 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

xonsh/xonsh

🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.

AI dev

Stack

Python pytest Tornado pip uv

GitHub topics

#anthropic #claude #claude-code #cmux #data-engineering #data-scientists

Updated: 2026-10-13
Lists: 3 list mentions
First commit: 2015-01-21
History: 9 history points
License: NOASSERTION
Issues: 81 open

9,667

stars

Forks: 749
Commits: 11,982 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack

Python LangChain Next.js pytest React npm PEP 517 pip

GitHub topics

#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science

Updated: 2026-09-10
Lists: 1 list mention
First commit: 2022-05-16
History: 7 history points
License: Apache-2.0
Issues: 624 open

8,821

stars

Forks: 990
Commits: 5,790 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

redpanda-data/connect

Fancy stream processing made operationally mundane

AI dev

Stack

Go Cobra Gin gRPC Go Starlette Go modules PEP 517 pip

GitHub topics

#amqp #cqrs #data-engineering #data-ops #etl #event-sourcing

Updated: 2026-10-08
Lists: 1 list mention
First commit: 2015-08-25
History: 5 history points
License: Unknown
Issues: 355 open

8,779

stars

Forks: 975
Commits: 7,711 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

growthbook/growthbook

Open Source Feature Flags, Experimentation, and Product Analytics

AI dev

Stack

TypeScript Express Jupyter Next.js pytest npm pip pnpm

GitHub topics

#ab-testing #abtest #abtesting #analytics #bigquery #clickhouse

Updated: 2026-10-05
Lists: 1 list mention
First commit: 2021-05-07
History: 5 history points
License: NOASSERTION
Issues: 828 open

8,474

stars

Forks: 868
Commits: 4,644 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

feast-dev/feast

The Open Source Feature Store for AI/ML

AI dev

Stack

Python Astro Cobra FastAPI gRPC Go Go modules Maven npm

GitHub topics

#big-data #data-engineering #data-quality #data-science #feature-store #features

Updated: 2026-10-16
Lists: 2 list mentions
First commit: 2018-12-10
History: 148 history points
License: Apache-2.0
Issues: 480 open

7,335

stars

Forks: 1,473
Commits: 4,847 commits
Star growth, last 7 days: +12 +0.2%
Commit velocity, last 7 days: +13 +0.3%

Website GitHub

Zipstack/unstract

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

AI dev

Stack

Python Celery Django Django REST Framework Flask Bun npm PEP 517

GitHub topics

#ai-agents #data-engineering #document-ai #generative-ai #idp #json-extraction

Updated: 2026-09-11
Lists: 1 list mention
First commit: 2024-02-21
History: 1 history point
License: AGPL-3.0
Issues: 95 open

7,234

stars

Forks: 715
Commits: 1,722 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

evidence-dev/evidence

Business intelligence as code: build fast, interactive data visualizations in SQL and markdown

AI dev

Stack

TypeScript Express Next.js React Svelte npm pnpm

GitHub topics

#analytics #business-intelligence #dashboard #data-engineering #data-science #data-visualization

Updated: 2026-10-02
Lists: 2 list mentions
First commit: 2021-05-27
History: 8 history points
License: MIT
Issues: 17 open

6,978

stars

Forks: 424
Commits: 10,025 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

AI dev

Stack

Go Cobra gRPC Go pytest Go modules Gradle npm

GitHub topics

#airbyte #attack-surface-management #aws #azure #bigquery #cspm

Updated: 2026-10-02
Lists: 2 list mentions
First commit: 2020-11-18
History: 5 history points
License: MPL-2.0
Issues: 180 open

6,535

stars

Forks: 563
Commits: 22,660 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

dlt-hub/dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

AI dev

Stack

Python pytest React Streamlit npm PEP 517 pip

GitHub topics

#data #data-engineering #data-lake #data-loading #data-warehouse #elt

Updated: 2026-10-16
Lists: 1 list mention
First commit: 2022-05-16
History: 176 history points
License: Apache-2.0
Issues: 454 open

5,979

stars

Forks: 626
Commits: 4,514 commits
Star growth, last 7 days: +28 +0.5%
Commit velocity, last 7 days: +15 +0.3%

Website GitHub

Eventual-Inc/Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

AI dev

Stack

Rust Axum pytest Cargo CMake PEP 517

GitHub topics

#ai-engineering #ai-pipeline #arrow #artificial-intelligence #big-data #data-engineering

Updated: 2026-09-12
Lists: 0 list mentions
First commit: 2022-05-10
History: 42 history points
License: Apache-2.0
Issues: 394 open

5,756

stars

Forks: 555
Commits: 4,555 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

treeverse/lakeFS

lakeFS - Data version control for your data lake | Git for data

Stack

Go Android Cobra Gin gRPC Go Bundler Cargo Go modules

GitHub topics

#apache-spark #apache-sparksql #aws-s3 #azure-blob-storage #azure-storage #data-engineering

Updated: 2026-10-07
Lists: 2 list mentions
First commit: 2019-09-12
History: 8 history points
License: NOASSERTION
Issues: 450 open

5,557

stars

Forks: 485
Commits: 6,569 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

ruc-datalab/DeepAnalyze

DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！

Stack

Python FastAPI Gradio Jupyter Next.js npm PEP 517 pip

GitHub topics

#agent #agentic #agentic-ai #ai #ai-scientist #chatbot

Updated: 2026-10-13
Lists: 2 list mentions
First commit: 2025-10-11
History: 8 history points
License: MIT
Issues: 25 open

4,719

stars

Forks: 742
Commits: 309 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-10-16
Lists: 4 list mentions
First commit: 2019-07-19
History: 10 history points
License: NOASSERTION
Issues: 50 open

4,500

stars

Forks: 80
Commits: 6,733 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

aws/aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Stack

Python pytest PEP 517 pip uv

GitHub topics

#amazon-athena #amazon-sagemaker-notebook #apache-arrow #apache-parquet #athena #aws

Updated: 2026-10-15
Lists: 2 list mentions
First commit: 2019-02-26
History: 11 history points
License: Apache-2.0
Issues: 46 open

4,122

stars

Forks: 751
Commits: 2,842 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Netflix/maestro

Maestro: Netflix’s Workflow Orchestrator

Stack

Java Spring Boot Gradle

GitHub topics

#agentic-workflow #analytics #automation #batch-processing #dag #data-engineering

Updated: 2026-09-03
Lists: 1 list mention
First commit: 2024-04-17
History: 7 history points
License: Apache-2.0
Issues: 58 open

3,834

stars

Forks: 311
Commits: 173 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

ploomber/ploomber

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

Archived

Stack

Python PEP 517 pip

GitHub topics

#data-engineering #data-science #jupyter #jupyter-notebooks #machine-learning #mlops

Updated: 2025-05-29
Lists: 1 list mention
First commit: 2020-01-20
History: 5 history points
License: Apache-2.0
Issues: 110 open

3,619

stars

Forks: 244
Commits: 3,061 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

lakehq/sail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

AI dev

Stack

Rust Axum pytest Tailwind CSS Vite Cargo PEP 517 pnpm

GitHub topics

#apache-iceberg #apache-spark #arrow #artificial-intelligence #big-data #data-engineering

Updated: 2026-10-17
Lists: 1 list mention
First commit: 2023-12-21
History: 111 history points
License: Apache-2.0
Issues: 307 open

3,451

stars

Forks: 228
Commits: 1,742 commits
Star growth, last 7 days: +26 +0.8%
Commit velocity, last 7 days: +25 +1.5%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing