Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 21,464
Awesome lists tracked: 149
Current results: 14

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Unsure which signals matter? Read the repository shortlisting guide.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

14 repos shown

Topic: data-pipeline

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

AI dev

Stack

Python Micronaut pytest React Gradle pip pnpm

GitHub topics

#bigquery #change-data-capture #data #data-analysis #data-collection #data-engineering

Updated: 2026-10-17
Lists: 2 list mentions
First commit: 2020-07-28
History: 173 history points
License: NOASSERTION
Issues: 2,606 open

22,234

stars

Forks: 5,409
Commits: 54,602 commits
Star growth, last 7 days: +32 +0.1%
Commit velocity, last 7 days: +534 +1.0%

Website GitHub

rocketride-org/rocketride-server

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.

AI dev

Stack

Python FastAPI LangChain pytest React CMake npm PEP 517

GitHub topics

#ai #cpp #data-pipeline #data-processing #machine-learning #mcp

Updated: 2026-09-09
Lists: 2 list mentions
First commit: 2026-02-20
History: 1 history point
License: MIT
Issues: 355 open

8,437

stars

Forks: 2,737
Commits: 923 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

datajuicer/data-juicer

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Stack

Python FastAPI pytest Streamlit uv

GitHub topics

#data #data-analysis #data-pipeline #data-processing #data-science #data-visualization

Updated: 2026-09-09
Lists: 2 list mentions
First commit: 2023-08-01
History: 7 history points
License: Apache-2.0
Issues: 59 open

7,036

stars

Forks: 425
Commits: 628 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

snowplow/snowplow

The leader in Customer Data Infrastructure

Stack

Scala

GitHub topics

#analytics #data #data-collection #data-pipeline #marketing-analytics #product-analytics

Updated: 2026-06-26
Lists: 1 list mention
First commit: 2012-03-01
History: 7 history points
License: Apache-2.0
Issues: 59 open

7,032

stars

Forks: 1,172
Commits: 6,950 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

clidey/whodb

Where data access meets operational intelligence

AI dev

Stack

Go Cobra gRPC Go React Tailwind CSS Cargo Go modules Maven

GitHub topics

#ai-agent #data-catalog #data-governance #data-integration #data-lineage #data-pipeline

Updated: 2026-10-16
Lists: 3 list mentions
First commit: 2024-06-11
History: 50 history points
License: Apache-2.0
Issues: 20 open

5,035

stars

Forks: 243
Commits: 4,283 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-10-16
Lists: 4 list mentions
First commit: 2019-07-19
History: 10 history points
License: NOASSERTION
Issues: 50 open

4,500

stars

Forks: 80
Commits: 6,733 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

dagucloud/dagu

Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.

AI dev

Stack

Go Cobra gRPC Go React Tailwind CSS Go modules npm pnpm

GitHub topics

#agentic-workflows #ai-agents #ai-workflows #airflow-alternative #cron #dag

Updated: 2026-10-17
Lists: 2 list mentions
First commit: 2022-04-22
History: 139 history points
License: GPL-3.0
Issues: 110 open

4,374

stars

Forks: 377
Commits: 3,362 commits
Star growth, last 7 days: +54 +1.2%
Commit velocity, last 7 days: +75 +2.3%

Website GitHub

bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev

Stack

Go Cobra gRPC Go Vite Vue Go modules npm PEP 517

GitHub topics

#bigquery #copy-database #data-ingestion #data-integration #data-pipeline #duckdb

Updated: 2026-10-16
Lists: 3 list mentions
First commit: 2024-02-12
History: 45 history points
License: NOASSERTION
Issues: 28 open

4,013

stars

Forks: 163
Commits: 3,719 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

superlinked/sie

Open-source inference server and production cluster for all the models your agent needs.

AI dev

Stack

Python Axum Express FastAPI Flask Bun Cargo npm

GitHub topics

#bge #colbert #data-pipeline #deep-learning #embeddings #inference

Updated: 2026-09-10
Lists: 1 list mention
First commit: 2026-04-01
History: 1 history point
License: Apache-2.0
Issues: 16 open

3,258

stars

Forks: 307
Commits: 155 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

pydoit/doit

CLI task management & automation tool

Stack

Python PEP 517 pip uv

GitHub topics

#build-automation #build-system #build-tool #cli #data-pipeline #data-science

Updated: 2026-09-21
Lists: 2 list mentions
First commit: 2008-02-24
History: 11 history points
License: MIT
Issues: 101 open

2,094

stars

Forks: 200
Commits: 1,527 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Multiwoven/multiwoven

🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.

Stack

Ruby React Ruby on Rails Vite Bundler npm

GitHub topics

#bigquery #cdp #customer-data-platform #data-activation #data-engineering #data-pipeline

Updated: 2026-10-15
Lists: 3 list mentions
First commit: 2023-10-20
History: 8 history points
License: AGPL-3.0
Issues: 199 open

1,680

stars

Forks: 96
Commits: 1,888 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

slothflowlabs/duckle

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

Stack

Rust Axum React Tauri Vite Cargo npm PEP 517

GitHub topics

#cdc #connectors #data-engineering #data-integration #data-orchestration #data-pipeline

Updated: 2026-10-14
Lists: 3 list mentions
First commit: 2026-05-21
History: 4 history points
License: Apache-2.0
Issues: 73 open

1,508

stars

Forks: 120
Commits: 1,751 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

drt-hub/drt

Reverse ETL for the code-first data stack

AI dev

Stack

Python pytest npm PEP 517

GitHub topics

#bigquery #cli #clickhouse #dagster #data-activation #data-engineering

Updated: 2026-10-16
Lists: 1 list mention
First commit: 2026-03-27
History: 1 history point
License: Apache-2.0
Issues: 53 open

stars

Forks: 39
Commits: 832 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

faucet-hq/faucet-stream

The fast, config-driven way to move data in Rust — a native CLI and an embeddable Rust ETL library

AI dev

Stack

Rust Axum Cargo

GitHub topics

#cdc #cli #connectors #data-engineering #data-integration #data-pipeline

Updated: 2026-10-16
Lists: 2 list mentions
First commit: 2026-03-23
History: 1 history point
License: NOASSERTION
Issues: 39 open

stars

Forks: 8
Commits: 509 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing