Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 21,464
Awesome lists tracked: 149
Current results: 142

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Unsure which signals matter? Read the repository shortlisting guide.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

142 repos shown

List: awesome-data-engineering

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

edenhill/kcat

Generic command line non-JVM Apache Kafka producer and consumer

Stack

C .NET SDK

Updated: 2024-07-09
Lists: 1 list mention
First commit: 2014-03-30
History: 1 history point
License: NOASSERTION
Issues: 161 open

5,788

stars

Forks: 498
Commits: 391 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

treeverse/lakeFS

lakeFS - Data version control for your data lake | Git for data

Stack

Go Android Cobra Gin gRPC Go Bundler Cargo Go modules

GitHub topics

#apache-spark #apache-sparksql #aws-s3 #azure-blob-storage #azure-storage #data-engineering

Updated: 2026-10-07
Lists: 2 list mentions
First commit: 2019-09-12
History: 8 history points
License: NOASSERTION
Issues: 450 open

5,557

stars

Forks: 485
Commits: 6,569 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

jitsucom/jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

AI dev

Stack

TypeScript Cobra Express Gin gRPC Go Go modules npm pnpm

GitHub topics

#bigquery #clickhouse #data-collection #data-connectors #data-integration #golang

Updated: 2026-10-16
Lists: 3 list mentions
First commit: 2022-06-22
History: 9 history points
License: MIT
Issues: 44 open

5,107

stars

Forks: 402
Commits: 3,939 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

OpenTSDB/opentsdb

A scalable, distributed Time Series Database.

Stack

Java

Updated: 2024-12-12
Lists: 2 list mentions
First commit: 2010-04-11
History: 9 history points
License: LGPL-2.1
Issues: 541 open

5,065

stars

Forks: 1,230
Commits: 1,712 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

zombodb/zombodb

Making Postgres and Elasticsearch work together like it's 2023

Archived

Stack

PLpgSQL Cargo

GitHub topics

#elasticsearch #postgres #postgresql #sql #text-search

Updated: 2025-03-01
Lists: 2 list mentions
First commit: 2015-07-17
History: 1 history point
License: NOASSERTION
Issues: 17 open

4,719

stars

Forks: 212
Commits: 1,653 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-10-16
Lists: 4 list mentions
First commit: 2019-07-19
History: 10 history points
License: NOASSERTION
Issues: 50 open

4,500

stars

Forks: 80
Commits: 6,733 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

aws/aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Stack

Python pytest PEP 517 pip uv

GitHub topics

#amazon-athena #amazon-sagemaker-notebook #apache-arrow #apache-parquet #athena #aws

Updated: 2026-10-15
Lists: 2 list mentions
First commit: 2019-02-26
History: 11 history points
License: Apache-2.0
Issues: 46 open

4,122

stars

Forks: 751
Commits: 2,842 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev

Stack

Go Cobra gRPC Go Vite Vue Go modules npm PEP 517

GitHub topics

#bigquery #copy-database #data-ingestion #data-integration #data-pipeline #duckdb

Updated: 2026-10-16
Lists: 3 list mentions
First commit: 2024-02-12
History: 45 history points
License: NOASSERTION
Issues: 28 open

4,013

stars

Forks: 163
Commits: 3,719 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

tarantool/tarantool

Get your data in RAM. Get compute close to data. Enjoy the performance.

AI dev

Stack

Lua CMake pip

GitHub topics

#appserver #database #disk #in-memory #lua #msgpack

Updated: 2026-10-16
Lists: 2 list mentions
First commit: 2010-08-12
History: 8 history points
License: NOASSERTION
Issues: 1,776 open

3,671

stars

Forks: 426
Commits: 20,214 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

piskvorky/smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

Stack

Python pytest PEP 517 pip

GitHub topics

#boto #bz2 #file #gzip-stream #hacktoberfest #hdfs

Updated: 2026-10-12
Lists: 1 list mention
First commit: 2015-01-02
History: 1 history point
License: MIT
Issues: 14 open

3,464

stars

Forks: 395
Commits: 1,246 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

mozilla-services/heka

DEPRECATED: Data collection and processing made easy.

Archived

Stack

Go CMake

Updated: 2024-01-23
Lists: 2 list mentions
First commit: 2012-10-10
History: 8 history points
License: NOASSERTION
Issues: 232 open

3,387

stars

Forks: 514
Commits: 4,118 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

ClusterHQ/flocker

Container data volume manager for your Dockerized application

Stack

Python pip

Updated: 2017-05-18
Lists: 1 list mention
First commit: 2014-04-28
History: 1 history point
License: Apache-2.0
Issues: 80 open

3,383

stars

Forks: 279
Commits: 19,142 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

twitter-archive/flockdb

A distributed, fault-tolerant graph database

Archived

Stack

Scala

Updated: 2017-03-16
Lists: 1 list mention
First commit: 2010-04-12
History: 1 history point
License: NOASSERTION
Issues: Disabled

3,313

stars

Forks: 244
Commits: 740 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

apache/gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

AI dev

Stack

Java pytest Starlette Cargo Gradle PEP 517

GitHub topics

#ai-catalog #data-catalog #datalake #federated-query #lakehouse #metadata

Updated: 2026-10-16
Lists: 1 list mention
First commit: 2023-04-23
History: 1 history point
License: Apache-2.0
Issues: 1,099 open

3,249

stars

Forks: 957
Commits: 4,671 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

jprante/elasticsearch-jdbc

JDBC importer for Elasticsearch *** THIS REPOSITORY WILL BE DELETED WITHOUT ANY FURTHER NOTICE AFTER AUG 1 2026 ***

Archived

Stack

Java Gradle

Updated: 2026-06-03
Lists: 1 list mention
First commit: 2012-06-02
History: 1 history point
License: Apache-2.0
Issues: 1 open

2,805

stars

Forks: 693
Commits: 453 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

pipelinedb/pipelinedb

High-performance time-series aggregation for PostgreSQL

Stack

C pytest pip

GitHub topics

#aggregation #analytics #pipelinedb #postgresql #push #realtime

Updated: 2022-02-20
Lists: 1 list mention
First commit: 2015-07-07
History: 1 history point
License: Apache-2.0
Issues: 133 open

2,664

stars

Forks: 243
Commits: 1,023 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

SOHU-Co/kafka-node

Node.js client for Apache Kafka 0.8 and later.

Stack

JavaScript npm

Updated: 2023-08-30
Lists: 1 list mention
First commit: 2013-08-23
History: 1 history point
License: MIT
Issues: 444 open

2,647

stars

Forks: 609
Commits: 827 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

apache/hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Stack

Jupyter Notebook Django FastAPI Jupyter LangChain npm PEP 517 pip

GitHub topics

#dag #data-analysis #data-engineering #data-science #dataframe #etl

Updated: 2026-10-14
Lists: 3 list mentions
First commit: 2019-07-25
History: 10 history points
License: Apache-2.0
Issues: 178 open

2,610

stars

Forks: 221
Commits: 2,116 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

apache/gobblin

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

Stack

Java Gradle pip

GitHub topics

#apache #data #ingestion #management #replication

Updated: 2026-10-15
Lists: 2 list mentions
First commit: 2014-02-04
History: 147 history points
License: Apache-2.0
Issues: Disabled

2,270

stars

Forks: 749
Commits: 6,560 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: +1 0.0%

Website GitHub

stitchfix/pyxley

Python helpers for building dashboards using Flask and React

Archived

Stack

JavaScript Flask React npm pip

Updated: 2026-08-06
Lists: 1 list mention
First commit: 2015-06-22
History: 1 history point
License: MIT
Issues: 0 open

2,262

stars

Forks: 256
Commits: 156 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

faust-streaming/faust

Python Stream Processing. A Faust fork

Stack

Python FastAPI pytest PEP 517 pip

GitHub topics

#asyncio #distributed-systems #kafka #python-streaming #redis

Updated: 2026-10-14
Lists: 1 list mention
First commit: 2017-03-08
History: 1 history point
License: NOASSERTION
Issues: 146 open

1,889

stars

Forks: 205
Commits: 4,707 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

pinterest/secor

Secor is a service implementing Kafka log persistence

Archived AI dev

Stack

Java Maven

GitHub topics

#kafka

Updated: 2026-10-04
Lists: 2 list mentions
First commit: 2014-04-15
History: 8 history points
License: Apache-2.0
Issues: 284 open

1,858

stars

Forks: 536
Commits: 3,340 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

gchq/Gaffer

A large-scale entity and relation database supporting aggregation of properties

Archived

Stack

Java Spring Boot Maven

GitHub topics

#accumulo #aggregation #big-data #graph #graph-database #hadoop

Updated: 2025-06-06
Lists: 2 list mentions
First commit: 2015-12-14
History: 9 history points
License: Apache-2.0
Issues: 138 open

1,787

stars

Forks: 363
Commits: 7,332 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

AI dev

Stack

Go Cobra Flask gRPC Go Vite Go modules npm PEP 517

GitHub topics

#analytics #bigquery #data-analysis #data-ingestion #data-modeling #data-pipelines

Updated: 2026-10-15
Lists: 3 list mentions
First commit: 2023-07-25
History: 45 history points
License: Apache-2.0
Issues: 66 open

1,779

stars

Forks: 98
Commits: 8,629 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

kairosdb/kairosdb

Fast scalable time series database

Stack

Java Maven

GitHub topics

#java #kairosdb #metrics #timeseries #timeseries-database

Updated: 2026-03-05
Lists: 3 list mentions
First commit: 2013-02-05
History: 10 history points
License: Apache-2.0
Issues: 141 open

1,760

stars

Forks: 341
Commits: 1,479 commits
Star growth, last 7 days: -1 -0.1%
Commit velocity, last 7 days: 0 0.0%

GitHub

lf-edge/ekuiper

Lightweight data stream processing engine for IoT edge

Stack

Go Cobra gRPC Go Go modules pip

GitHub topics

#edge #edge-analytics #edge-computing #edge-streaming #hacktoberfest #iot

Updated: 2026-10-16
Lists: 2 list mentions
First commit: 2019-07-03
History: 1 history point
License: Apache-2.0
Issues: 47 open

1,739

stars

Forks: 464
Commits: 3,719 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

aklivity/zilla

🦎 A lightweight, multi-protocol gateway for event-driven applications and AI agents. Expose and govern Kafka, MQTT, APIs, and MCP through one high-performance engine with shared routing, security, schema, and observability.

AI dev

Stack

Java Maven

GitHub topics

#api-gateway #asyncapi #event-driven-architecture #event-stream-proxy #event-streaming #grpc

Updated: 2026-10-16
Lists: 2 list mentions
First commit: 2021-12-07
History: 9 history points
License: NOASSERTION
Issues: 241 open

1,710

stars

Forks: 147
Commits: 4,224 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: +7 +0.2%

Website GitHub

dropbox/PyHive

Python interface to Hive and Presto. 🐝

Stack

Python pytest pip

GitHub topics

#dbapi #hive #hiveserver2 #presto #python #sqlalchemy

Updated: 2026-04-13
Lists: 1 list mention
First commit: 2014-01-30
History: 1 history point
License: NOASSERTION
Issues: 222 open

1,694

stars

Forks: 544
Commits: 189 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

Multiwoven/multiwoven

🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.

Stack

Ruby React Ruby on Rails Vite Bundler npm

GitHub topics

#bigquery #cdp #customer-data-platform #data-activation #data-engineering #data-pipeline

Updated: 2026-10-15
Lists: 3 list mentions
First commit: 2023-10-20
History: 8 history points
License: AGPL-3.0
Issues: 199 open

1,680

stars

Forks: 96
Commits: 1,888 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

capitalone/DataProfiler

What's in your data? Extract schema, statistics and entities from datasets

Stack

Python pytest Tornado pip

GitHub topics

#avro #csv #data-analysis #data-labels #data-science #dataprofiling

Updated: 2026-09-14
Lists: 1 list mention
First commit: 2020-11-09
History: 1 history point
License: Apache-2.0
Issues: 83 open

1,595

stars

Forks: 194
Commits: 619 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing