Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 21,464
Awesome lists tracked: 149
Current results: 186

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Unsure which signals matter? Read the repository shortlisting guide.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

186 repos shown

List: awesome-bigdata

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

facebookarchive/scribe

Scribe is a server for aggregating log data streamed in real time from a large number of servers.

Archived

Stack

C++ pip

Updated: 2020-08-27
Lists: 1 list mention
First commit: 2008-10-23
History: 8 history points
License: Apache-2.0
Issues: Disabled

3,906

stars

Forks: 767
Commits: 118 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

polyaxon/polyaxon

AI Infra / AI Orchestration / AI Control Plane

Stack

MDX

GitHub topics

#agents #artificial-intelligence #data-science #deep-learning #harness #hyperparameter-optimization

Updated: 2026-10-13
Lists: 4 list mentions
First commit: 2016-03-25
History: 9 history points
License: Apache-2.0
Issues: 125 open

3,745

stars

Forks: 329
Commits: 10,463 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

tarantool/tarantool

Get your data in RAM. Get compute close to data. Enjoy the performance.

AI dev

Stack

Lua CMake pip

GitHub topics

#appserver #database #disk #in-memory #lua #msgpack

Updated: 2026-10-16
Lists: 2 list mentions
First commit: 2010-08-12
History: 8 history points
License: NOASSERTION
Issues: 1,776 open

3,671

stars

Forks: 426
Commits: 20,214 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

apache/incubator-heron

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

Archived

Stack

Java npm pip

GitHub topics

#heron #messaging #streaming

Updated: 2023-03-01
Lists: 1 list mention
First commit: 2015-12-19
History: 146 history points
License: Apache-2.0
Issues: 409 open

3,625

stars

Forks: 578
Commits: 3,308 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Netflix/atlas

In-memory dimensional time series database.

AI dev

Stack

Scala Vite npm

Updated: 2026-10-15
Lists: 2 list mentions
First commit: 2014-08-05
History: 8 history points
License: Apache-2.0
Issues: 9 open

3,571

stars

Forks: 359
Commits: 3,050 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

ml-tooling/ml-workspace

🛠 All-in-one web-based IDE specialized for machine learning and data science.

Stack

Jupyter Notebook FastAPI Flask .NET SDK pip

GitHub topics

#anaconda #data-analysis #data-science #data-visualization #deep-learning #docker

Updated: 2024-07-26
Lists: 3 list mentions
First commit: 2019-05-27
History: 8 history points
License: Apache-2.0
Issues: 0 open

3,546

stars

Forks: 456
Commits: 847 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

twitter/scalding

A Scala API for Cascading

Stack

Scala

Updated: 2023-05-28
Lists: 2 list mentions
First commit: 2012-01-10
History: 7 history points
License: Apache-2.0
Issues: 317 open

3,524

stars

Forks: 699
Commits: 4,195 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

Stack

Java Spring Boot Vite Vue Maven npm

GitHub topics

#application-manager #context-service #engine #hive #hive-table #impala

Updated: 2026-10-16
Lists: 1 list mention
First commit: 2019-07-23
History: 146 history points
License: Apache-2.0
Issues: 183 open

3,415

stars

Forks: 1,169
Commits: 4,342 commits
Star growth, last 7 days: +4 +0.1%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mozilla-services/heka

DEPRECATED: Data collection and processing made easy.

Archived

Stack

Go CMake

Updated: 2024-01-23
Lists: 2 list mentions
First commit: 2012-10-10
History: 8 history points
License: NOASSERTION
Issues: 232 open

3,387

stars

Forks: 514
Commits: 4,118 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

WeBankFinTech/DataSphereStudio

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Stack

Java Spring Boot Vite Vue Maven npm

GitHub topics

#airflow #atlas #azkaban #dataworks #davinci #dolphinscheduler

Updated: 2025-11-04
Lists: 1 list mention
First commit: 2019-11-24
History: 7 history points
License: Apache-2.0
Issues: 362 open

3,264

stars

Forks: 1,040
Commits: 12,523 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

facebookarchive/beringei

Beringei is a high performance, in-memory storage engine for time series data.

Archived

Stack

C++ CMake

Updated: 2018-07-11
Lists: 1 list mention
First commit: 2016-11-18
History: 147 history points
License: NOASSERTION
Issues: Disabled

3,150

stars

Forks: 286
Commits: 182 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

benedekrozemberczki/pytorch_geometric_temporal

PyTorch Geometric Temporal: Spatiotemporal Signal Processing with Neural Machine Learning Models (CIKM 2021)

Stack

Python pip

GitHub topics

#deep-learning #gcn #gnn #graph-convolution #graph-convolutional-networks #graph-embedding

Updated: 2026-05-30
Lists: 3 list mentions
First commit: 2020-06-27
History: 10 history points
License: MIT
Issues: 30 open

2,992

stars

Forks: 402
Commits: 2,062 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

chdb-io/chdb

chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse

AI dev

Stack

Python pytest PEP 517 pip

GitHub topics

#chdb #clickhouse #clickhouse-database #clickhouse-server #data-science #database

Updated: 2026-09-09
Lists: 2 list mentions
First commit: 2008-12-01
History: 6 history points
License: Apache-2.0
Issues: 41 open

2,890

stars

Forks: 130
Commits: 3,412 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

baidu/bfs

The Baidu File System.

Stack

C++

Updated: 2018-12-03
Lists: 1 list mention
First commit: 2014-11-13
History: 8 history points
License: BSD-3-Clause
Issues: 119 open

2,845

stars

Forks: 551
Commits: 2,139 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

numaproj/numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

Stack

Rust Axum Cobra Gin gRPC Go Cargo Go modules npm

GitHub topics

#data-processing #hacktoberfest #k8s #kubernetes #map-reduce #pipeline

Updated: 2026-10-16
Lists: 1 list mention
First commit: 2022-05-20
History: 8 history points
License: Apache-2.0
Issues: 295 open

2,835

stars

Forks: 185
Commits: 1,931 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

airbnb/airpal

Web UI for PrestoDB.

Archived

Stack

Java React Gradle npm

Updated: 2021-05-20
Lists: 1 list mention
First commit: 2014-05-07
History: 8 history points
License: Apache-2.0
Issues: 87 open

2,744

stars

Forks: 442
Commits: 448 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

samizdatco/arbor

a graph visualization library using web workers and jQuery

Stack

JavaScript

Updated: 2020-04-10
Lists: 2 list mentions
First commit: 2011-01-12
History: 8 history points
License: Unknown
Issues: 56 open

2,658

stars

Forks: 618
Commits: 12 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

FeatureBaseDB/featurebase

A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase

Archived

Stack

Go Cobra Echo Gin gRPC Go Go modules npm Yarn

GitHub topics

#big-data #bitmap #database #go #index #pilosa

Updated: 2024-02-21
Lists: 1 list mention
First commit: 2013-10-16
History: 145 history points
License: Apache-2.0
Issues: 7 open

2,523

stars

Forks: 240
Commits: 5,576 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

griddb/griddb

GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.

Stack

C++ CMake .NET SDK Maven

GitHub topics

#bigdata #database #fast #griddb #iot #newsql

Updated: 2026-03-19
Lists: 1 list mention
First commit: 2016-02-24
History: 147 history points
License: AGPL-3.0
Issues: 51 open

2,474

stars

Forks: 4,961
Commits: 500 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

influxdata/kapacitor

Open source framework for processing, monitoring, and alerting on time series data

AI dev

Stack

Go Cobra gRPC Go Go modules pip

GitHub topics

#kapacitor #monitoring #time-series

Updated: 2026-10-15
Lists: 2 list mentions
First commit: 2015-08-31
History: 9 history points
License: MIT
Issues: 834 open

2,376

stars

Forks: 479
Commits: 2,068 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

datopian/portaljs

🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless).

AI dev

Stack

TypeScript Express Next.js React Tailwind CSS npm Yarn

GitHub topics

#agent-skills #ai #ai-agents #ckan #claude-code #data-mesh

Updated: 2026-10-16
Lists: 1 list mention
First commit: 2011-03-09
History: 145 history points
License: MIT
Issues: 88 open

2,363

stars

Forks: 335
Commits: 3,501 commits
Star growth, last 7 days: +4 +0.2%
Commit velocity, last 7 days: +2 +0.1%

Website GitHub

benedekrozemberczki/karateclub

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

Stack

Python pip

GitHub topics

#2vec #community-detection #deepwalk #gcn #graph-clustering #graph-embedding

Updated: 2024-07-17
Lists: 3 list mentions
First commit: 2019-12-05
History: 10 history points
License: GPL-3.0
Issues: 12 open

2,291

stars

Forks: 253
Commits: 2,319 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

apache/gobblin

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

Stack

Java Gradle pip

GitHub topics

#apache #data #ingestion #management #replication

Updated: 2026-10-15
Lists: 2 list mentions
First commit: 2014-02-04
History: 147 history points
License: Apache-2.0
Issues: Disabled

2,270

stars

Forks: 749
Commits: 6,560 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: +1 0.0%

Website GitHub

microsoft/GraphEngine

Microsoft Graph Engine

Archived

Stack

C# CMake .NET SDK

GitHub topics

#distributed-computing #dotnet #graph-engine #graph-query-language #in-memory-computations #in-memory-storage

Updated: 2024-10-08
Lists: 1 list mention
First commit: 2017-02-09
History: 145 history points
License: MIT
Issues: 47 open

2,266

stars

Forks: 335
Commits: 1,795 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

twitter/summingbird

Streaming MapReduce with Scalding and Storm

Archived

Stack

Scala

Updated: 2022-01-19
Lists: 2 list mentions
First commit: 2012-09-25
History: 8 history points
License: Apache-2.0
Issues: 162 open

2,121

stars

Forks: 255
Commits: 1,793 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Stack

Python pytest PEP 517 pip

GitHub topics

#data #data-integration #etl #pipeline #postgresql #python

Updated: 2023-12-15
Lists: 1 list mention
First commit: 2018-04-08
History: 147 history points
License: MIT
Issues: 26 open

2,093

stars

Forks: 99
Commits: 172 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

tinkerpop/gremlin

A Graph Traversal Language (no longer active - see Apache TinkerPop)

Stack

Java Maven

Updated: 2021-08-16
Lists: 1 list mention
First commit: 2009-11-07
History: 8 history points
License: NOASSERTION
Issues: Disabled

1,949

stars

Forks: 229
Commits: 1,227 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

baidu/tera

An Internet-Scale Database.

Stack

C++ CMake Maven

GitHub topics

#baidu #bigtable #c-plus-plus #data #database #hbase

Updated: 2024-06-05
Lists: 1 list mention
First commit: 2014-03-26
History: 8 history points
License: BSD-3-Clause
Issues: 172 open

1,904

stars

Forks: 432
Commits: 2,252 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

biokoda/actordb

ActorDB distributed SQL database

Stack

Erlang

Updated: 2022-11-10
Lists: 1 list mention
First commit: 2014-01-21
History: 8 history points
License: MPL-2.0
Issues: 32 open

1,888

stars

Forks: 71
Commits: 397 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

pinterest/secor

Secor is a service implementing Kafka log persistence

Archived AI dev

Stack

Java Maven

GitHub topics

#kafka

Updated: 2026-10-04
Lists: 2 list mentions
First commit: 2014-04-15
History: 8 history points
License: Apache-2.0
Issues: 284 open

1,858

stars

Forks: 536
Commits: 3,340 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing