Awesome List

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

oxnr/awesome-bigdata #awesome #awesome-list #bigdata #data #data-analytics #data-science #data-stream #data-visualization #data-warehouse #database #distributed-database #series-database #stream-processing #streaming-data #visualize-data 404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=4776 | rate_limit_reset=1792234418
List stars
14,676
README repos
214
Indexed repos
186
List commits
592
Forks
2,622
Open issues
9

Tracked list growth

GitHub stars and default-branch commits for oxnr/awesome-bigdata.

Latest scan 2026-10-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

61 repos matching these filters.

Latest repo push 2026-10-17

Filter this list

Search within Awesome Bigdata or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

apache/superset

Apache Superset is a Data Visualization and Data Exploration Platform

AI dev
Updated
2026-10-17
Lists
7 list mentions
First commit
2015-07-02
License
Apache-2.0
Issues
586 open
Forks
18,481
Commits
23,792 commits
Star growth, last 7 days
+74 +0.1%
Commit velocity, last 7 days
+153 +0.6%
metabase/metabase

The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:

AI dev
Updated
2026-10-17
Lists
6 list mentions
First commit
2015-02-02
License
NOASSERTION
Issues
4,549 open
Forks
6,910
Commits
45,700 commits
Star growth, last 7 days
+99 +0.2%
Commit velocity, last 7 days
+205 +0.5%
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev
Updated
2026-10-17
Lists
7 list mentions
First commit
2014-10-06
License
Apache-2.0
Issues
1,932 open
Forks
18,051
Commits
42,128 commits
Star growth, last 7 days
+49 +0.1%
Commit velocity, last 7 days
+168 +0.4%
ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

AI dev
Updated
2026-09-11
Lists
5 list mentions
First commit
2016-02-07
License
Apache-2.0
Issues
3,571 open
Forks
8,019
Commits
31,669 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
cockroachdb/cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

AI dev
Updated
2026-10-15
Lists
2 list mentions
First commit
2014-02-06
License
NOASSERTION
Issues
8,259 open
Forks
4,131
Commits
118,999 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
getredash/redash

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Updated
2026-10-08
Lists
7 list mentions
First commit
2013-10-25
License
BSD-2-Clause
Issues
813 open
Forks
4,633
Commits
8,008 commits
Star growth, last 7 days
+1 0.0%
Commit velocity, last 7 days
0 0.0%
taosdata/TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

AI dev
Updated
2026-10-06
Lists
2 list mentions
First commit
2019-07-11
License
AGPL-3.0
Issues
439 open
Forks
5,020
Commits
86,992 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
VictoriaMetrics/VictoriaMetrics

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

AI dev
Updated
2026-10-09
Lists
6 list mentions
First commit
2018-09-30
License
Apache-2.0
Issues
788 open
Forks
1,766
Commits
13,010 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev
Updated
2026-10-12
Lists
5 list mentions
First commit
2018-04-30
License
Apache-2.0
Issues
2,590 open
Forks
2,354
Commits
28,117 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
thanos-io/thanos

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

Updated
2026-10-15
Lists
2 list mentions
First commit
2017-11-01
License
Apache-2.0
Issues
930 open
Forks
2,391
Commits
5,100 commits
Star growth, last 7 days
+9 +0.1%
Commit velocity, last 7 days
0 0.0%
apache/druid

Apache Druid: a high performance real-time analytics database.

AI dev
GitHub topics
Updated
2026-10-17
Lists
4 list mentions
First commit
2012-10-23
License
Apache-2.0
Issues
777 open
Forks
3,802
Commits
16,747 commits
Star growth, last 7 days
+26 +0.2%
Commit velocity, last 7 days
+44 +0.3%
jacomyal/sigma.js

A JavaScript library aimed at visualizing graphs of thousands of nodes and edges

Updated
2026-08-20
Lists
2 list mentions
First commit
2012-01-28
License
MIT
Issues
15 open
Forks
1,620
Commits
2,065 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
yugabyte/yugabyte-db

YugabyteDB - the cloud native distributed SQL database for mission-critical applications.

AI dev
Updated
2026-10-17
Lists
2 list mentions
First commit
2005-06-28
License
NOASSERTION
Issues
8,379 open
Forks
1,347
Commits
40,568 commits
Star growth, last 7 days
+13 +0.1%
Commit velocity, last 7 days
+160 +0.4%
VowpalWabbit/vowpal_wabbit

Vowpal Wabbit is a machine learning system which pushes the frontier of machine learning with techniques such as online, hashing, allreduce, reductions, learning2search, active, and interactive learning.

Updated
2026-10-15
Lists
2 list mentions
First commit
2009-04-29
License
NOASSERTION
Issues
0 open
Forks
1,923
Commits
10,603 commits
Star growth, last 7 days
+3 0.0%
Commit velocity, last 7 days
0 0.0%
harthur/brain

Simple feed-forward neural network in JavaScript

Archived
Stack
Updated
2020-09-03
Lists
3 list mentions
First commit
2010-05-10
License
MIT
Issues
21 open
Forks
843
Commits
151 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
h2oai/h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

AI dev
Updated
2026-09-25
Lists
3 list mentions
First commit
2014-03-03
License
Apache-2.0
Issues
2,852 open
Forks
2,019
Commits
32,845 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Freeboard/freeboard

A damn-sexy, open source real-time dashboard builder for IOT and other web mashups. A free open-source alternative to Geckoboard.

Stack
Updated
2023-09-23
Lists
3 list mentions
First commit
2013-07-28
License
MIT
Issues
166 open
Forks
1,175
Commits
280 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
MaterializeInc/materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

AI dev
Updated
2026-10-17
Lists
2 list mentions
First commit
2017-12-05
License
NOASSERTION
Issues
Disabled
Forks
515
Commits
51,752 commits
Star growth, last 7 days
+7 +0.1%
Commit velocity, last 7 days
+119 +0.2%
aimhubio/aim

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

Updated
2026-10-09
Lists
4 list mentions
First commit
2019-05-31
License
Apache-2.0
Issues
480 open
Forks
413
Commits
2,265 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
lightdash/lightdash

Agentic BI. Analytics at the speed of code ⚡️

AI dev
Updated
2026-10-04
Lists
2 list mentions
First commit
2021-05-18
License
NOASSERTION
Issues
1,090 open
Forks
790
Commits
24,651 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
square/cubism

Cubism.js: A JavaScript library for time series visualization.

Stack
Updated
2025-04-01
Lists
2 list mentions
First commit
2012-03-28
License
NOASSERTION
Issues
42 open
Forks
511
Commits
112 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
infiniflow/infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

AI dev
Updated
2026-09-09
Lists
4 list mentions
First commit
2022-07-18
License
Apache-2.0
Issues
122 open
Forks
443
Commits
3,171 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev
Updated
2026-10-16
Lists
3 list mentions
First commit
2024-02-12
License
NOASSERTION
Issues
28 open
Forks
163
Commits
3,719 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Netflix/atlas

In-memory dimensional time series database.

AI dev
Stack
Updated
2026-10-15
Lists
2 list mentions
First commit
2014-08-05
License
Apache-2.0
Issues
9 open
Forks
359
Commits
3,050 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
apache/linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

Updated
2026-10-16
Lists
1 list mention
First commit
2019-07-23
License
Apache-2.0
Issues
183 open
Forks
1,169
Commits
4,342 commits
Star growth, last 7 days
+4 +0.1%
Commit velocity, last 7 days
0 0.0%
WeBankFinTech/DataSphereStudio

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Updated
2025-11-04
Lists
1 list mention
First commit
2019-11-24
License
Apache-2.0
Issues
362 open
Forks
1,040
Commits
12,523 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
FeatureBaseDB/featurebase

A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase

Archived
Updated
2024-02-21
Lists
1 list mention
First commit
2013-10-16
License
Apache-2.0
Issues
7 open
Forks
240
Commits
5,576 commits
Star growth, last 7 days
+1 0.0%
Commit velocity, last 7 days
0 0.0%
datopian/portaljs

🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless).

AI dev
Updated
2026-10-16
Lists
1 list mention
First commit
2011-03-09
License
MIT
Issues
88 open
Forks
335
Commits
3,501 commits
Star growth, last 7 days
+4 +0.2%
Commit velocity, last 7 days
+2 +0.1%
bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

AI dev
Updated
2026-10-15
Lists
3 list mentions
First commit
2023-07-25
License
Apache-2.0
Issues
66 open
Forks
98
Commits
8,629 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
slothflowlabs/duckle

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

Updated
2026-10-14
Lists
3 list mentions
First commit
2026-05-21
License
Apache-2.0
Issues
73 open
Forks
120
Commits
1,751 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
rescrv/HyperDex

HyperDex is a scalable, searchable key-value store

Stack
Updated
2024-05-21
Lists
2 list mentions
First commit
2011-04-13
License
BSD-3-Clause
Issues
37 open
Forks
165
Commits
2,439 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
etsy/411

An Alert Management Web Application

Archived
Stack
GitHub topics
Updated
2023-04-09
Lists
1 list mention
First commit
2016-08-12
License
MIT
Issues
29 open
Forks
105
Commits
431 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%