Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
oxnr/awesome-bigdata
#awesome
#awesome-list
#bigdata
#data
#data-analytics
#data-science
#data-stream
#data-visualization
#data-warehouse
#database
#distributed-database
#series-database
#stream-processing
#streaming-data
#visualize-data
404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=4776 | rate_limit_reset=1792234418
- List stars
- 14,676
- README repos
- 214
- Indexed repos
- 186
- List commits
- 592
- Forks
- 2,622
- Open issues
- 9
Tracked list growth
GitHub stars and default-branch commits for oxnr/awesome-bigdata.
Latest scan 2026-10-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-10-17
tensorflow/tensorflow
An Open Source Machine Learning Framework for Everyone
AI dev
- Updated
- 2026-10-17
- Lists
- 5 list mentions
- First commit
- 2015-11-07
- License
- Apache-2.0
- Issues
- 3,346 open
201,061
stars
- Forks
- 79,636
- Commits
- 201,315 commits
- Star growth, last 7 days
- +295 +0.1%
- Commit velocity, last 7 days
- +823 +0.4%
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 7 list mentions
- First commit
- 2015-07-02
- License
- Apache-2.0
- Issues
- 586 open
75,176
stars
- Forks
- 18,481
- Commits
- 23,792 commits
- Star growth, last 7 days
- +74 +0.1%
- Commit velocity, last 7 days
- +153 +0.6%
scikit-learn/scikit-learn
scikit-learn: machine learning in Python
AI dev
GitHub topics
- Updated
- 2026-09-12
- Lists
- 3 list mentions
- First commit
- 2010-01-05
- License
- BSD-3-Clause
- Issues
- 2,160 open
67,234
stars
- Forks
- 27,390
- Commits
- 33,993 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
keras-team/keras
Deep Learning for humans
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 4 list mentions
- First commit
- 2015-03-28
- License
- Apache-2.0
- Issues
- 233 open
64,378
stars
- Forks
- 19,799
- Commits
- 12,919 commits
- Star growth, last 7 days
- +14 0.0%
- Commit velocity, last 7 days
- +56 +0.4%
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
AI dev
GitHub topics
- Updated
- 2026-10-17
- Lists
- 7 list mentions
- First commit
- 2014-10-06
- License
- Apache-2.0
- Issues
- 1,932 open
47,194
stars
- Forks
- 18,051
- Commits
- 42,128 commits
- Star growth, last 7 days
- +49 +0.1%
- Commit velocity, last 7 days
- +168 +0.4%
apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
AI dev
- Updated
- 2026-09-09
- Lists
- 4 list mentions
- First commit
- 2010-03-29
- License
- Apache-2.0
- Issues
- 518 open
43,961
stars
- Forks
- 29,365
- Commits
- 50,040 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ray-project/ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
AI dev
- Updated
- 2026-09-11
- Lists
- 5 list mentions
- First commit
- 2016-02-07
- License
- Apache-2.0
- Issues
- 3,571 open
43,770
stars
- Forks
- 8,019
- Commits
- 31,669 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
getredash/redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
GitHub topics
- Updated
- 2026-10-08
- Lists
- 7 list mentions
- First commit
- 2013-10-25
- License
- BSD-2-Clause
- Issues
- 813 open
28,832
stars
- Forks
- 4,633
- Commits
- 8,008 commits
- Star growth, last 7 days
- +1 0.0%
- Commit velocity, last 7 days
- 0 0.0%
plotly/dash
Data Apps & Dashboards for Python. No JavaScript Required.
AI dev
GitHub topics
- Updated
- 2026-10-15
- Lists
- 4 list mentions
- First commit
- 2015-04-10
- License
- MIT
- Issues
- 433 open
24,456
stars
- Forks
- 2,329
- Commits
- 10,295 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
matplotlib/matplotlib
matplotlib: plotting with Python
GitHub topics
- Updated
- 2026-10-08
- Lists
- 3 list mentions
- First commit
- 2003-05-12
- License
- Unknown
- Issues
- 1,489 open
23,343
stars
- Forks
- 8,502
- Commits
- 55,445 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
spotify/luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
GitHub topics
- Updated
- 2026-10-14
- Lists
- 4 list mentions
- First commit
- 2011-11-17
- License
- Apache-2.0
- Issues
- 185 open
18,782
stars
- Forks
- 2,471
- Commits
- 4,323 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
AI dev
- Updated
- 2026-10-12
- Lists
- 5 list mentions
- First commit
- 2018-04-30
- License
- Apache-2.0
- Issues
- 2,590 open
16,282
stars
- Forks
- 2,354
- Commits
- 28,117 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
spotify/annoy
Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk
- Updated
- 2025-10-29
- Lists
- 3 list mentions
- First commit
- 2013-02-20
- License
- Apache-2.0
- Issues
- 90 open
14,312
stars
- Forks
- 1,227
- Commits
- 911 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
h2oai/h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
AI dev
Stack
GitHub topics
- Updated
- 2026-09-25
- Lists
- 3 list mentions
- First commit
- 2014-03-03
- License
- Apache-2.0
- Issues
- 2,852 open
7,509
stars
- Forks
- 2,019
- Commits
- 32,845 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
feast-dev/feast
The Open Source Feature Store for AI/ML
AI dev
GitHub topics
- Updated
- 2026-10-16
- Lists
- 2 list mentions
- First commit
- 2018-12-10
- License
- Apache-2.0
- Issues
- 480 open
7,335
stars
- Forks
- 1,473
- Commits
- 4,847 commits
- Star growth, last 7 days
- +12 +0.2%
- Commit velocity, last 7 days
- +13 +0.3%
aimhubio/aim
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
- Updated
- 2026-10-09
- Lists
- 4 list mentions
- First commit
- 2019-05-31
- License
- Apache-2.0
- Issues
- 480 open
6,282
stars
- Forks
- 413
- Commits
- 2,265 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
ml-tooling/ml-workspace
🛠 All-in-one web-based IDE specialized for machine learning and data science.
Stack
GitHub topics
- Updated
- 2024-07-26
- Lists
- 3 list mentions
- First commit
- 2019-05-27
- License
- Apache-2.0
- Issues
- 0 open
3,546
stars
- Forks
- 456
- Commits
- 847 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
chdb-io/chdb
chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse
AI dev
GitHub topics
- Updated
- 2026-09-09
- Lists
- 2 list mentions
- First commit
- 2008-12-01
- License
- Apache-2.0
- Issues
- 41 open
2,890
stars
- Forks
- 130
- Commits
- 3,412 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
mara/mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
GitHub topics
- Updated
- 2023-12-15
- Lists
- 1 list mention
- First commit
- 2018-04-08
- License
- MIT
- Issues
- 26 open
2,093
stars
- Forks
- 99
- Commits
- 172 commits
- Star growth, last 7 days
- +1 0.0%
- Commit velocity, last 7 days
- 0 0.0%
bruin-data/bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
AI dev
- Updated
- 2026-10-15
- Lists
- 3 list mentions
- First commit
- 2023-07-25
- License
- Apache-2.0
- Issues
- 66 open
1,779
stars
- Forks
- 98
- Commits
- 8,629 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
IBMStreams/streamsx.topology
Develop streaming applications for IBM Streams in Python, Java & Scala.
GitHub topics
- Updated
- 2022-07-24
- Lists
- 1 list mention
- First commit
- 2015-05-28
- License
- Apache-2.0
- Issues
- 3 open
- Forks
- 43
- Commits
- 6,370 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%