Sign in
← All awesome lists Search these repos

Awesome List

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

oxnr/awesome-bigdata #awesome #awesome-list #bigdata #data #data-analytics #data-science #data-stream #data-visualization #data-warehouse #database #distributed-database #series-database #stream-processing #streaming-data #visualize-data 404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=4776 | rate_limit_reset=1792234418
Open GitHub
List stars
14,676
README repos
214
Indexed repos
186
List commits
592
Forks
2,622
Open issues
9

Tracked list growth

GitHub stars and default-branch commits for oxnr/awesome-bigdata.

Latest scan 2026-10-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

8 repos matching these filters.

Package manager: cargo
Latest repo push 2026-10-17

Filter this list

Search within Awesome Bigdata or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

AI dev
Stack
Go Axum Cobra Gin gRPC Go Cargo CMake Conan
GitHub topics
#anns #cloud-native #diskann #distributed #embedding-database #embedding-similarity
Updated
2026-10-17
Lists
8 list mentions
First commit
2019-03-18
License
Apache-2.0
Issues
1,476 open
Sign in to like milvus-io/milvus
46,402
stars
Forks
4,303
Commits
25,778 commits
Star growth, last 7 days
+53 +0.1%
Commit velocity, last 7 days
+54 +0.2%
Website GitHub
taosdata/TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

AI dev
Stack
C Gin gRPC Go pytest Cargo CMake Conan
GitHub topics
#bigdata #cloud-native #cluster #connected-vehicles #database #distributed
Updated
2026-10-06
Lists
2 list mentions
First commit
2019-07-11
License
AGPL-3.0
Issues
439 open
Sign in to like taosdata/TDengine
25,151
stars
Forks
5,020
Commits
86,992 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
MaterializeInc/materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

AI dev
Stack
Rust Axum FastAPI pytest React Cargo npm PEP 517
GitHub topics
#cdc #data-mesh #data-store #database #distributed-systems #kafka
Updated
2026-10-17
Lists
2 list mentions
First commit
2017-12-05
License
NOASSERTION
Issues
Disabled
Sign in to like MaterializeInc/materialize
6,385
stars
Forks
515
Commits
51,752 commits
Star growth, last 7 days
+7 +0.1%
Commit velocity, last 7 days
+119 +0.2%
Website GitHub
slothflowlabs/duckle

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

Stack
Rust Axum React Tauri Vite Cargo npm PEP 517
GitHub topics
#cdc #connectors #data-engineering #data-integration #data-orchestration #data-pipeline
Updated
2026-10-14
Lists
3 list mentions
First commit
2026-05-21
License
Apache-2.0
Issues
73 open
Sign in to like slothflowlabs/duckle
1,508
stars
Forks
120
Commits
1,751 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
chrislusf/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.

Stack
Go Cobra Gin gRPC Go Cargo Go modules Maven
Updated
2026-10-16
Lists
3 list mentions
First commit
2011-11-30
License
Apache-2.0
Issues
Disabled
Sign in to like chrislusf/seaweedfs
43
stars
Forks
7
Commits
12,815 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub