Search awesome repositories

Apache Superset is a Data Visualization and Data Exploration Platform

Protocol Buffers - Google's data interchange format

The Prometheus monitoring system and time series database.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.

Scalable datastore for metrics, events, and real-time analytics

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

Data Apps & Dashboards for Python. No JavaScript Required.

Analyzes resource usage and performance characteristics of running containers.

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.

Nomad is an easy-to-use, flexible, and performant workload orchestrator that can deploy a mix of microservice, batch, containerized, and non-containerized applications. Nomad is easy to operate and scale and has native Consul and Vault integrations.

An orchestration platform for the development, production, and observation of data assets.

A lightweight, lightning-fast, in-process vector database

NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB

An open-source graph database

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Apache Druid: a high performance real-time analytics database.

Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.

CMAK is a tool for managing Apache Kafka clusters

Incremental engine for long horizon agents 🌟 Star if you like it!

Polyglot document intelligence with a Rust core: extract text, metadata, images, tables, and structured data from 106 formats across 140 file extensions, plus code intelligence for 371 languages. Fifteen bindings, with CLI, REST API, and MCP server.

A polyglot document intelligence framework with a Rust core. Extract text, metadata, images, and structured information from PDFs, Office documents, images, and 97+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, R, C, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server.

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

Dockerfile for Apache Kafka

A fast compressor/decompressor

Simple, resilient multi-host containers networking and more.

Java binary serialization and cloning: fast, efficient, automatic