Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of data engineering tools for software developers
GitHub stars and default-branch commits for igorbarinov/awesome-data-engineering.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Protocol Buffers - Google's data interchange format
A lightweight, lightning-fast, in-process vector database
NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB
Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
A fast compressor/decompressor
HyperDex is a scalable, searchable key-value store
Time-series database
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
An experimental embedded SQL engine in C++20. Query Parquet, CSV, JSON, Arrow, Avro, SQLite, and Excel files directly with SQL, in-process. Early-stage.
Kyoto Tycoon key-value store (and the underlying Kyoto Cabinet library)