Search awesome repositories

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

A hands-on introduction to video technology: image, video, codec (av1, vp9, h265) and more (ffmpeg encoding). Translations: 🇺🇸 🇨🇳 🇯🇵 🇮🇹 🇰🇷 🇷🇺 🇧🇷 🇪🇸

Deduplicating archiver with compression and authenticated encryption.

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

Free Zip / Unzip software and Rar file extractor. Cross-platform file and archive manager. Features volume spanning, compression, authenticated encryption. Supports 7Z, 7-Zip sfx, ACE, ARJ, Brotli, BZ2, CAB, CHM, CPIO, DEB, GZ, ISO, JAR, LHA/LZH, NSIS, OOo, PAQ/LPAQ, PEA, QUAD, RAR, RPM, split, TAR, Z, ZIP, ZIPX, Zstandard.

The macOS & iOS file archiver

DEPRECATED. Please use mholt/archives instead.

Hide secrets with invisible characters in plain text securely using passwords 🧙🏻‍♂️⭐

[ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Insane(ly slow but wicked good) PNG image optimization

An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

A tool to convert a Wallpaper's color scheme / palette, OCR with VLM's Traditional & Hybrid, Image Compression ,color palette extraction, image upsacling with Adversarial Networks and more image processing features.

Columnar storage extension for Postgres built as a foreign data wrapper. Check out https://github.com/citusdata/citus for a modernized columnar storage implementation built as a table access method.

Bareos is a cross-network Open Source backup solution (licensed under AGPLv3) which preserves, archives, and recovers data from all major operating systems.

Archive manager and 7zip replacement for macOS. Preview (nested) archives without extracting them. Extract single files.

ZSON is a PostgreSQL extension for transparent JSONB compression

Pakkero is a binary packer written in Go made for fun and educational purpose. Its main goal is to take in input a program file (elf binary, script, even appimage) and compress it, protect it from tampering and intrusion.

Smart Tree: not just a tree, a philosophy. A context-aware, AI-crafted replacement for 20+ tools with MEM8 quantum compression, semantic search, AST-smart editing, and partnership memory. Crafted with care by human + AI—accept no knock-offs.

DAR - Disk ARchive, a fully featured backup tool

Open source Windows x64 PE packer and crypter. Compresses and encrypts executables with a custom virtual machine into a self extracting stub.

Lossy/lossless wavelet video codec. Comparable to H.264 in terms of efficiency and quality.

Cold storage that queries like hot storage. High-ratio JSONL compressor with block-level random access. Query cold storage in seconds — no restore, no full decompression. 5–13% ratio on JSONL logs, 25–57% smaller than gzip. 1-hour window via DuckDB in under 6s. Free for personal and open-source use.

DuckDB extension to read PFC-JSONL compressed log files with block-level timestamp filtering