TokenSpeed is a speed-of-light LLM inference engine.
Appears on
Quick read
Latest capture 2026-10-28 10:56
Compare the starting count and capture dates, not just the percentage. How to read GitHub star growth. Missing history is not zero growth.
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
2 paths
Agent instructions and tool configuration found in this repository.
Explore indexed repositories with these instruction or planning files. File detection is not a quality, compatibility, or safety assessment; check the actual instructions upstream.
AGENTS.md, CLAUDE.md, and GEMINI.md searches also match nested paths. Other file searches require the exact repository-root path. To require several files, select them together in the search filters.
1 observed capture since 2026-10-28. Observed captures are shown by default.
Stars from first capture 0
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Achieve state of the art inference performance with modern accelerators on Kubernetes
LLM speculative inference server for heterogeneous hardware & consumer GPUs
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
