FlashInfer: Kernel Library for LLM Serving
Appears on
Quick read
Latest capture 2026-09-12 03:03
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
11 paths
Agent instructions and tool configuration found in this repository.
Agent instructions
Claude Code 10
7 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +705
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
High-speed Large Language Model Serving for Local Deployment
Fast and memory-efficient exact attention
A high-throughput and memory-efficient inference and serving engine for LLMs
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models
[ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
