thu-ml/SageAttention
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
[ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
Quick read
Latest capture 2026-10-17 04:10
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
138 observed captures since 2026-06-04. Observed captures are shown by default.
Stars from first capture +2
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
Fast and memory-efficient exact attention
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
FlashInfer: Kernel Library for LLM Serving
High-speed Large Language Model Serving for Local Deployment