inference-acceleration

4 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

SageAttention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to…

★ 4k

TeaCache

Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model

★ 1.4k

Locals

Run many AI agents at once on your Mac, up to 3x faster.

★ 356 · GitHub ↗

Awesome-Efficient-dLLMs

[EMNLP 2026] 📚 A curated list of Awesome Efficient dLLMs Papers with Codes

★ 150 · GitHub ↗

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.