speculative-decoding
10 projetos partilham este topic do GitHub
Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.
🧬 Membros
EAGLE
Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).
★ 2.6k
sonar
Large-scale LLM inference engine
★ 1.9k
AngelSlim
Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
★ 1.8k
halogen-flash-server
Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models,…
★ 1.1k · GitHub ↗
awesome-on-policy-distillation
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of…
★ 881
orthrus
[NeurIPS 2026 Spotlight] Fast, lossless LLM inference via dual-view diffusion decoding.
★ 482
sndr_core_engine
SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere…
★ 133
halofpx
High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen…
★ 94 · GitHub ↗
glm-5.3-flash-2x-rtx-pro-6000-blackwell
Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive…
★ 61 · GitHub ↗
llama.cpp-v100
llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K…
★ 59 · GitHub ↗
🔗 Familias relacionadas
Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.