speculative-decoding

7 Projekte teilen dieses GitHub-Topic

Linien verbinden Mitglieder, die messbar miteinander verwandt sind. Die Punktgröße spiegelt die Sterne wider.

🧬 Mitglieder

Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).

Large-scale LLM inference engine

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Pure Rust Inference Engine

awesome-on-policy-distillation

A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of…

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

sndr_core_engine

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere…

🔗 Verwandte Familien

llm-inference 76 cuda 90 quantization 51 qwen 102 inference-engine 14 intel 5 lora 65 rocm 13

Gemessen anhand der von beiden Projekten geteilten GitHub-Themen, gewichtet nach der Seltenheit jedes Themas.