efficient-inference

11 Projekte teilen dieses GitHub-Topic

Linien verbinden Mitglieder, die messbar miteinander verwandt sind. Die Punktgröße spiegelt die Sterne wider.

🧬 Mitglieder

Awesome-Model-Quantization

A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit…

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

EfficientFormer

EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]

[CVPR 2024] DeepCache: Accelerating Diffusion Models for Free

Awesome-Quantization-Papers

List of papers related to neural network quantization in recent AI conferences and journals.

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

[NeurIPS 2026 Spotlight] Fast, lossless LLM inference via dual-view diffusion decoding.

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Awesome-Generation-Acceleration

📚 Collection of awesome generation acceleration resources.

On-device LLM Inference Powered by X-Bit Quantization

speculative-decoding

Explorations into some recent techniques surrounding speculative decoding

🔗 Verwandte Familien

model-compression 11 quantization 41 transformer 62 post-training-quantization 4 llama2 40 localllm 6 small-models 4 text-generation 17

Gemessen anhand der von beiden Projekten geteilten GitHub-Themen, gewichtet nach der Seltenheit jedes Themas.