sparsity

4 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression…

★ 2.7k

model-optimization

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

★ 1.6k

nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

★ 1.2k

H2O

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

★ 529

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.