Deploy large language models on your own server using a method that reduces memory usage without losing performance.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytime[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
SqueezeLLM has 723 stars on GitHub. It has been forked 52 times. SqueezeLLM is written mainly in Python. It has been in active development since 2023. SqueezeLLM is available under the MIT license. Its main topics are efficient-inference, large-language-models, llama, llm.
What is SqueezeLLM?
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
Is SqueezeLLM open source?
SqueezeLLM is an open-source project. It is released under the MIT license.
Is SqueezeLLM free?
Yes. SqueezeLLM is free and open source — you can use, modify and self-host it.
What license does SqueezeLLM use?
SqueezeLLM is available under the MIT license.
What language is SqueezeLLM written in?
SqueezeLLM is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/squeezeailab-squeezellm.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.