H2O
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
Run large language models more efficiently for generating long content like dialogues and stories.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytime[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
H2O has 532 stars on GitHub. It has been forked 89 times. H2O is written mainly in Python. It has been in active development since 2023. Its main topics are gpt-3, heavy-hitters, high-throughput, kv-cache.
What is H2O?
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
Is H2O open source?
H2O is an open-source project.
Is H2O free?
Yes. H2O is free and open source — you can use, modify and self-host it.
What language is H2O written in?
H2O is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/fminference-h2o.html)
