distributed-llama
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Link your home devices to create a faster network for running AI models.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeDistributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
distributed-llama has 3k stars on GitHub. It has been forked 248 times. distributed-llama is written mainly in C++. It has been in active development since 2023. distributed-llama is available under the MIT license. Its main topics are distributed-computing, distributed-llm, llama2, llama3.
What is distributed-llama?
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Is distributed-llama open source?
distributed-llama is an open-source project. It is released under the MIT license.
Is distributed-llama free?
Yes. distributed-llama is free and open source — you can use, modify and self-host it.
What license does distributed-llama use?
distributed-llama is available under the MIT license.
What language is distributed-llama written in?
distributed-llama is written mainly in C++.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/b4rtaz-distributed-llama.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.