rtp-llm
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
Use a high-performance tool to run large language models for different applications efficiently.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
rtp-llm has 1.3k stars on GitHub. It has been forked 241 times. rtp-llm is written mainly in Cuda. It has been in active development since 2023. rtp-llm is available under the Apache-2.0 license. Its main topics are gpt, inference, llama, llm.
What is rtp-llm?
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
Is rtp-llm open source?
rtp-llm is an open-source project. It is released under the Apache-2.0 license.
Is rtp-llm free?
Yes. rtp-llm is free and open source — you can use, modify and self-host it.
What license does rtp-llm use?
rtp-llm is available under the Apache-2.0 license.
What language is rtp-llm written in?
rtp-llm is written mainly in Cuda.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/alibaba-rtp-llm.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.