Run large language models quickly and efficiently for tasks that require real-time responses.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeTokenSpeed is a speed-of-light LLM inference engine.
tokenspeed has 2k stars on GitHub. It has been forked 265 times. tokenspeed is written mainly in Python. It has been in active development since 2026. tokenspeed is available under the MIT license. Its main topics are b200, b300, blackwell, deepseek.
What is tokenspeed?
TokenSpeed is a speed-of-light LLM inference engine.
Is tokenspeed open source?
tokenspeed is an open-source project. It is released under the MIT license.
Is tokenspeed free?
Yes. tokenspeed is free and open source — you can use, modify and self-host it.
What license does tokenspeed use?
tokenspeed is available under the MIT license.
What language is tokenspeed written in?
tokenspeed is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/lightseekorg-tokenspeed.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.