Home Projects mistral.rs
mistral.rs
Rust

mistral.rs

Fast, flexible LLM inference

by EricLBuehler · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
llmrustuqffMITRust
View on GitHub
In plain words

Run large language models on your computer using Rust for flexible and fast AI tasks.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
mistral.rs — GitHub preview card
📈 Star history
8k7k
2026-07-042026-08-31
📈 Track mistral.rs

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Fast, flexible LLM inference

mistral.rs has 7.6k stars on GitHub. It has been forked 689 times. mistral.rs is written mainly in Rust. It has been in active development since 2024. mistral.rs is available under the MIT license. Its main topics are llm, rust, uqff.

Frequently asked questions

What is mistral.rs?

Fast, flexible LLM inference

Is mistral.rs open source?

mistral.rs is an open-source project. It is released under the MIT license.

Is mistral.rs free?

Yes. mistral.rs is free and open source — you can use, modify and self-host it.

What license does mistral.rs use?

mistral.rs is available under the MIT license.

What language is mistral.rs written in?

mistral.rs is written mainly in Rust.

🏅 Maintainer of this project?
olud.ai badge — mistral.rs

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=ericlbuehler-mistral-rs)](https://olud.ai/project/ericlbuehler-mistral-rs.html)
More badge options →
🧬 Related projects