Home Projects millwright
millwright
Rust

millwright

Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default.

by Northwood-Systems · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
Likely
Self-hostable
ai-gatewaybedrockgatewayApache-2.0RustSelf-hostable
View on GitHub
In plain words

Manage and route requests between your AI applications and model providers securely.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
millwright — GitHub preview card
📈 Star history
4544
2026-08-012026-08-31
📈 Track millwright

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default.

millwright has 45 stars on GitHub. It has been forked 2 times. millwright is written mainly in Rust. It has been in active development since 2026. millwright is available under the Apache-2.0 license. Its main topics are ai-gateway, bedrock, gateway, litellm.

Frequently asked questions

What is millwright?

Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default.

Is millwright open source?

millwright is an open-source project. It is released under the Apache-2.0 license.

Is millwright free?

Yes. millwright is free and open source — you can use, modify and self-host it.

What license does millwright use?

millwright is available under the Apache-2.0 license.

What language is millwright written in?

millwright is written mainly in Rust.

🏅 Maintainer of this project?
olud.ai badge — millwright

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=northwood-systems-millwright)](https://olud.ai/project/northwood-systems-millwright.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or nat…
57.6k · ai-gateway
sharesrust-aiopenai-proxy
gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails w…
12.9k · ai-gateway
sharesgatewayllm-gateway
aisix
Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenA…
123 · ai-agents
sharesgatewaybedrock
bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mo…
7.7k · ai-gateway
sharesgatewayllm-gateway
awesome-ai-gateway
⚡ Awesome AI Gateway — pick an AI gateway from 160+ (LiteLLM, OpenRouter, Portkey, Kong, Higres…
97 · ai-gateway
shareslitellmllm-gateway
ai-gateway
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrail…
243 · ai-gateway
shareslitellmllm-gateway
busbarAI
Point your existing SDK at one URL and reach every LLM vendor — with real failover, not a try/e…
142 · ai-gateway
sharesbedrockai-gateway
otari
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, wi…
417 · ai
sharesgatewayllm-gateway
plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observab…
7k · ai-gateway
sharesgatewayllm-gateway
sbproxy
Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0…
51 · ai-gateway
sharesopenai-proxyllm-gateway

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.