Home Projects aisix
aisix
Rust

aisix

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

by api7 · GitHub
Stars
Forks
License
Created
Last commit
Category
Language
Likely
Self-hostable
ai-agentsai-gatewayai-gateway-rustApache-2.0RustSelf-hostable
View on GitHub
In plain words

Manage and monitor all your AI model traffic through a single, easy-to-use interface.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
aisix — GitHub preview card
📈 Star history
12368
2026-07-202026-08-31
📈 Track aisix

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

aisix has 123 stars on GitHub. It has been forked 22 times. aisix is written mainly in Rust. It has been in active development since 2026. aisix is available under the Apache-2.0 license. Its main topics are ai-agents, ai-gateway, ai-gateway-rust, aisix.

Frequently asked questions

What is aisix?

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

Is aisix open source?

aisix is an open-source project. It is released under the Apache-2.0 license.

Is aisix free?

Yes. aisix is free and open source — you can use, modify and self-host it.

What license does aisix use?

aisix is available under the Apache-2.0 license.

What language is aisix written in?

aisix is written mainly in Rust.

🏅 Maintainer of this project?
olud.ai badge — aisix

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=api7-aisix)](https://olud.ai/project/api7-aisix.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
otari
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, wi…
417 · ai
sharesgatewayllm-proxy
millwright
Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default.
45 · ai-gateway
sharesgatewaybedrock
ai-gateway
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrail…
243 · ai-gateway
sharesllm-proxyllm-gateway
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or nat…
57.6k · ai-gateway
sharesgatewaybedrock
llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API inter…
1.6k · ai
sharesllm-proxyllm-gateway
busbar
Point your existing SDK at one URL and reach every LLM vendor — with real failover, not a try/e…
115 · ai-gateway
sharesllm-proxybedrock
awesome-ai-gateway
⚡ Awesome AI Gateway — pick an AI gateway from 160+ (LiteLLM, OpenRouter, Portkey, Kong, Higres…
97 · ai-gateway
sharesllm-routerllm-proxy
1flowbase
Open-source AI gateway for local agent clients: publish fusion-style multi-model workflows as O…
219 · agent-observability
sharesllm-routerllm-gateway
bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mo…
7.7k · ai-gateway
sharesgatewayllm-gateway
plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observab…
7k · ai-gateway
sharesgatewayllm-proxy

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.