llm-gateway

21 projects share this GitHub topic

llm-gateway — OmniRoute ★59.3kllm-gatewaylitellm — ★57.7k9router — ★26.8kgateway — ★12.9kcoai — ★9.3kbifrost — ★7.7kplano — ★7kgpt-load — ★6.3kllmgateway — ★1.6kparitok-4b-v1 — ★1.4kvllora — ★812otari — ★418ai-gateway — ★2411flowbase — ★219aisix — ★126busbar — ★116Gozar — ★107awesome-ai-gateway — ★97byok-relay — ★54sbproxy — ★51millwright — ★45litellm★ 57.7k9router★ 26.8kgateway★ 12.9kcoai★ 9.3kbifrost★ 7.7kplano★ 7kgpt-load★ 6.3kllmgateway★ 1.6kparitok-4b-v1★ 1.4kvllora★ 812otari★ 418ai-gateway★ 2411flowbase★ 219aisix★ 126busbar★ 116Gozar★ 107awesome-ai-gateway★ 97byok-relay★ 54sbproxy★ 51millwright★ 45

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members
OmniRoute
Never stop coding. Free MIT AI gateway: one endpoint, 352 providers (150+ free), 1200+ models Kimi, Claude,…
★ 59.3k
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format…
★ 57.7k
9router
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE…
★ 26.8k
gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast &…
★ 12.9k
coai
🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM…
★ 9.3k
bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode,…
★ 7.7k
plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent…
★ 7k
gpt-load
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts,…
★ 6.3k
llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1.6k
paritok-4b-v1
Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long…
★ 1.4k
vllora
Debug your AI agents
★ 812
otari
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual…
★ 418
ai-gateway
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test &…
★ 241
1flowbase
Open-source AI gateway for local agent clients: publish fusion-style multi-model workflows as…
★ 219
aisix
Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic,…
★ 126
busbar
Point your existing SDK at one URL and reach every LLM vendor — with real failover, not a try/except. One…
★ 116
Gozar
Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage…
★ 107
awesome-ai-gateway
⚡ Awesome AI Gateway — pick an AI gateway from 160+ (LiteLLM, OpenRouter, Portkey, Kong, Higress,…
★ 97
byok-relay
Bring your own key (BYOK) relay to enable lightweight frontend-only apps to use LLMs using the user's API…
★ 54
sbproxy
Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72…
★ 51
millwright
Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default.
★ 45
🔗 Related families

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.