Home Projects llmix
llmix
Python

llmix

Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.

by sno-ai · GitHub
Stars
Forks
Trending
License
Created
Last commit
Category
Language
ai-agentsai-sdkai-toolsApache-2.0Python
View on GitHub
In plain words

Manage AI model calls in your applications without rewriting existing code, while adding features like caching and retries.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
llmix — GitHub preview card
📈 Star history
132130
2026-07-202026-08-31
📈 Track llmix

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.

llmix has 132 stars on GitHub. It has been forked 28 times. llmix is written mainly in Python. It has been in active development since 2026. llmix is available under the Apache-2.0 license. Its main topics are ai-agents, ai-sdk, ai-tools, anthropic.

Frequently asked questions

What is llmix?

Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.

Is llmix open source?

llmix is an open-source project. It is released under the Apache-2.0 license.

Is llmix free?

Yes. llmix is free and open source — you can use, modify and self-host it.

What license does llmix use?

llmix is available under the Apache-2.0 license.

What language is llmix written in?

llmix is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — llmix

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=sno-ai-llmix)](https://olud.ai/project/sno-ai-llmix.html)
More badge options →
🧬 Related projects🧬 View the DNA map →