Home› Projects› mlx-omni-server
mlx-omni-server
Python

mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveragi

by madroidmaq · GitHub
733
Stars
90
Forks
MIT
License
2024
Created
3 mo ago
Last commit
function-calling
Category
Python
Language
Likely
Self-hostable
function-callinggenaimlxMITPythonSelf-hostable
View on GitHub
In plain words

Run AI models locally on Apple Silicon devices using a simple API.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
mlx-omni-server — GitHub preview card
📈 Star history
734733
2026-07-202026-08-31
📈 Track mlx-omni-server

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveragi

mlx-omni-server has 733 stars on GitHub. It has been forked 90 times. mlx-omni-server is written mainly in Python. It has been in active development since 2024. mlx-omni-server is available under the MIT license. Its main topics are function-calling, genai, mlx, openai.

❓ Frequently asked questions

What is mlx-omni-server?

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveragi

Is mlx-omni-server open source?

mlx-omni-server is an open-source project. It is released under the MIT license.

Is mlx-omni-server free?

Yes. mlx-omni-server is free and open source — you can use, modify and self-host it.

What license does mlx-omni-server use?

mlx-omni-server is available under the MIT license.

What language is mlx-omni-server written in?

mlx-omni-server is written mainly in Python.

🏅 Maintainer of this project?
olud.ai badge — mlx-omni-server

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=madroidmaq-mlx-omni-server)](https://olud.ai/project/madroidmaq-mlx-omni-server.html)
More badge options →
🧬 Shares DNA with🧬 View the DNA map →
mlx-lm
Run LLMs with MLX
★ 6.8k · llms
sharesmlx
llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Model…
★ 650 · agents
sharesfunction-calling
mlx-llm
Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with…
★ 465 · llama
sharesmlx
Linguflex
Command Your World with Voice
★ 811 · chatbot
sharesfunction-calling
PicoMLXServer
The easiest way to run the fastest MLX-based LLMs locally
★ 327 · ai
sharesmlx
magenta-realtime
Magenta RealTime 2: An Open-Weights Live Music Model
★ 1.7k · jax
sharesmlx
ReCall
ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning & ReCall: Learning…
★ 1.4k · agent
sharesfunction-calling
mlx-audio
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple'…
★ 7.6k · apple-silicon
sharesmlx
functionary
Chat language model that can use tools and interpret the results
★ 1.6k · agents
sharesfunction-calling
ChatMLX
🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large…
★ 832 · chat
sharesmlx

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.