inference-server

7 Projekte teilen dieses GitHub-Topic

Linien verbinden Mitglieder, die messbar miteinander verwandt sind. Die Punktgröße spiegelt die Sterne wider.

🧬 Mitglieder

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu…

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server and Mac app…

Open-source inference server and production cluster for all the models your agent needs.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and…

Turn any computer or edge device into a command center for your computer vision projects.

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX,…

TurboOCR, >200 img/s OmnidocBench. TensorRT FP16, PP-OCRv6, HTTP + gRPC

🔗 Verwandte Familien

apple-silicon 46 mlx 39 openai-api 68 anthropic-api 13 local-llm 60 openai-compatible 42 tool-calling 35 inference 81

Gemessen anhand der von beiden Projekten geteilten GitHub-Themen, gewichtet nach der Seltenheit jedes Themas.