inference-server

6 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu…

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and…

Open-source inference server and production cluster for all the models your agent needs.

Turn any computer or edge device into a command center for your computer vision projects.

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX,…

TurboOCR, >200 img/s OmnidocBench. TensorRT FP16, PP-OCRv6, HTTP + gRPC

🔗 Familias relacionadas

apple-silicon 37 mlx 29 openai-api 61 vllm 35 inference 74 tensorrt 8 containers 12 cuda 78

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.