serving

12 Projekte teilen dieses GitHub-Topic

Linien verbinden Mitglieder, die messbar miteinander verwandt sind. Die Punktgröße spiegelt die Sterne wider.

🧬 Mitglieder

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for…

A flexible, high-performance serving system for machine learning models

A Cloud Native Batch System (Project under CNCF)

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

Deep-Learning-in-Production

In this repository, I will share some useful notes and references about deploying deep learning-based models…

A minimal Python framework for building custom AI inference servers with full control over logic, batching,…

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

tensorflow_template_application

TensorFlow template application for deep learning

llm-applications

A comprehensive guide to building RAG-based LLM applications for production.

A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible)…

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

🔗 Verwandte Familien

inference 94 deployment 25 llm-serving 23 ray 14 vllm 47 model-serving 26 rest-api 19 distributed 31

Gemessen anhand der von beiden Projekten geteilten GitHub-Themen, gewichtet nach der Seltenheit jedes Themas.