inference-engine

14 progetti condividono questo topic GitHub

Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.

🧬 Membri

✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field…

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and…

OneDiff: An out-of-the-box acceleration library for diffusion models.

Large-scale LLM inference engine

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.…

MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)

A highly optimized LLM inference acceleration engine for Llama and its variants.

Python Computer Vision & Video Analytics Framework With Batteries Included

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over…

https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with…

PyTorch library for cost-effective, fast and easy serving of MoE models.

🔗 Famiglie affini

inference 94 cuda 90 llm-inference 76 model-serving 26 mlops 103 yolo 59 diffusers 28 lora 65

Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.