llamacpp

28 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

★ 45.1k

khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule…

★ 37.9k

llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

★ 14.8k

koboldcpp

KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.

★ 12.1k

llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your…

★ 10.9k

runanywhere-sdks

Production ready toolkit to run AI locally

★ 10.3k

inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and…

★ 9.6k

cactus

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

★ 6.2k

llama-swap

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

★ 5k

spark-nlp

State of the Art Natural Language Processing

★ 4.2k

LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

★ 3.8k

twinny

Open-source AI coding assistant for VS Code. Coding agent, code completion, chat, edits and reviews with…

★ 3.7k · GitHub ↗

Bonsai-demo

Bonsai Demo

★ 3.4k

AGiXT

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and…

★ 3.2k

lsp-ai

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to…

★ 3.2k

ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and…

★ 3.1k

kalosm

Instant, controllable, local pre-trained AI models in Rust

★ 2.2k

Dot

Text-To-Speech, RAG, and LLMs. All local!

★ 1.9k

Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

★ 1.9k

paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙…

★ 1.7k

gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

★ 1.4k

OllamaSharp

The easiest way to use Ollama in .NET

★ 1.4k

Box

The most advanced, fully offline client-side AI suite on Android today.

★ 947

FineTuningLLMs

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

★ 876

Spark-X2.6

Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

★ 860 · GitHub ↗

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs).…

★ 650

ImageIndexer

Creates an index of images, queries a local LLM and adds tags to the image metadata

★ 397

OfflineLLM

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…

★ 274

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.