llamacpp

27 progetti condividono questo topic GitHub

Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.

🧬 Membri

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule…

Unified framework for building enterprise RAG pipelines with small, specialized models

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your…

runanywhere-sdks

Production ready toolkit to run AI locally

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and…

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make…

State of the Art Natural Language Processing

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and…

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to…

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and…

Instant, controllable, local pre-trained AI models in Rust

Text-To-Speech, RAG, and LLMs. All local!

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙…

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

The easiest way to use Ollama in .NET

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

The most advanced, fully offline client-side AI suite on Android today.

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs).…

Creates an index of images, queries a local LLM and adds tags to the image metadata

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…

🔗 Famiglie affini

gemma 30 gguf 21 mistral 42 llama-cpp 23 llama2 41 on-device-ai 24 whisper 30 local-ai 45

Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.