llamacpp

36 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule…

Unified framework for building enterprise RAG pipelines with small, specialized models

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your…

runanywhere-sdks

Production ready toolkit to run AI locally

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and…

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No…

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make…

State of the Art Natural Language Processing

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and…

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to…

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and…

Instant, controllable, local pre-trained AI models in Rust

Text-To-Speech, RAG, and LLMs. All local!

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙…

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

generative_ai_with_langchain

Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph. This is…

The easiest way to use Ollama in .NET

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

🌌 Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app…

LSP server leveraging LLMs for code completion (and more?)

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

Llama 3+ inference in pure Java

The most advanced, fully offline client-side AI suite on Android today.

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs).…

Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions…

browser-operator-core

Browser Operator - The AI browser with built in Multi-Agent platform! Open source alternative to ChatGPT…

A simple "Be My Eyes" web app with a llama.cpp/llava backend

Kolosal AI is an OpenSource and Lightweight alternative to LM Studio to run LLMs 100% offline on your device.

Creates an index of images, queries a local LLM and adds tags to the image metadata

AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your…

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…

🔗 Familias relacionadas

huggingface 108 llama3 48 llama2 56 llm-inference 76 local-llm 50 mistral 66 gguf 26 local-ai 36

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.