Open-Source AI · Tools

Open-Source AI Tools

A curated directory of 47 of the best open-source AI tools in 2026 — each with a deep-dive, alternatives and head-to-head comparisons. Search or filter by category.

Curated by olud.ai

Run LLMs locally

OllamaRun open LLMs locally from one commandLM StudioBrowse, download and chat with local modelsJanOpen-source, offline ChatGPT-style desktop appGPT4AllPrivate local AI that runs on CPUllama.cppThe C/C++ engine powering local inferenceLocalAIA drop-in OpenAI API you self-hostText Generation WebUIFeature-rich web UI for local models

Self-hosted chat UI

Open WebUIChatGPT-style interface over any modelLibreChatMulti-provider open-source ChatGPT cloneLobe ChatModern, design-forward chat frameworkAnythingLLMAll-in-one app to chat with your documents

AI image generation

ComfyUINode-graph control over image pipelinesAUTOMATIC1111The classic Stable Diffusion web UIFooocusMidjourney-like simplicity, zero tweakingInvokeAIPolished studio with a unified canvasSD.NextPower-user fork with broad model support

Inference server

vLLMHigh-throughput serving for productionTGIHugging Face's production text serverSGLangFast serving with structured outputsLMDeployToolkit for compressing and serving LLMs

Coding assistant

ContinueOpen-source autocomplete and chat in your IDEAiderAI pair programming in your terminalClineAutonomous coding agent in VS CodeRoo CodeCustomizable agentic coder (Cline fork)TabbySelf-hosted Copilot alternative

LLM / RAG framework

LangChainCompose chains, tools and agentsLlamaIndexThe data framework for RAGHaystackProduction pipelines for search and RAG

AI agent framework

CrewAIOrchestrate role-playing agent crewsAutoGenMicrosoft's conversational agent frameworkLangGraphStateful, controllable agent graphs

Low-code AI builder

DifyBuild and operate AI apps visuallyFlowiseDrag-and-drop LLM flowsLangflowVisual builder for agents and RAGn8nAutomate workflows with AI nodes

Vector database

QdrantFast Rust-based vector searchWeaviateVector DB with built-in modulesMilvusBillion-scale vector databaseChromaThe simplest embedding DB for prototypingpgvectorVector search inside PostgreSQL

Speech (STT / TTS)

WhisperOpenAI's open speech-to-text baselinefaster-whisperWhisper, much faster and lighterWhisperXWhisper plus word timestamps and diarizationPiperFast, local neural text-to-speech

Fine-tuning

UnslothFine-tune LLMs 2x faster on one GPUAxolotlConfig-driven fine-tuning for many modelsLLaMA-FactoryFine-tune 100+ models with a UI

Compare them head-to-head

See detailed side-by-side comparisons of these tools, with feature matrices and scores.

Open the comparisons →