Python
LLMWare
Enterprise RAG with small specialised models
by llmware-ai · Apache-2.0
LLM / RAG frameworkRAG frameworkApache-2.0Runs locallyPythonIntermediate
From the README
Install
git clone [email protected]:llmware-ai/llmware.git
- 20 OV-optimized encoding models with OVEmbeddingModel class - supports wide of embedding, reranker and classifers, e.g.,
- usingopenvinoembeddingmodel
- usingopenvinorerankermodel
- usingopenvinoclassifiermodel
Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.
A high count usually means the project is heavily examined. A low count usually means it is little examined — not that it is safe.
No public activity signals for this tool — it has no open repository we can measure.
🐳 Docker pulls
📦 PyPI downloads / month
📦 npm downloads / month
🚀 Latest release ·
What is LLMWare?
LLMWare focuses on RAG pipelines built from small, specialised models that run on CPU, aimed at private enterprise deployments.
Why people choose LLMWare
- Runs specialised small models on CPU
- Complete RAG pipeline out of the box
- Built for private deployments
LLMWare at a glance
| Category | LLM / RAG framework |
| Type | RAG framework |
| License | Apache-2.0 |
| Runs locally | Yes |
| Built with | Python |
| Skill level | Intermediate |
| Best for | private RAG on modest hardware |
Latest releases
Open-source alternatives to LLMWare
Other open-source llm / rag framework tools worth comparing:
LangChainCompose chains, tools and agents
LlamaIndexThe data framework for RAG
HaystackProduction pipelines for search and RAG
DSPyProgram — not prompt — language models
txtaiAll-in-one embeddings database
RAGFlowDeep-document-understanding RAG
Semantic KernelMicrosoft's enterprise agent frameworkGraphRAGRAG that builds a knowledge graph first
LiteLLMOne API for 100+ LLM providers
InstructorReliable structured outputs from LLMs
OutlinesGuarantee valid JSON and grammars
GuidanceInterleave control and generation
FlashRankUltra-light reranking for better RAG
Sentence TransformersThe standard way to make embeddings
RagasMeasure whether your RAG is any good
PromptfooUnit tests for your prompts
LangfuseSee what your LLM app actually did
PhoenixTrace, evaluate and debug LLM appsLLMWare head-to-head
LLMWare vs LangChainLLMWare vs LlamaIndexLLMWare vs HaystackLLMWare vs DSPyLLMWare vs txtaiLLMWare vs RAGFlowLLMWare vs Semantic KernelLLMWare vs GraphRAGLLMWare vs LiteLLMLLMWare vs InstructorLLMWare vs OutlinesLLMWare vs GuidanceLLMWare vs FlashRankLLMWare vs Sentence TransformersLLMWare vs RagasLLMWare vs PromptfooLLMWare vs LangfuseLLMWare vs Phoenix
FAQ
Is LLMWare free?
LLMWare is free and open-source (Apache-2.0 license), so you can use, self-host and modify it at no cost.
Can I run LLMWare locally?
Yes. LLMWare is designed to run on your own machine or server, keeping your data private.
What is the best alternative to LLMWare?
Popular open-source alternatives include LangChain, LlamaIndex, Haystack. See the comparisons above to choose.
Explore more open-source AI
Browse the full directory of open-source AI tools, models and projects — updated daily.
Browse all tools →