The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output a
Chat with large language models and get structured responses using a simple interface for your projects.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeThe llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output a
llama-cpp-agent has 650 stars on GitHub. It has been forked 71 times. llama-cpp-agent is written mainly in Python. It has been in active development since 2023. Its main topics are agents, function-calling, llamacpp, llm.
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output a
llama-cpp-agent is an open-source project.
Yes. llama-cpp-agent is free and open source — you can use, modify and self-host it.
llama-cpp-agent is written mainly in Python.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/maximilian-winter-llama-cpp-agent.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.