Home Projects llmff
llmff
Rust

llmff

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any OpenAI-compatible local server, emitting JSONL traces, inspect reports, and stable exit codes.

by syndicalt · GitHub
Stars
Forks
Created
Last commit
Category
Language
Likely
Self-hostable
agent-toolscliinference-pipelineRustSelf-hostable
View on GitHub
In plain words

Run AI language model tasks locally with a command-line tool that tracks and validates data outputs.

You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
llmff — GitHub preview card
📈 Star history
4644
2026-07-202026-08-31
📈 Track llmff

Get an email alert on its next release or when it starts trending — never miss the moment.

Free · no card · unsubscribe anytime
Get email alerts →
📄 About

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any OpenAI-compatible local server, emitting JSONL traces, inspect reports, and stable exit codes.

llmff has 46 stars on GitHub. It has been forked 1 times. llmff is written mainly in Rust. It has been in active development since 2026. Its main topics are agent-tools, cli, inference-pipeline, json-schema.

Frequently asked questions

What is llmff?

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any OpenAI-compatible local server, emitting JSONL traces, inspect reports, and stable exit codes.

Is llmff open source?

llmff is an open-source project.

Is llmff free?

Yes. llmff is free and open source — you can use, modify and self-host it.

What language is llmff written in?

llmff is written mainly in Rust.

🏅 Maintainer of this project?
olud.ai badge — llmff

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![olud.ai](https://olud.ai/badge.php?tool=syndicalt-llmff)](https://olud.ai/project/syndicalt-llmff.html)
More badge options →
🧬 Related projects🧬 View the DNA map →