node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Run AI models on your computer using simple commands and enforce structured output formats.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Get an email alert on its next release or when it starts trending — never miss the moment.
Free · no card · unsubscribe anytimeRun AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
node-llama-cpp has 2.2k stars on GitHub. It has been forked 215 times. node-llama-cpp is written mainly in TypeScript. It has been in active development since 2023. node-llama-cpp is available under the MIT license. Its main topics are ai, bindings, catai, cmake.
What is node-llama-cpp?
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Is node-llama-cpp open source?
node-llama-cpp is an open-source project. It is released under the MIT license.
Is node-llama-cpp free?
Yes. node-llama-cpp is free and open source — you can use, modify and self-host it.
What license does node-llama-cpp use?
node-llama-cpp is available under the MIT license.
What language is node-llama-cpp written in?
node-llama-cpp is written mainly in TypeScript.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://olud.ai/project/withcatai-node-llama-cpp.html)
