llama.cpp
Run language-model inference with a C and C++ runtime.
An open-source C and C++ runtime for executing language models, including LLaMA and other supported architectures.
Pricing label: see the product site.
Open llama.cppIs this your tool? Feature it
More in this area
AI Apps & Frameworks
0xPlaygrounds/rig
Rig is a Rust framework for building modular, scalable applications powered by large language models.
See siteVisit
AI Apps & Frameworks
10Web
Build and manage WordPress websites with AI.
See siteVisit
AI Apps & Frameworks
abso
Call many language model providers through one TypeScript SDK.
See siteVisit