PowerInfer
Run large language models locally
An open-source inference engine for running large language models on local machines.
Pricing label: see the product site.
Open PowerInferIs this your tool? Feature it
More in this area
AI Apps & Frameworks
0xPlaygrounds/rig
Rig is a Rust framework for building modular, scalable applications powered by large language models.
See siteVisit
AI Apps & Frameworks
10Web
Build and manage WordPress websites with AI.
See siteVisit
AI Apps & Frameworks
abso
Call many language model providers through one TypeScript SDK.
See siteVisit