Official documentationNot tested by BlueFish
llama.cpp
A C/C++ language-model inference project for multiple local hardware backends.
A quick glossary
Models generate and reason. Agents use tools to work on tasks. A harness manages an agent’s environment. MCP connects tools and data. Skills are reusable task guidance.
Research notes
A C/C++ language-model inference project for multiple local hardware backends.
Validation
- A C/C++ language-model inference project for multiple local hardware backends.
Cost
Free software; check license and compute costs
Source code is public; model licensing, hardware, electricity and hosting are separate. Total cost is not verified.
Limits & boundaries
- Model format, quantization, context and hardware jointly determine resources; no universal hardware guarantee is given.
- Official documentation reviewed; this site has not run this combination or tested the device.
Original sources
- llama.cpp official documentation ↗
github.com · 2026-10-15 · Official documentation