llama.cpp
The foundational C++ engine for running LLMs anywhere
Tools
In plain English
The open-source engine that unlocked running large language models on MacBooks and personal computers without cloud servers.
Technically
A lightweight, zero-dependency C/C++ inference engine created by Georgi Gerganov. Optimized for CPU, Apple Silicon Metal, and NVIDIA CUDA with extensive GGUF quantization support.