What Llama.cpp does
The go-to library for running quantized LLMs on CPU and GPU with minimal dependencies.
How Llama.cpp compares with its closest alternatives
All 5 closest alternatives have a free plan, as Llama.cpp does. All 5 offer an API, as Llama.cpp does. Llama.cpp offers a command-line tool. Of the 4 alternatives with platforms on record, 2 offer a command-line tool. Llama.cpp was founded in 2023; the alternatives were founded between 2023 and 2024. Llama.cpp has no single headquarters on record; its alternatives with a known headquarters are in the United States and China.