What Magnitude does
Magnitude is an inference engine for agents that tunes itself to the user hardware. It ships as a desktop app for macOS, Linux, and Windows that runs open models locally. Named features include kernels tuned on the device before a model runs, hand-optimized kernels for popular open-weight model families, memory freed when agents stop, shared prefix caches for concurrent sessions, and one-click connection to agents such as Pi, OpenCode, Hermes, Codex, and Claude Code. An OpenAI-compatible API serves other agents. Prompts, files, and models stay on the user machine, and no internet connection is needed once a model is downloaded. Pricing is free, and the software is open source under the Apache 2.0 license.
How Magnitude compares with its closest alternatives
3 of the 5 closest alternatives have a free plan, as Magnitude does. All 5 offer an API, as Magnitude does. Magnitude offers a web app. Of the alternatives, 4 offer a web app. Magnitude was founded in 2024; the alternatives were founded between 2023 and 2024, 4 of them earlier. The alternatives with a known headquarters are in Singapore and the United States.