About
What this is, where the numbers come from, and what to trust.
What it is
CanItRunLocal answers one question: will a given model actually run on a given machine, and how fast? Two independent tools do that —
- Browse — crowdsourced Hardware × Model × Runtime performance reports.
- Calculator — a deterministic memory-fit estimate you can run for hardware you don't own yet. No account needed.
Performance reports (Browse)
Every report is submitted by a person who ran the model. Reports are grouped into buckets keyed on a normalized hardware identity × model × runtime, so independent reports on equivalent rigs land together.
A bucket's status:
- Verified — two or more reports whose generation speed agrees within ~10%.
- Conflicting — reports split into more than one cluster; both are shown rather than averaged away.
- Unverified — a single report so far.
Models, hardware & runtimes
- Models — synced daily from Hugging Face GGUF repositories (base model → variant → quant). Never user-submitted.
- Hardware specs (VRAM, memory bandwidth) — synced from a curated local-hardware spec catalog.
- Runtimes — a curated list: llama.cpp, Ollama, LM Studio, vLLM, MLX.
The calculator
A closed-form estimate: model weights (parameters × bits-per-weight) plus KV cache at the chosen context length, against the rig's usable memory. It never invents data — if a table it needs is empty, it says so rather than guessing. Treat the result as a fit estimate, not a benchmark.
Limitations
- Reports are self-reported and un-audited; convergence across independent submissions is the only verification.
- The calculator models memory fit, not throughput — a model that fits can still be slow.
- Free-text hardware entries are normalized, not fuzzy-matched, so near-identical rig strings may not yet share a bucket.
Have numbers to add? Submit a report.