Budget Pick
AMD Radeon RX 7900 XT20 GB VRAM · ~45.7 tok/s
Lowest cost that meets recommended VRAM
Check price on AmazonCompatibility Check
Mistral Small 24B is a 24B parameter model from the Mistral family. Check if your hardware can handle it.
Send this page to a friend or teammate so they can check whether Mistral Small 24B fits their hardware too.
Social proof
33% of 1,597 scanned PCs run Mistral Small 24B fully on GPU.
1,109 keep at least some work on GPU. Based on anonymous compatibility checks.
Beginner tip: minimum values mean the model can start, while recommended values usually feel smoother during real use. VRAM is your GPU's dedicated memory; RAM is your system memory used as fallback. See the full glossary.
| Quantization | File Size | Min VRAM | Recommended VRAM | Min RAM | Context |
|---|---|---|---|---|---|
| Q4_K_MEasiest | 14 GB | 16 GB | 20 GB | 20 GB | 8K / 32K |
| Q8_0 | 25 GB | 27 GB | 32 GB | 32 GB | 8K / 32K |
Not sure your GPU has enough VRAM? Compare GPUs that can run Mistral Small 24B.
These GPUs meet the recommended 20 GB VRAM for the Q4_K_M quantization. Estimated speeds are approximate and assume full GPU offloading.
Budget Pick
AMD Radeon RX 7900 XT20 GB VRAM · ~45.7 tok/s
Lowest cost that meets recommended VRAM
Check price on AmazonFastest Pick
NVIDIA GeForce RTX 509032 GB VRAM · ~102.4 tok/s
Highest estimated throughput
Check price on AmazonBest Value
NVIDIA GeForce RTX 409024 GB VRAM · ~57.6 tok/s
Best speed per dollar of VRAM
Rent on RunPodNeed a detailed comparison? See all GPU rankings for Mistral Small 24B.
Strong OpenClaw Model Candidate
Mistral Small 24B is a common OpenClaw pick for local agent workflows. Use this model with Ollama, llama.cpp, or LM Studio, then confirm full OpenClaw hardware compatibility.
Why choose Mistral Small 24B?
General-purpose local model brief
Quantization tip: Benchmark at least two quantizations and validate with a task-specific eval set before production use.