Compatibility Check
Can I Run Devstral Small 2 24B on AMD Radeon RX 7900 XT?
Yes — AMD Radeon RX 7900 XT runs Devstral Small 2 24B fully on GPU at the Q5_K_M quantization.
Estimated ~46.4 tokens/sec on the Q5_K_M quantization.
Full GPU
Best variant: Q5_K_M
Full GPU inference — 20 GB VRAM meets the 19.5 GB recommendation.
- GPU VRAM
- 20 GB
- Min VRAM (best fit)
- 17.3 GB
- Recommended VRAM
- 19.5 GB
- Estimated tok/s
- ~46.4
Share this matchup
Send this page so a friend can see if AMD Radeon RX 7900 XT fits Devstral Small 2 24B.
Every Devstral Small 2 24B quantization on AMD Radeon RX 7900 XT
Each row runs the compatibility engine against your VRAM, RAM, and the model's requirements.
| Quantization | File Size | Min VRAM | Rec VRAM | Context | Verdict | Estimated tok/s |
|---|---|---|---|---|---|---|
| Q4_K_M | 12 GB | 13.8 GB | 15.6 GB | 8K / 8K | Full GPU | ~53.3 |
| Q5_K_MBest fit | 15 GB | 17.3 GB | 19.5 GB | 8K / 8K | Full GPU | ~46.4 |
| Q8_0 | 24 GB | 27.6 GB | 31.2 GB | 8K / 8K | Hybrid CPU+GPU | ~10 |
| FP16 | 48 GB | 55.2 GB | 62.4 GB | 8K / 8K | Can't Run | — |
AMD Radeon RX 7900 XT is solid pick for Devstral Small 2 24B
Need second card or fresh build? These links help support site at no extra cost.