Skip to main content
Full GPU

Best variant: Q8_0

Full GPU inference — 256 GB VRAM meets the 159.9 GB recommendation.

GPU VRAM
256 GB
Min VRAM (best fit)
141.5 GB
Recommended VRAM
159.9 GB
Estimated tok/s
~8.5

Share this matchup

Send this page so a friend can see if Apple M4 Ultra fits Devstral 2 123B.

Every Devstral 2 123B quantization on Apple M4 Ultra

Each row runs the compatibility engine against your VRAM, RAM, and the model's requirements.

QuantizationFile SizeMin VRAMRec VRAMContextVerdictEstimated tok/s
Q4_K_M61.5 GB70.7 GB80 GB8K / 8KFull GPU~14.2
Q5_K_M76.9 GB88.4 GB100 GB8K / 8KFull GPU~12.3
Q8_0Best fit123 GB141.5 GB159.9 GB8K / 8KFull GPU~8.5
FP16246 GB282.9 GB319.8 GB8K / 8KCan't Run

Apple M4 Ultra is solid pick for Devstral 2 123B

Need second card or fresh build? These links help support site at no extra cost.

All hardware for Devstral 2 123BBest GPU for Devstral 2 123BModels that fit Apple M4 UltraFull model detailsBrowse all models