Skip to main content
Full GPU

Best variant: Q4_K_M

Full GPU inference — 32 GB VRAM meets the 4 GB recommendation.

GPU VRAM
32 GB
Min VRAM (best fit)
2.5 GB
Recommended VRAM
4 GB
Estimated tok/s
~88.9

Share this matchup

Send this page so a friend can see if Apple M1 Pro (16-core GPU) fits StarCoder2 3B.

Every StarCoder2 3B quantization on Apple M1 Pro (16-core GPU)

Each row runs the compatibility engine against your VRAM, RAM, and the model's requirements.

QuantizationFile SizeMin VRAMRec VRAMContextVerdictEstimated tok/s
Q4_K_MBest fit1.8 GB2.5 GB4 GB4K / 16KFull GPU~88.9

Apple M1 Pro (16-core GPU) is solid pick for StarCoder2 3B

Need second card or fresh build? These links help support site at no extra cost.

All hardware for StarCoder2 3BBest GPU for StarCoder2 3BModels that fit Apple M1 Pro (16-core GPU)Full model detailsBrowse all models