Skip to main content
Full GPU

Best variant: FP16

Full GPU inference — 10 GB VRAM meets the 10 GB recommendation.

GPU VRAM
10 GB
Min VRAM (best fit)
7.5 GB
Recommended VRAM
10 GB
Estimated tok/s
~118.8

Share this matchup

Send this page so a friend can see if NVIDIA GeForce RTX 3080 10GB fits Llama 3.2 3B.

Every Llama 3.2 3B quantization on NVIDIA GeForce RTX 3080 10GB

Each row runs the compatibility engine against your VRAM, RAM, and the model's requirements.

QuantizationFile SizeMin VRAMRec VRAMContextVerdictEstimated tok/s
Q4_K_M2 GB3 GB4 GB8K / 128KFull GPU~304
Q8_03.4 GB4.5 GB6 GB8K / 128KFull GPU~212.9
FP16Best fit6.4 GB7.5 GB10 GB8K / 128KFull GPU~118.8

NVIDIA GeForce RTX 3080 10GB is solid pick for Llama 3.2 3B

Need second card or fresh build? These links help support site at no extra cost.

All hardware for Llama 3.2 3BBest GPU for Llama 3.2 3BModels that fit NVIDIA GeForce RTX 3080 10GBFull model detailsBrowse all models