Skip to main content
Full GPU

Best variant: FP16

Full GPU inference — 24 GB VRAM meets the 7.8 GB recommendation.

GPU VRAM
24 GB
Min VRAM (best fit)
6.9 GB
Recommended VRAM
7.8 GB
Estimated tok/s
~168

Share this matchup

Send this page so a friend can see if NVIDIA GeForce RTX 3090 Ti fits SmolLM3 3B.

Every SmolLM3 3B quantization on NVIDIA GeForce RTX 3090 Ti

Each row runs the compatibility engine against your VRAM, RAM, and the model's requirements.

QuantizationFile SizeMin VRAMRec VRAMContextVerdictEstimated tok/s
Q4_K_M1.5 GB1.7 GB2 GB8K / 8KFull GPU~537.6
Q5_K_M1.9 GB2.2 GB2.5 GB8K / 8KFull GPU~461.3
Q8_03 GB3.5 GB3.9 GB8K / 8KFull GPU~320
FP16Best fit6 GB6.9 GB7.8 GB8K / 8KFull GPU~168

NVIDIA GeForce RTX 3090 Ti is solid pick for SmolLM3 3B

Need second card or fresh build? These links help support site at no extra cost.

All hardware for SmolLM3 3BBest GPU for SmolLM3 3BModels that fit NVIDIA GeForce RTX 3090 TiFull model detailsBrowse all models