Compatibility Check
Can I Run Phi-3 Medium 14B on NVIDIA GeForce RTX 2080 Ti?
Mostly — NVIDIA GeForce RTX 2080 Ti runs Phi-3 Medium 14B (Q4_K_M) with partial GPU offload. Expect slower speeds than a fully fitting card.
Estimated ~42.1 tokens/sec on the Q4_K_M quantization.
Partial GPU
Best variant: Q4_K_M
Partial GPU offload — 11 GB VRAM is above the 9.5 GB minimum but below the 12 GB recommendation. Some layers will spill to RAM.
- GPU VRAM
- 11 GB
- Min VRAM (best fit)
- 9.5 GB
- Recommended VRAM
- 12 GB
- Estimated tok/s
- ~42.1
Share this matchup
Send this page so a friend can see if NVIDIA GeForce RTX 2080 Ti fits Phi-3 Medium 14B.
Every Phi-3 Medium 14B quantization on NVIDIA GeForce RTX 2080 Ti
Each row runs the compatibility engine against your VRAM, RAM, and the model's requirements.
| Quantization | File Size | Min VRAM | Rec VRAM | Context | Verdict | Estimated tok/s |
|---|---|---|---|---|---|---|
| Q4_K_MBest fit | 8.2 GB | 9.5 GB | 12 GB | 4K / 4K | Partial GPU | ~42.1 |
| Q8_0 | 14.8 GB | 16 GB | 20 GB | 4K / 4K | Hybrid CPU+GPU | ~13 |
NVIDIA GeForce RTX 2080 Ti is solid pick for Phi-3 Medium 14B
Need second card or fresh build? These links help support site at no extra cost.