Q4_K_M
1 GBMin VRAM: 1.2 GB
Recommended VRAM: 1.3 GB
Min RAM: 2 GB
Context: 8K / 8K
Loading model details...
Fetching variants, compatibility details, and metadata.
Loading model details...
Fetching variants, compatibility details, and metadata.
Share Gemma 3n E2B with someone who is deciding what to run locally.
Social proof
79% of 982 scanned PCs run Gemma 3n E2B fully on GPU.
776 keep at least some work on GPU. Based on anonymous compatibility checks.
General-purpose local model brief
Best for
Consider alternatives if
Quantization tip: Benchmark at least two quantizations and validate with a task-specific eval set before production use.
New to local models? Smaller quantization variants are easier to run, while larger ones can improve quality at the cost of more memory.
Q4_K_M
1 GBMin VRAM: 1.2 GB
Recommended VRAM: 1.3 GB
Min RAM: 2 GB
Context: 8K / 8K
Q5_K_M
1.3 GBMin VRAM: 1.5 GB
Recommended VRAM: 1.7 GB
Min RAM: 2 GB
Context: 8K / 8K
Q8_0
2 GBMin VRAM: 2.3 GB
Recommended VRAM: 2.6 GB
Min RAM: 3 GB
Context: 8K / 8K
FP16
4 GBMin VRAM: 4.6 GB
Recommended VRAM: 5.2 GB
Min RAM: 6 GB
Context: 8K / 8K
| Quantization | File Size | Min VRAM | Recommended VRAM | Min RAM | Context |
|---|---|---|---|---|---|
| Q4_K_M | 1 GB | 1.2 GB | 1.3 GB | 2 GB | 8K / 8K |
| Q5_K_M | 1.3 GB | 1.5 GB | 1.7 GB | 2 GB | 8K / 8K |
| Q8_0 | 2 GB | 2.3 GB | 2.6 GB | 3 GB | 8K / 8K |
| FP16 | 4 GB | 4.6 GB | 5.2 GB | 6 GB | 8K / 8K |
These GPUs meet the recommended 1.3 GB VRAM for the Q4_K_M quantization. Estimated speeds are approximate and assume full GPU offloading.
Budget Pick
NVIDIA GeForce GTX 1060 3GB3 GB VRAM · ~153.6 tok/s
Lowest cost that meets recommended VRAM
Check price on AmazonFastest Pick
NVIDIA GeForce RTX 509032 GB VRAM · ~1433.6 tok/s
Highest estimated throughput
Check price on AmazonBest Value
NVIDIA GeForce RTX 3080 Ti12 GB VRAM · ~729.6 tok/s
Best speed per dollar of VRAM
Check price on AmazonNeed a detailed comparison? See all GPU rankings for Gemma 3n E2B.