Q2_K
145 GBMin VRAM: 150 GB
Recommended VRAM: 160 GB
Min RAM: 160 GB
Context: 4K / 128K
Loading model details...
Fetching variants, compatibility details, and metadata.
Loading model details...
Fetching variants, compatibility details, and metadata.
New to local models? Smaller quantization variants are easier to run, while larger ones can improve quality at the cost of more memory.
Q2_K
145 GBMin VRAM: 150 GB
Recommended VRAM: 160 GB
Min RAM: 160 GB
Context: 4K / 128K
Q4_K_M
230 GBMin VRAM: 235 GB
Recommended VRAM: 256 GB
Min RAM: 256 GB
Context: 4K / 128K
| Quantization | File Size | Min VRAM | Recommended VRAM | Min RAM | Context |
|---|---|---|---|---|---|
| Q2_K | 145 GB | 150 GB | 160 GB | 160 GB | 4K / 128K |
| Q4_K_M | 230 GB | 235 GB | 256 GB | 256 GB | 4K / 128K |