Q4_K_M
60 GBMin VRAM: 63 GB
Recommended VRAM: 68 GB
Min RAM: 68 GB
Context: 8K / 128K
Loading model details...
Fetching variants, compatibility details, and metadata.
New to local models? Smaller quantization variants are easier to run, while larger ones can improve quality at the cost of more memory.
Q4_K_M
60 GBMin VRAM: 63 GB
Recommended VRAM: 68 GB
Min RAM: 68 GB
Context: 8K / 128K
Q8_0
115 GBMin VRAM: 118 GB
Recommended VRAM: 128 GB
Min RAM: 128 GB
Context: 8K / 128K
| Quantization | File Size | Min VRAM | Recommended VRAM | Min RAM | Context |
|---|---|---|---|---|---|
| Q4_K_M | 60 GB | 63 GB | 68 GB | 68 GB | 8K / 128K |
| Q8_0 | 115 GB | 118 GB | 128 GB | 128 GB | 8K / 128K |