RTX PRO 6000 Blackwell
96 GiB vendor-published framebuffer. Catalogue open-weight models that fit, ranked by measured quality. NVIDIA does not pick the winner.
96 GiB framebuffer. Source: https://www.nvidia.com/en-eu/design-visualization/desktop-graphics/
11 of 25 profiled open-weight models fit 96 GiB (vram) at F16, 8192 context. Best rated that fits: Gemma 4 31B.
rtx-pro-6000-blackwell: vendor 96 GiB framebuffer, not free-after-driver.
Among models that fit
Highest LMArena Elo among models that fit: Gemma 4 31B 1443.4. Elo is a human-preference scale, not the intelligence index.
The arena boards are separate scales and are never blended. A missing cell is unmeasured, not zero. A model’s highest axis is relative to its own scores, not a claim it leads the catalogue.
Rated models that fit
| Model | Human preference | Quant that fits | Estimated GiB | Headroom |
|---|---|---|---|---|
Gemma 4 31B Fit assumptions
| 1443.4 | F16 | 62.41 | 33.59 |
Qwen3.8 27B Fit assumptions
| 1440.7 | F16 | 55.5 | 40.5 |
gpt-oss-120b Fit assumptions
| 1365.4 | Q5_K_M | 82 | 14 |
Phi 4 Fit assumptions
| 1216.7 | F16 | 30.563 | 65.438 |
Fits, unrated
- Mistral Small 4 — Q5_K_M, 82.813 GiB unrated
- Command A — Q5_K_M, 77.313 GiB unrated
- Llama 4 Scout — Q5_K_M, 75.938 GiB unrated
- Muse Glimmer 30B — F16, 60.606 GiB unrated
- Ministral 3 14B 2512 — F16, 30.05 GiB unrated
- Ministral 3 8B 2512 — F16, 19.663 GiB unrated
- Ministral 3 3B 2512 — F16, 9.413 GiB unrated
Does not fit, or not profiled
- cohere/command-a-plus — even Q4_K_M wants 132.618 GiB; pool is 96 GiB
- deepseek/deepseek-v4-flash-vision-exp — even Q4_K_M wants 184.902 GiB; pool is 96 GiB
- z-ai/glm-5.3 — even Q4_K_M wants 455.624 GiB; pool is 96 GiB
- qwen/qwen3.8-2.4t-a95b — even Q4_K_M wants 1450.719 GiB; pool is 96 GiB
- moonshotai/kimi-k3 — even Q4_K_M wants 1691.5 GiB; pool is 96 GiB
- z-ai/glm-5.2 — even Q4_K_M wants 455.624 GiB; pool is 96 GiB
- moonshotai/kimi-k2.7-code — even Q4_K_M wants 604.75 GiB; pool is 96 GiB
- nvidia/nemotron-3-ultra-550b-a55b — even Q4_K_M wants 333.063 GiB; pool is 96 GiB
- minimax/minimax-m3 — even Q4_K_M wants 259.405 GiB; pool is 96 GiB
- deepseek/deepseek-v4-pro — even Q4_K_M wants 967 GiB; pool is 96 GiB
- deepseek/deepseek-v4-flash — even Q4_K_M wants 172.465 GiB; pool is 96 GiB
- mistralai/mistral-large-2512 — even Q4_K_M wants 408.531 GiB; pool is 96 GiB
- deepseek/deepseek-v3.2 — even Q4_K_M wants 406.116 GiB; pool is 96 GiB
- meta-llama/llama-4-maverick — even Q4_K_M wants 242.5 GiB; pool is 96 GiB
How the number is made
Weights: a measured GGUF size when we have one, otherwise total parameters × bits per weight ÷ 8. Q4_K_M is treated as 4.83 bits/param. MoE memory uses total parameters, not active parameters.
KV cache, when layer and head geometry is sourced: 2 × kvLayers × kvHeads × headDim × context × 2 bytes (FP16, batch 1). Hybrid models use attention-layer count, not every layer. If geometry is missing, cache is omitted and that is stated.
1 GiB is added for CUDA/runtime. Apple unified memory uses RAM as the pool. CPU-only is a memory fit, not a speed claim. DDR generation is ignored for fit — it changes bandwidth, not whether the weights sit in memory.
RAM type (DDR4/DDR5/LPDDR) is not a field. It does not change whether a model fits.
Questions this page answers
What LLM can I run on a RTX PRO 6000 Blackwell?
11 of 25 profiled open-weight models fit 96 GiB (vram) at F16, 8192 context. Best rated that fits: Gemma 4 31B.
How much memory does a RTX PRO 6000 Blackwell have?
96 GiB vendor-published framebuffer (https://www.nvidia.com/en-eu/design-visualization/desktop-graphics/), not free-after-driver.
Does NVIDIA pick the winner?
No. Ranking is arithmetic on sourced parameter counts. Quality leads. Unrated models that fit are listed separately, never scored zero.