Self-host

80 GiB GPU

80 GiB is the vendor-published framebuffer on A100 80, H100. Same pool on every card in that list. Ranking is arithmetic on sourced parameter counts.

80 GiB framebuffer, taken from the sourced cards listed below. Not a free-after-driver figure.

11 of 25 profiled open-weight models fit 80 GiB (vram) at F16, 8192 context. Best rated that fits: Gemma 4 31B.

Weights 61.41 GiB KV not estimated Runtime 1 GiB Headroom 17.6 GiB / 80 GiB

VRAM as entered. Driver reservation is inside the 1 GiB overhead, not extra.

Among models that fit

Highest LMArena Elo among models that fit: Gemma 4 31B 1443.4. Elo is a human-preference scale, not the intelligence index.

The arena boards are separate scales and are never blended. A missing cell is unmeasured, not zero. A model’s highest axis is relative to its own scores, not a claim it leads the catalogue.

Rated models that fit

ModelHuman preferenceQuant that fitsEstimated GiBHeadroom
Gemma 4 31B
visionvideoreasoningtools
Fit assumptions
  • KV heads and head dim are not in the public size table we used. Cache is not estimated.
  • KV cache not estimated — layer/head geometry is not in the sourced profile. Longer context may not fit.
1443.4F1662.4117.59
Qwen3.8 27B
visionvideoreasoningtools
Fit assumptions
  • Hybrid: only 16 of 64 layers are Gated Attention. KV uses kvLayers=16, not nLayers=64. Measured Q4 is Unsloth UD-Q4_K_M, not a vanilla Q4_K_M.
1440.7F1655.524.5
gpt-oss-120b
reasoningtools
Fit assumptions
  • MoE: memory follows 117B total, not 5.1B active. Vendor 80GB claim is for MXFP4, not Q4_K_M. KV from the published config: 36 layers, 8 KV heads, head dim 64.
  • MoE: memory follows 117B total parameters, not 5.1B active.
1365.4Q4_K_M72.2017.799
Phi 4
Fit assumptions
  • Hub safetensors listing says 15B params; the card states 14B. We use the card. KV from config.json: 40 layers, 10 KV heads, hidden 5120 → head dim 128.
1216.7F1630.56349.438

Fits, unrated

Does not fit, or not profiled

  • cohere/command-a-plus — even Q4_K_M wants 132.618 GiB; pool is 80 GiB
  • deepseek/deepseek-v4-flash-vision-exp — even Q4_K_M wants 184.902 GiB; pool is 80 GiB
  • z-ai/glm-5.3 — even Q4_K_M wants 455.624 GiB; pool is 80 GiB
  • qwen/qwen3.8-2.4t-a95b — even Q4_K_M wants 1450.719 GiB; pool is 80 GiB
  • moonshotai/kimi-k3 — even Q4_K_M wants 1691.5 GiB; pool is 80 GiB
  • z-ai/glm-5.2 — even Q4_K_M wants 455.624 GiB; pool is 80 GiB
  • moonshotai/kimi-k2.7-code — even Q4_K_M wants 604.75 GiB; pool is 80 GiB
  • nvidia/nemotron-3-ultra-550b-a55b — even Q4_K_M wants 333.063 GiB; pool is 80 GiB
  • minimax/minimax-m3 — even Q4_K_M wants 259.405 GiB; pool is 80 GiB
  • deepseek/deepseek-v4-pro — even Q4_K_M wants 967 GiB; pool is 80 GiB
  • deepseek/deepseek-v4-flash — even Q4_K_M wants 172.465 GiB; pool is 80 GiB
  • mistralai/mistral-large-2512 — even Q4_K_M wants 408.531 GiB; pool is 80 GiB
  • deepseek/deepseek-v3.2 — even Q4_K_M wants 406.116 GiB; pool is 80 GiB
  • meta-llama/llama-4-maverick — even Q4_K_M wants 242.5 GiB; pool is 80 GiB

GPU

How the number is made

Weights: a measured GGUF size when we have one, otherwise total parameters × bits per weight ÷ 8. Q4_K_M is treated as 4.83 bits/param. MoE memory uses total parameters, not active parameters.

KV cache, when layer and head geometry is sourced: 2 × kvLayers × kvHeads × headDim × context × 2 bytes (FP16, batch 1). Hybrid models use attention-layer count, not every layer. If geometry is missing, cache is omitted and that is stated.

1 GiB is added for CUDA/runtime. Apple unified memory uses RAM as the pool. CPU-only is a memory fit, not a speed claim. DDR generation is ignored for fit — it changes bandwidth, not whether the weights sit in memory.

RAM type (DDR4/DDR5/LPDDR) is not a field. It does not change whether a model fits.

Self-host

Questions this page answers

What LLM can I run on a 80GB card?

11 of 25 profiled open-weight models fit 80 GiB (vram) at F16, 8192 context. Best rated that fits: Gemma 4 31B.

Which sourced cards publish 80 GiB?

A100 80 (80 GiB), H100 (80 GiB).

Does NVIDIA pick the winner?

No. Ranking is arithmetic on sourced parameter counts. Quality leads. Unrated models that fit are listed separately, never scored zero.

Evidence & Ask