All rankings / Coding and agents

Agents · explicit task outcomes

Agent Arena signal scores from the official dataset. Each signal is a separate measurement; it is not a success percentage.

58 entries · IPS score · Higher is better

Source publication: 2026-11-04. Retrieved 2026-11-05.

Source: Arena (lmarena-ai) · CC-BY-4.0.

Ranks use confidence bounds. Several models can share a rank; the rows within a shared rank are displayed by score.

Agents · explicit task outcomes · IPS score
Significance rankModel / evaluated variantIPS score95% confidence intervalObservations
1Claude Opus 5.5 (Max)anthropic0.2114940.179358 – 0.2436294,352
1Claude Sonnet 5.5 (Max)anthropic0.2020960.158045 – 0.2461462,205
1Gemini 4 Carbon (High)google0.1802130.16765 – 0.19277622,690
2GPT-6 Astra (Max)openai0.1416850.108107 – 0.1752636,555
4Gemini 4 Argon (High)google0.1336710.118328 – 0.14901326,963
2Claude Fable 5.1 (Max)anthropic0.1329050.097311 – 0.1684987,487
4GPT-6.1 Sol (Max)openai0.1218950.102325 – 0.14146612,235
4Muse Wonder Full (Max)meta0.1144160.096455 – 0.13237716,254
4Claude Opus 5 (Max)anthropic0.1138340.090077 – 0.1375918,539
4GPT-6.1 Terra (Max)openai0.1113360.083964 – 0.13870710,041
6Hy4tencent0.0739510.041718 – 0.1061844,692
9Muse Wonder (Max)meta0.0633070.034035 – 0.0925798,073
11Claude Fable 5 (High)anthropic0.0564830.034532 – 0.07843436,809
11MiMo-V2.6-Flashxiaomi0.0550390.032476 – 0.07760113,651
10Grok 4.7 (xHigh)xai0.0534060.02237 – 0.0844429,073
11MiMo-V2.6-Proxiaomi0.0524910.033002 – 0.0719821,044
11Hy4 previewtencent0.0454710.029889 – 0.06105436,269
11Qwen3.8-Maxalibaba0.0433770.029049 – 0.05770442,576
11Kimi K3.1 Pro (Max)moonshot0.0401770.011919 – 0.06843610,202
11Muse Spark 1.3 (Max)meta0.0397820.021949 – 0.05761544,614
11Kimi K3 (Max)moonshot0.0374580.024496 – 0.05042199,584
11GPT-6 Sol (Max)openai0.0353760.001195 – 0.0695566,126
11DeepSeek-V4.1-Flash-20261017 (Max)deepseek0.0337710.020559 – 0.04698235,025
11GLM-5.3 (Max)zai0.0319220.014407 – 0.04943658,030
11GLM-5.2 (Max)zai0.0253850.00849 – 0.04227957,302
12GLM-5.3-Flashzai0.023160.007056 – 0.03926459,023
11GPT-5.6 Sol (xHigh)openai0.019726-0.002776 – 0.04222931,493
12Claude Haiku 5.5 (High)anthropic0.014338-0.010339 – 0.03901416,264
17Gemini 3.8 Flash (High)google0.011985-0.005741 – 0.02971128,414
11MiniMax-M3.1-Flashminimax0.010977-0.026916 – 0.0488714,626
21Qwen3.8-Flash-Nextalibaba0.003862-0.013584 – 0.02130741,035
18Claude Sonnet 5 (High)anthropic-0.00023-0.02637 – 0.0259127,267
25GPT-6 Luna (Max)openai-0.001673-0.011665 – 0.008318110,526
18Step 5 Previewstepfun-0.004597-0.036741 – 0.0275467,033
25Grok 4.6 (xHigh)xai-0.018889-0.045235 – 0.00745617,841
28Qwen3.8-27Balibaba-0.02419-0.043734 – -0.00464631,813
24DeepSeek-V4-Pro (High, 20260813)deepseek-0.027969-0.066191 – 0.0102533,402
31Gemini 3.7 Flash (High)google-0.031184-0.050586 – -0.01178243,575
26Mistral Large 4mistral-0.04311-0.089689 – 0.003472,389
37GPT-6 Luna (Medium)openai-0.062334-0.075377 – -0.04929236,762
37Muse Spark 1.1meta-0.065335-0.080794 – -0.04987686,947
38GPT-5.6 Terra (xHigh)openai-0.073179-0.091222 – -0.05513529,566
35Spark-X2.6synlan-0.078792-0.116422 – -0.0411624,124
39Muse Spark 1.2 (xHigh)meta-0.091773-0.113193 – -0.07035330,983
38Qwen3.7-Plusalibaba-0.092098-0.128426 – -0.0557715,743
40Qwen3.7-Maxalibaba-0.103331-0.130636 – -0.07602728,968
37Beam 1.0 501B A23Breflection-0.106308-0.1649 – -0.0477175,050
41MiMo-V2.5-Proxiaomi-0.108486-0.132301 – -0.08467129,180
41Hy3tencent-0.116695-0.147749 – -0.08564213,853
42Gemini 3.1 Pro Previewgoogle-0.119168-0.147388 – -0.09094769,499
48GPT-6 Luna (Low)openai-0.152584-0.170912 – -0.13425622,963
46Mistral Medium 3.5mistral-0.170482-0.210413 – -0.1305527,353
50MiniMax-M3minimax-0.176701-0.20539 – -0.14801126,992
50NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4)nvidia-0.186147-0.209256 – -0.16303710,821
50Nemotron 3 Ultranvidia-0.233662-0.310611 – -0.1567124,275
55Inkling-Smallthinky-0.264232-0.31302 – -0.2154447,078
55Inklingthinky-0.270384-0.309389 – -0.23137924,084
55Solar Pro 4upstage-0.307814-0.366177 – -0.2494524,588

What this ranking can tell you

  • The population is the models in this source board, including variants and models without an available API price.
  • Ranks use the published confidence bounds: one plus the number of models whose lower bound exceeds this model’s upper bound. Shared ranks are not proof of equal performance.

Check the source

The original evidence is retained byte for byte. The downloadable board includes the source URLs, revision and SHA-256 hashes.

Download this board and provenance →

Source files and licences

Explore other model types →Read the benchmark guide →

Evidence & Ask