All rankings / Language models

Text · style controlled

Human preference ratings for the overall category of this Arena task. Scores from different boards are not interchangeable.

419 entries · Arena score · Higher is better

Source publication: 2026-10-28. Retrieved 2026-11-05.

Source: Arena (lmarena-ai) · CC-BY-4.0.

Ranks use confidence bounds. Several models can share a rank; the rows within a shared rank are displayed by score.

Text · style controlled · Arena score
Significance rankModel / evaluated variantArena score95% confidence intervalVotes
1Gemini 4 Carbon (High)google1,527.511,518.1 – 1,536.924,403
1Gemini 4 Argon (High)google1,520.251,513.98 – 1,526.5311,889
2Claude Opus 5.5 (High)anthropic1,508.71,502.09 – 1,515.311,415
2Muse Wonder (Max)meta1,507.11,499.76 – 1,514.447,749
3Claude Fable 5.1 (Max)anthropic1,504.371,498.55 – 1,510.1817,178
3Claude Fable 5 (High)anthropic1,503.891,499.72 – 1,508.0745,341
3Claude Opus 4.6 (High)anthropic1,503.161,499.9 – 1,506.4384,512
3Claude Opus 4.7 (High)anthropic1,501.051,497.29 – 1,504.8165,110
7Claude Opus 4.6anthropic1,496.11,492.91 – 1,499.2889,324
4Gemini 3.8 Flash (High)google1,495.951,491.51 – 1,500.3847,803
4Muse Spark 1.3 (Max)meta1,495.051,489.8 – 1,500.2922,134
8Claude Opus 4.7anthropic1,493.721,489.96 – 1,497.4866,140
8Muse Spark 1.2 (xHigh)meta1,492.191,485.84 – 1,498.5411,724
9Claude Opus 5 (High)anthropic1,491.551,487.97 – 1,495.1373,167
9Claude Opus 5 (Max)anthropic1,490.51,485.81 – 1,495.235,531
9Muse Spark 1.1meta1,490.241,486.09 – 1,494.3846,354
9Gemini 3.7 Flash (High)google1,489.551,484.88 – 1,494.2232,289
9Muse Sparkmeta1,489.031,483.3 – 1,494.7514,140
10Kimi K3 (Max)moonshot1,488.191,483.75 – 1,492.6336,780
12Gemini 3.1 Pro Previewgoogle1,486.91,483.98 – 1,489.82132,547
13Gemini 3 Progoogle1,485.431,481.64 – 1,489.2242,057
13GPT-5.6 Sol (xHigh)openai1,484.911,480.67 – 1,489.1543,796
14Gemini 3.6 Flash (High)google1,483.161,478.73 – 1,487.5836,028
14Qwen3.8-Maxalibaba1,482.411,477.62 – 1,487.231,915
17Claude Opus 4.8 (High)anthropic1,481.711,477.85 – 1,485.5863,994
17GPT-5.5 (High)openai1,481.71,477.97 – 1,485.4269,377
13GPT-6.1 Sol (Max)openai1,481.331,474.28 – 1,488.389,367
17GLM-5.3 (Max)zai1,480.571,475.62 – 1,485.5226,606
13MiMo-V2.6-Proxiaomi1,479.71,470.28 – 1,489.124,037
22Gemini 3.5 Flash (High)google1,477.631,473.74 – 1,481.5248,376
19Claude Sonnet 5.5 (xHigh)anthropic1,477.151,470.37 – 1,483.9310,033
23GPT-5.5openai1,476.651,472.97 – 1,480.3370,949
22GLM-5.3-Flashzai1,476.521,471.86 – 1,481.1741,642
23Gemini 3.5 Flash (Medium)google1,476.411,472.26 – 1,480.5547,196
21DeepSeek-V4.1-Flash-20260910 (Max)deepseek1,476.231,470.13 – 1,482.3313,657
23GPT-5.2 Chat (20260210)openai1,475.661,471.62 – 1,479.735,974
22GPT-6 Astra (Max)openai1,475.651,469.72 – 1,481.5715,038
23GLM-5.2 (Max)zai1,475.291,471.21 – 1,479.3753,702
23GPT-5.4 (High)openai1,475.271,471.51 – 1,479.0464,748
23Grok 4.20 Beta 1xai1,474.611,470.05 – 1,479.1827,889
24Claude Opus 4.8anthropic1,474.441,470.6 – 1,478.2965,121
20Qwen3.7-Max-Previewalibaba1,473.71,463.97 – 1,483.443,932
27Claude Opus 4.5 (High, 32K, 20251101)anthropic1,473.691,469.86 – 1,477.5237,484
24GPT-5.5 Instantopenai1,473.171,468.16 – 1,478.1727,128
27Gemini 3 Flashgoogle1,472.751,468.41 – 1,477.0931,301
28Claude Sonnet 4.6anthropic1,471.951,468.44 – 1,475.4670,916
28Grok 4.20 Beta (Reasoning, 0309)xai1,471.741,468.07 – 1,475.4166,422
28Grok 4.20 Multi-Agent Beta (0309)xai1,470.711,467.01 – 1,474.4164,917
31Claude Opus 4.5 (20251101)anthropic1,469.681,466.54 – 1,472.8172,825
35GPT-5.6 Terra (xHigh)openai1,467.341,463.19 – 1,471.4848,166
34ERNIE 5.1baidu1,467.081,462.55 – 1,471.6239,469
40MiMo-V2.5-Proxiaomi1,466.61,463.09 – 1,470.1177,728
42Grok 4.5xai1,465.451,461.11 – 1,469.7839,801
43GLM-5.1zai1,465.381,461.86 – 1,468.966,771
33DeepSeek-V4-Pro (High, 20260813)deepseek1,465.061,458.44 – 1,471.679,787
45Grok 4.1 (Thinking)xai1,465.051,461.87 – 1,468.2366,470
43GPT-5.4openai1,465.041,461.36 – 1,468.7367,856
43Qwen3.5-Max-Previewalibaba1,464.641,459.76 – 1,469.5222,582
49Claude Sonnet 5 (High)anthropic1,461.741,457.71 – 1,465.7852,952
49Kimi K2.6moonshot1,460.961,456.53 – 1,465.3839,978
44Qwen3.6-Max-Previewalibaba1,460.211,452.02 – 1,468.415,419
53Grok 4.1xai1,4591,455.84 – 1,462.1768,599
55Gemini 3 Flash (Minimal)google1,458.371,455.35 – 1,461.3990,997
49GPT-6 Sol (Max)openai1,458.321,452.44 – 1,464.215,807
55DeepSeek-V4-Prodeepseek1,457.771,453.88 – 1,461.6757,572
55GLM-5zai1,457.241,452.99 – 1,461.4829,255
58Claude Sonnet 4.5 (High, 32K, 20250929)anthropic1,456.321,453.57 – 1,459.0883,892
58Dola Seed 2.0 Probytedance1,456.131,452.74 – 1,459.5279,094
58GPT-5.1 (High)openai1,455.71,451.99 – 1,459.4141,639
57Qwen3.7-Plusalibaba1,455.661,451.33 – 1,46042,011
57Gemini 3.5 Flash-Litegoogle1,455.661,451.18 – 1,460.1335,740
57Grok 4.6 (High)xai1,455.481,450.86 – 1,460.133,824
59Claude Sonnet 4.5 (20250929)anthropic1,455.051,452.19 – 1,457.9182,621
58DeepSeek-V4-Pro Preview (High)deepseek1,454.891,450.93 – 1,458.8654,870
57Hy3tencent1,454.481,448.6 – 1,460.3613,840
60GPT-5.6 Luna (xHigh)openai1,453.021,448.72 – 1,457.3241,317
58Gemma 4 31Bgoogle1,452.291,444.85 – 1,459.736,138
63GPT-5.3 Chatopenai1,450.111,445.87 – 1,454.3434,316
65Claude Opus 4.1 (Thinking 16K, 20250805)anthropic1,449.771,446.32 – 1,453.2249,535
65Kimi K2.5 (Thinking)moonshot1,449.751,446.47 – 1,453.0274,682
63ERNIE-5.0-Preview (1203)baidu1,448.491,441.99 – 1,454.989,802
63Step 5 Previewstepfun1,448.371,442 – 1,454.7511,355
73Claude Opus 4.1 (20250805)anthropic1,448.011,445.04 – 1,450.9877,213
68MiMo-V2-Proxiaomi1,447.761,443.1 – 1,452.4225,421
65MiMo-V2.6-Flashxiaomi1,447.591,441.79 – 1,453.3915,312
74GPT-5.4 mini (High)openai1,447.171,443.43 – 1,450.9263,432
75ERNIE 5.0 (0110)baidu1,446.141,442.25 – 1,450.0436,475
77Gemini 2.5 Progoogle1,445.411,442.95 – 1,447.87125,307
75GPT-4.5 Preview (2025-02-27)openai1,444.641,438.92 – 1,450.3514,547
77Qwen3.6-Plusalibaba1,4431,438.87 – 1,447.1348,126
80ChatGPT-4o Latest (20250326)openai1,442.651,439.84 – 1,445.4681,893
78Inklingthinky1,442.21,437.99 – 1,446.4145,472
80Grok 4.3xai1,441.631,438 – 1,445.2671,287
82Qwen3.5-397B-A17Balibaba1,441.41,438.35 – 1,444.4697,675
77GLM-4.7zai1,441.341,435.29 – 1,447.412,239
77Grok 4.7 (xHigh)xai1,441.231,435.48 – 1,446.9716,442
80GPT-6 Luna (Max)openai1,440.871,436.59 – 1,445.1486,478
84MiniMax-M3minimax1,439.241,435.49 – 1,442.9968,611
85DeepSeek-V4-Flash Preview (High)deepseek1,438.651,434.55 – 1,442.7651,763
86GPT-5.1openai1,438.531,434.94 – 1,442.1244,413
81Gemma 4 26B A4Bgoogle1,437.61,430.16 – 1,445.046,090
89GPT-5.2 (High)openai1,437.291,433.74 – 1,440.8449,628
89LongCat-Flash-Chat Exp (2602)meituan1,436.41,431.87 – 1,440.9329,244
90DeepSeek-V4-Flashdeepseek1,435.671,431.64 – 1,439.7151,944
81Beam 1.0 501B A23Breflection1,435.671,426.35 – 1,444.994,233
89Qwen3.8-27Balibaba1,435.61,430.73 – 1,440.4727,779
92GPT-5.2openai1,435.551,432.38 – 1,438.7383,793
90GPT-5 (High)openai1,434.741,430.24 – 1,439.2531,718
92Qwen3-Max-Previewalibaba1,434.261,429.75 – 1,438.7827,368
89GLM-5V-Turbozai1,433.961,427.52 – 1,440.3910,476
93MiMo-V2.5xiaomi1,433.911,429.69 – 1,438.1347,327
96Gemini 3.1 Flash-Lite Previewgoogle1,432.91,429.28 – 1,436.5264,196
93Mistral Large 4mistral1,432.011,425.8 – 1,438.2312,066
98o3 (2025-04-16)openai1,431.661,428.03 – 1,435.2958,901
96MiMo-V2-Omnixiaomi1,430.731,425.19 – 1,436.2820,615
95Kimi K2.5 (Instant)moonshot1,430.521,424.02 – 1,437.038,371
102Grok 4.1 Fast (Reasoning)xai1,430.31,427.11 – 1,433.557,500
102Kimi K2 Thinking Turbomoonshot1,429.971,426.88 – 1,433.0663,310
96amazon-nova-experimental-chat (26-02-10)amazon1,426.711,417.04 – 1,436.383,523
102NVIDIA-Nemotron-3-Ultra-550B-A55B (NVFP4)nvidia1,426.511,419.62 – 1,433.411,563
105GPT-5 Chatopenai1,426.441,422.15 – 1,430.7431,187
102Mistral Medium 3.5mistral1,426.381,419.99 – 1,432.7711,791
106Claude Opus 4 (Thinking 16K, 20250514)anthropic1,426.231,421.83 – 1,430.6335,904
104DeepSeek-V3.2-Exp (Thinking)deepseek1,425.151,418.58 – 1,431.718,991
100Muse Glimmermeta1,424.941,415.23 – 1,434.643,884
103Claude Haiku 5.5 (High)anthropic1,424.821,417.34 – 1,432.317,890
111DeepSeek-V3.2deepseek1,424.651,421.16 – 1,428.1448,095
111GLM-4.6zai1,424.291,420.39 – 1,428.1935,810
108Qwen3-Max (2025-09-23)alibaba1,423.491,417.01 – 1,429.989,026
116DeepSeek-V3.2 (Thinking)deepseek1,422.341,418.77 – 1,425.9142,033
118Qwen3-235B-A22B-Instruct (2507)alibaba1,422.211,419.66 – 1,424.7698,081
111DeepSeek-V3.2-Expdeepseek1,421.721,415.34 – 1,428.0911,996
113DeepSeek-R1 (0528)deepseek1,421.461,415.78 – 1,427.1418,165
118Kimi K2 Preview (0905)moonshot1,418.471,411.94 – 1,42511,592
116Grok 4 Fast (Non-Reasoning)xai1,418.41,410.6 – 1,426.216,336
114ERNIE-5.0-Preview (1022)baidu1,418.271,409.51 – 1,427.024,755
119Kimi K2 Preview (0711)moonshot1,417.781,412.88 – 1,422.6727,139
119DeepSeek-V3.1deepseek1,416.941,410.88 – 1,423.0114,606
122Qwen3.5-122B-A10Balibaba1,416.461,412.17 – 1,420.7429,712
116DeepSeek-V3.1-Terminus (Thinking)deepseek1,416.11,405.99 – 1,426.23,379
119DeepSeek-V3.1 (Thinking)deepseek1,415.81,409.14 – 1,422.4611,458
128MiniMax-M2.7minimax1,414.991,411.68 – 1,418.2989,197
118DeepSeek-V3.1-Terminusdeepseek1,414.711,404.99 – 1,424.433,609
128GPT-4.1 (2025-04-14)openai1,414.641,410.93 – 1,418.3550,298
131Claude Haiku 4.5 (20251001)anthropic1,414.51,412.12 – 1,416.89154,063
129Mistral Large 3mistral1,414.351,411.53 – 1,417.1788,325
127Claude Opus 4 (20250514)anthropic1,414.311,409.99 – 1,418.6343,037
124Qwen3-VL-235B-A22B-Instructalibaba1,413.291,406.76 – 1,419.8111,314
119amazon-nova-experimental-chat (26-01-10)amazon1,412.761,403.09 – 1,422.443,534
121NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4)nvidia1,412.271,402.91 – 1,421.644,178
132Grok 3 Preview (02-24)xai1,411.211,406.87 – 1,415.5632,496
134Grok 4 (0709)xai1,410.981,407.04 – 1,414.9339,678
131GLM-4.5zai1,410.881,405.96 – 1,415.823,797
139Gemini 2.5 Flashgoogle1,409.241,406.8 – 1,411.67125,457
134Qwen3.5-27Balibaba1,408.811,404.51 – 1,413.128,647
131Hy3 previewtencent1,408.761,401.35 – 1,416.176,869
143Mistral Medium 3.1 (2508)mistral1,407.791,405.2 – 1,410.3995,269
143Inkling-Smallthinky1,405.521,401.01 – 1,410.0436,999
143Grok 4 Fast (Reasoning)xai1,405.281,400.22 – 1,410.3518,270
146Gemini 2.5 Flash Preview (09-2025)google1,403.041,398.99 – 1,407.0932,996
150o1 (2024-12-17)openai1,402.271,397.79 – 1,406.7427,807
150Qwen3-235B-A22B (Non-Thinking)alibaba1,402.121,397.58 – 1,406.6537,472
150Claude Sonnet 4 (Thinking 32K, 20250514)anthropic1,401.951,397.5 – 1,406.434,128
154GPT-5.4 nano (High)openai1,401.191,397.41 – 1,404.9762,314
146LongCat-Flash-Chatmeituan1,400.771,394.36 – 1,407.1911,167
150Qwen3-235B-A22B-Thinking (2507)alibaba1,400.061,393.48 – 1,406.638,822
155Qwen3-Next-80B-A3B-Instructalibaba1,398.511,393.74 – 1,403.2922,753
156DeepSeek-R1deepseek1,398.081,393.18 – 1,402.9818,524
160Qwen3.5-Flashalibaba1,3961,392.33 – 1,399.6661,776
160DeepSeek-V3 (0324)deepseek1,395.241,391.34 – 1,399.1344,977
157Qwen3-VL-235B-A22B-Thinkingalibaba1,394.711,387.89 – 1,401.547,862
150Hunyuan Vision 1.5 Thinkingtencent1,394.071,381.66 – 1,406.482,169
161Qwen3.5-35B-A3Balibaba1,393.831,389.6 – 1,398.0630,427
165Step-3.5-Flashstepfun1,393.011,389.46 – 1,396.5660,305
157amazon-nova-experimental-chat (12-10)amazon1,392.911,383.44 – 1,402.373,734
165MiMo-V2-Flash (Non-Thinking)xiaomi1,391.511,388.03 – 1,394.9948,060
165o4-mini (2025-04-16)openai1,390.951,386.96 – 1,394.9544,843
165Claude Sonnet 4 (20250514)anthropic1,390.931,386.53 – 1,395.3239,168
165MiniMax-M2.5minimax1,390.621,386.74 – 1,394.5142,783
165GPT-5 mini (High)openai1,389.831,385.19 – 1,394.4826,793
167o1-previewopenai1,388.571,383.56 – 1,393.5831,122
169Claude 3.7 Sonnet (Thinking 32K, 20250219)anthropic1,388.261,384.05 – 1,392.4638,156
169Solar Pro 4upstage1,387.831,382.78 – 1,392.8726,159
169Qwen3-Coder-480B-A35B-Instructalibaba1,387.571,382.59 – 1,392.5525,190
165Hunyuan T1 (20250711)tencent1,387.271,378.56 – 1,395.984,595
170Mistral Medium 3 (2505)mistral1,387.261,382.54 – 1,391.9832,777
170MiMo-V2-Flash (Thinking)xiaomi1,386.111,379.94 – 1,392.2811,135
171MiniMax-M2.1 Previewminimax1,384.541,379.36 – 1,389.7217,222
172Hunyuan TurboS (20250416)tencent1,383.091,376.59 – 1,389.5910,623
175GPT-4.1 mini (2025-04-14)openai1,382.811,378.48 – 1,387.1538,696
175Qwen3-30B-A3B-Instruct (2507)alibaba1,382.311,377.4 – 1,387.2223,312
182Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025)google1,379.41,375.97 – 1,382.8247,418
182Trinity Large PreviewOrganization not supplied1,378.531,374.27 – 1,382.7931,233
172GLM-4.6Vzai1,378.361,367.18 – 1,389.542,833
187Qwen3-235B-A22Balibaba1,374.851,370.15 – 1,379.5625,950
188Gemini 2.5 Flash-Lite Preview (Thinking, 06-17)google1,374.71,370.17 – 1,379.2232,381
190Claude 3.5 Sonnet (20241022)anthropic1,374.281,371.07 – 1,377.4987,771
190Qwen2.5-Maxalibaba1,373.771,369.65 – 1,377.8832,487
191GLM-4.5-Airzai1,373.021,368.77 – 1,377.2830,652
192Claude 3.7 Sonnet (20250219)anthropic1,372.471,368.5 – 1,376.4442,573
193Qwen3-Next-80B-A3B-Thinkingalibaba1,369.191,363.33 – 1,375.0513,476
194Trinity Large ThinkingOrganization not supplied1,367.481,362.89 – 1,372.0830,290
198Gemma 3 27B ITgoogle1,365.321,361.62 – 1,369.0346,670
195GLM-4.7-Flashzai1,364.711,358.99 – 1,370.4212,008
200MiniMax-M1minimax1,363.821,359.52 – 1,368.1134,293
200amazon-nova-experimental-chat (11-10)amazon1,363.811,359.53 – 1,368.0926,026
198Grok 3 Mini (High)xai1,363.71,358.23 – 1,369.1815,595
198o3-mini (High)openai1,363.561,358.29 – 1,368.8318,589
201Gemini 2.0 Flash (001)google1,359.971,356.16 – 1,363.7743,443
201NVIDIA-Nemotron-3-Super-120B-A12Bnvidia1,359.931,352.8 – 1,367.057,870
202DeepSeek-V3deepseek1,358.421,353.66 – 1,363.1821,770
202Grok 3 Mini Betaxai1,357.891,352.76 – 1,363.0320,930
204Mistral Small 3.2 (2506)mistral1,356.171,350.95 – 1,361.417,462
201INTELLECT-3Organization not supplied1,355.511,347.26 – 1,363.765,435
209Command A (03-2025)cohere1,353.651,350.18 – 1,357.1355,763
209Gemini 2.0 Flash-Lite Preview (02-05)google1,353.541,349.22 – 1,357.8724,955
207NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4)nvidia1,353.311,348 – 1,358.6224,230
204GLM-4.5Vzai1,352.151,343.71 – 1,360.594,817
210gpt-oss-120bopenai1,351.741,347.37 – 1,356.130,200
210Gemini 1.5 Pro (002)google1,351.31,347.9 – 1,354.755,606
209Step-3stepfun1,349.031,341.52 – 1,356.556,291
204Hunyuan TurboS (20250226)tencent1,348.841,337.13 – 1,360.542,220
210amazon-nova-experimental-chat (10-20)amazon1,348.21,342.06 – 1,354.3411,625
213o3-miniopenai1,348.061,344.5 – 1,351.6156,735
206Llama 3.1 Nemotron Ultra 253B v1nvidia1,347.571,335.9 – 1,359.252,549
209Qwen3-32Balibaba1,346.821,337.36 – 1,356.283,926
209amazon-nova-experimental-chat (10-09)amazon1,346.21,335.27 – 1,357.132,781
215GPT-4o (2024-05-13)openai1,346.121,342.66 – 1,349.59112,881
210Qwen-Plus (0125)alibaba1,345.891,337.56 – 1,354.225,819
213MiniMax-M2minimax1,343.541,335.79 – 1,351.286,850
220Claude 3.5 Sonnet (20240620)anthropic1,343.281,339.84 – 1,346.7382,419
214Ling-flash-2.0ant-group1,343.271,335.99 – 1,350.556,952
211Llama 3.3 Nemotron Super 49B v1.5nvidia1,343.071,333.07 – 1,353.063,327
211Mercury 2inception-ai1,342.821,332.29 – 1,353.353,191
213GLM-4-Plus (0111)zai1,342.721,334.3 – 1,351.135,760
213Gemma 3 12B ITgoogle1,341.741,332.23 – 1,351.253,829
213Hunyuan Turbo (0110)tencent1,340.661,329.14 – 1,352.182,290
214Granite 4.2 30Bibm1,340.121,329.63 – 1,350.613,389
220GPT-5 nano (High)openai1,337.651,330.73 – 1,344.578,134
225o1-miniopenai1,336.811,333.15 – 1,340.4851,981
225Gemini Advanced (0514)google1,335.971,330.81 – 1,341.1250,148
226Grok 2 (2024-08-13)xai1,335.651,331.96 – 1,339.3563,498
226GPT-4o (2024-08-06)openai1,335.591,331.37 – 1,339.845,499
225QwQ-32Balibaba1,335.581,331.12 – 1,340.0425,177
226Llama 3.1 405B Instruct (BF16)meta1,335.451,331.72 – 1,339.1841,375
225Amazon Nova 2 Liteamazon1,334.961,328.87 – 1,341.0412,415
228Llama 3.1 405B Instruct (FP8)meta1,333.61,330 – 1,337.2159,656
223Step-2 16K Exp (202412)stepfun1,333.511,324.92 – 1,342.14,833
232Olmo 3.1 32B Instructallenai1,329.321,323.18 – 1,335.4611,805
234Yi LightningOrganization not supplied1,328.281,323.33 – 1,333.2227,332
225Llama 3.3 Nemotron Super 49B v1nvidia1,327.741,315.61 – 1,339.872,218
241Llama 4 Maverick 17B 128E Instructmeta1,326.961,322.68 – 1,331.2439,439
240Qwen3-30B-A3Balibaba1,326.71,321.95 – 1,331.4526,156
229Hunyuan Large (2025-02-10)tencent1,326.331,316.6 – 1,336.053,738
248Claude 3.5 Haiku (20241022)anthropic1,324.761,321.5 – 1,328.0369,056
248GPT-4 Turbo (2024-04-09)openai1,324.51,320.58 – 1,328.4398,114
248Gemini 1.5 Pro (001)google1,324.061,320.07 – 1,328.0579,138
240DeepSeek-V2.5 (1210)deepseek1,323.381,315.11 – 1,331.656,795
245Ring-flash-2.0ant-group1,322.361,315.09 – 1,329.646,987
245GPT-4.1 nano (2025-04-14)openai1,322.261,314.53 – 1,329.996,103
248Claude 3 Opus (20240229)anthropic1,322.241,319.17 – 1,325.31194,909
248Llama 4 Scout 17B 16E Instructmeta1,321.451,316.71 – 1,326.1829,823
223Molmo 2 8Ballenai1,321.351,300.24 – 1,342.46822
248Step-1o Turbo (202506)stepfun1,319.761,312.88 – 1,326.638,906
249GLM-4-Pluszai1,319.371,314.43 – 1,324.326,126
249Qwen-Max (0919)alibaba1,318.111,312.41 – 1,323.8216,478
253Llama 3.3 70B Instructmeta1,318.051,314.54 – 1,321.5554,493
254GPT-4o mini (2024-07-18)openai1,317.591,314.04 – 1,321.1568,705
251Gemma 3n E4B ITgoogle1,317.541,312.36 – 1,322.7222,136
249gpt-oss-20bopenai1,317.311,310.89 – 1,323.7210,416
254Qwen2.5-Plus (1127)alibaba1,314.611,308.25 – 1,320.9710,187
257Mistral Large 2 (2407)mistral1,314.431,310.5 – 1,318.3745,459
257Athene V2 ChatOrganization not supplied1,314.131,309.57 – 1,318.724,739
257NVIDIA-Nemotron-3-Nano-30B-A3B (BF16)nvidia1,313.611,308.13 – 1,319.0915,761
257GPT-4 Turbo Preview (0125)openai1,313.251,309.17 – 1,317.3493,439
257GPT-4 Turbo Preview (1106)openai1,312.911,309.02 – 1,316.8100,105
254Hunyuan Standard (2025-02-10)tencent1,311.271,301.61 – 1,320.943,904
266Gemini 1.5 Flash (002)google1,309.271,305.04 – 1,313.534,902
269Grok 2 mini (2024-08-13)xai1,308.391,304.66 – 1,312.1352,567
269DeepSeek-V2.5deepseek1,307.181,302.47 – 1,311.924,572
269Athene 70B (0725)Organization not supplied1,306.631,300.96 – 1,312.319,621
265Olmo 3 32B Thinkallenai1,305.951,297.7 – 1,314.195,827
256Mercuryinception-ai1,305.661,291.9 – 1,319.431,966
271Mistral Large (2411)mistral1,305.561,301.1 – 1,310.0228,073
269Magistral Medium (2506)mistral1,304.821,298.37 – 1,311.2711,513
266Granite 4.1 8Bibm1,303.961,293.96 – 1,313.964,177
267Gemma 3 4B ITgoogle1,303.231,293.91 – 1,312.554,171
276Qwen2.5-72B-Instructalibaba1,302.861,298.78 – 1,306.9539,406
276Mistral Small 3.1 24B Instruct (2503)mistral1,302.591,298.05 – 1,307.1432,722
276Llama 3.1 Nemotron 70B Instructnvidia1,298.731,290.97 – 1,306.497,140
278Hunyuan Large Visiontencent1,293.731,284.59 – 1,302.885,279
287Llama 3.1 70B Instructmeta1,293.351,289.6 – 1,297.155,240
287Amazon Nova Pro 1.0amazon1,290.091,285.51 – 1,294.6824,745
280Granite 4.2 3Bibm1,2901,278.4 – 1,301.63,249
282Granite 4.2 8Bibm1,289.681,278.5 – 1,300.873,251
289Gemma 2 27B ITgoogle1,289.491,286.09 – 1,292.8875,754
287Jamba 1.5 LargeOrganization not supplied1,289.471,282.17 – 1,296.778,662
287Reka Core (20240904)Organization not supplied1,288.051,280.86 – 1,295.237,312
289GPT-4 (0314)openai1,287.891,283.14 – 1,292.6554,173
287Granite-4.0-H-Smallibm1,287.311,278.91 – 1,295.715,630
287Llama 3.1 Nemotron 51B Instructnvidia1,286.661,276.7 – 1,296.633,749
290Gemini 1.5 Flash (001)google1,286.541,282.04 – 1,291.0462,833
289Olmo 3.1 32B Thinkallenai1,286.441,279.18 – 1,293.718,299
287Llama 3.1 Tulu 3 70Ballenai1,286.111,275.66 – 1,296.572,846
294Claude 3 Sonnet (20240229)anthropic1,281.41,277.42 – 1,285.39109,284
292Gemma 2 9B IT SimPOOrganization not supplied1,280.381,273.52 – 1,287.2410,072
296Nemotron-4 340B Instructnvidia1,277.21,271.89 – 1,282.5219,659
299Llama 3 70B Instructmeta1,276.61,273.01 – 1,280.18156,876
296Command R+ (08-2024)cohere1,276.341,269.77 – 1,282.929,866
299GPT-4 (0613)openai1,276.281,272.23 – 1,280.3388,723
299Mistral Small 24B Instruct (2501)mistral1,274.381,268.46 – 1,280.314,681
299GLM-4 (0520)zai1,273.451,266.47 – 1,280.439,788
299Reka Flash (20240904)Organization not supplied1,272.451,265.45 – 1,279.457,536
301Qwen2.5-Coder-32B-Instructalibaba1,270.631,262.5 – 1,278.755,432
309Aya Expanse 32Bcohere1,267.271,262.37 – 1,272.1727,124
310Gemma 2 9B ITgoogle1,267.021,263.18 – 1,270.8554,611
310DeepSeek-Coder-V2deepseek1,265.411,259.14 – 1,271.6815,147
312Qwen2-72B-Instructalibaba1,261.871,256.92 – 1,266.8137,325
313Command R+cohere1,261.831,257.52 – 1,266.1577,554
313Claude 3 Haiku (20240307)anthropic1,261.731,257.97 – 1,265.49117,701
313Amazon Nova Lite 1.0amazon1,260.441,255.24 – 1,265.6319,372
315Gemini 1.5 Flash-8B (001)google1,258.81,254.49 – 1,263.1135,558
317Phi-4microsoft1,256.291,251.68 – 1,260.924,126
316OLMo 2 32B Instruct (0325)allenai1,251.661,240.88 – 1,262.433,334
320Command R (08-2024)cohere1,250.481,243.88 – 1,257.0810,140
324Mistral Large (2402)mistral1,242.611,237.9 – 1,247.3262,436
324Amazon Nova Micro 1.0amazon1,240.711,235.53 – 1,245.8919,364
324Jamba 1.5 MiniOrganization not supplied1,239.81,232.57 – 1,247.028,858
324Ministral 8B (2410)mistral1,237.621,228.54 – 1,246.714,781
324Gemini Pro (Dev API)google1,236.881,229.58 – 1,244.1918,354
326Qwen1.5-110B-Chatalibaba1,234.221,228.68 – 1,239.7726,195
325Reka Flash 21B (Online, 20240226)Organization not supplied1,233.621,226.23 – 1,241.0115,450
326Qwen1.5-72B-Chatalibaba1,233.591,228.33 – 1,238.8539,302
324Hunyuan Standard 256Ktencent1,233.21,221.48 – 1,244.922,728
328Mixtral 8x22B Instruct v0.1mistral1,229.651,225.1 – 1,234.2151,416
329Command Rcohere1,226.941,222.16 – 1,231.7154,036
328Reka Flash 21B (20240226)Organization not supplied1,226.881,220.94 – 1,232.8124,806
329GPT-3.5 Turbo (0125)openai1,225.641,220.95 – 1,230.3366,207
333Llama 3 8B Instructmeta1,223.681,219.94 – 1,227.41104,642
328Gemini Progoogle1,223.671,211.95 – 1,235.396,390
329Aya Expanse 8Bcohere1,223.081,216.1 – 1,230.069,818
333Mistral Mediummistral1,222.781,217.3 – 1,228.2634,550
329Llama 3.1 Tulu 3 8Ballenai1,220.51,209.83 – 1,231.172,896
335Zephyr ORPO 141B A35B v0.1Organization not supplied1,213.091,202.32 – 1,223.864,652
340Yi 1.5 34B ChatOrganization not supplied1,212.881,207.85 – 1,217.9124,146
342Llama 3.1 8B Instructmeta1,211.231,207.07 – 1,215.3949,605
340Granite 3.1 8B Instructibm1,208.571,197.49 – 1,219.663,090
342GPT-3.5 Turbo (1106)openai1,204.291,195.58 – 1,213.0116,619
343Qwen1.5-32B-Chatalibaba1,204.061,197.95 – 1,210.1621,741
346Gemma 2 2B ITgoogle1,200.091,195.99 – 1,204.246,616
346Phi-3 Medium 4K Instructmicrosoft1,197.971,192.81 – 1,203.1225,055
347Mixtral 8x7B Instruct v0.1mistral1,197.231,192.97 – 1,201.4873,503
347DBRX Instruct PreviewOrganization not supplied1,195.581,189.48 – 1,201.6932,191
347Qwen1.5-14B-Chatalibaba1,191.141,184.04 – 1,198.2417,839
347InternLM2.5 20B ChatOrganization not supplied1,190.781,183.6 – 1,197.969,901
349DeepSeek LLM 67B Chatdeepseek1,1851,173.55 – 1,196.464,932
351WizardLM 70Bmicrosoft1,184.811,175.4 – 1,194.228,214
353Yi 34B ChatOrganization not supplied1,183.781,176.97 – 1,190.615,483
353Granite 3.0 8B Instructibm1,183.211,174.54 – 1,191.886,638
353OpenChat 3.5Organization not supplied1,183.111,173.48 – 1,192.757,968
353OpenChat 3.5 (0106)Organization not supplied1,182.811,174.83 – 1,190.7912,637
354Gemma 1.1 7B ITgoogle1,182.61,176.54 – 1,188.6623,893
354Snowflake Arctic InstructOrganization not supplied1,180.121,174.22 – 1,186.0232,832
353Granite 3.1 2B Instructibm1,178.921,167.75 – 1,190.13,188
354Tulu 2 DPO 70BOrganization not supplied1,177.731,167.94 – 1,187.516,535
354OpenHermes 2.5 Mistral 7BOrganization not supplied1,176.031,165.64 – 1,186.415,006
356Vicuna 33BOrganization not supplied1,172.991,166.81 – 1,179.1822,479
356Phi-3 Small 8K Instructmicrosoft1,171.131,165.23 – 1,177.0417,766
356Starling LM 7B BetaOrganization not supplied1,171.031,163.64 – 1,178.4216,056
358Llama 2 70B Chatmeta1,170.71,165.22 – 1,176.1838,492
358Starling LM 7B AlphaOrganization not supplied1,167.471,159.43 – 1,175.5210,224
361Llama 3.2 3B Instructmeta1,166.821,159.12 – 1,174.527,936
358Nous Hermes 2 Mixtral 8x7B DPOOrganization not supplied1,164.461,152.57 – 1,176.343,777
370Granite 3.0 2B Instructibm1,156.721,148.34 – 1,165.16,837
366Llama 2 70B SteerLM Chatnvidia1,154.761,142.19 – 1,167.333,585
367QwQ-32B-Previewalibaba1,154.251,142.78 – 1,165.723,231
368SOLAR 10.7B Instruct v1.0upstage1,152.491,139.36 – 1,165.624,155
366Dolphin 2.2.1 Mistral 7BOrganization not supplied1,152.341,137.07 – 1,167.611,679
371MPT 30B ChatOrganization not supplied1,150.821,138.62 – 1,163.022,572
373WizardLM 13Bmicrosoft1,149.591,140.4 – 1,158.787,044
373Mistral 7B Instruct v0.2mistral1,149.451,142.82 – 1,156.0919,402
370Falcon 180B ChatOrganization not supplied1,148.191,131.19 – 1,165.191,295
373Qwen1.5-7B-Chatalibaba1,143.91,134.03 – 1,153.774,737
374Phi-3 Mini 4K Instruct (June 2024)microsoft1,143.181,136.74 – 1,149.6112,297
375Vicuna 13BOrganization not supplied1,141.631,134.96 – 1,148.3119,367
375Llama 2 13B Chatmeta1,141.481,134.77 – 1,148.1919,174
374Qwen-14B-Chatalibaba1,139.421,128.51 – 1,150.344,964
374PaLM 2google1,139.241,129.91 – 1,148.578,554
375Gemma 7B ITgoogle1,137.751,128.29 – 1,147.228,925
375Code Llama 34B Instructmeta1,136.931,128.06 – 1,145.797,366
379Zephyr 7B BetaOrganization not supplied1,130.871,122.07 – 1,139.6711,118
381Phi-3 Mini 128K Instructmicrosoft1,129.91,122.49 – 1,137.3120,685
385Phi-3 Mini 4K Instructmicrosoft1,128.161,121.77 – 1,134.5520,118
379Guanaco 33BOrganization not supplied1,127.561,115.51 – 1,139.62,921
377Zephyr 7B AlphaOrganization not supplied1,1271,111.46 – 1,142.541,785
386StripedHyena Nous 7BOrganization not supplied1,121.681,110.73 – 1,132.635,182
381Code Llama 70B Instructmeta1,119.221,101.14 – 1,137.291,143
391Gemma 1.1 2B ITgoogle1,116.71,108.99 – 1,124.4210,854
391Vicuna 7BOrganization not supplied1,115.381,106.28 – 1,124.476,923
388SmolLM2 1.7B InstructOrganization not supplied1,114.761,100.43 – 1,129.092,199
394Llama 3.2 1B Instructmeta1,111.151,103.27 – 1,119.038,045
394Mistral 7B Instructmistral1,110.431,101.17 – 1,119.688,977
395Llama 2 7B Chatmeta1,107.991,100.95 – 1,115.0214,148
399Gemma 2B ITgoogle1,093.691,082.23 – 1,105.144,780
403Qwen1.5-4B-Chatalibaba1,091.21,081.89 – 1,100.517,597
404OLMo 7B Instructallenai1,073.671,062.55 – 1,084.86,328
406Koala 13BOrganization not supplied1,070.991,061.18 – 1,080.86,965
406Alpaca 13BOrganization not supplied1,070.291,058.91 – 1,081.675,745
404GPT4All 13B SnoozyOrganization not supplied1,067.771,052.64 – 1,082.91,743
406MPT 7B ChatOrganization not supplied1,063.511,051.61 – 1,075.413,924
406ChatGLM3 6BOrganization not supplied1,056.631,045 – 1,068.264,658
409RWKV-4 Raven 14BOrganization not supplied1,042.41,031.09 – 1,053.714,845
412ChatGLM2 6BOrganization not supplied1,024.831,011.3 – 1,038.362,658
412OpenAssistant Pythia 12BOrganization not supplied1,023.591,012.8 – 1,034.386,310
415ChatGLM 6BOrganization not supplied995.88983.4 – 1,008.374,914
415FastChat-T5 3BOrganization not supplied992.63980.34 – 1,004.924,203
415Dolly 2.0 12BOrganization not supplied982.55969.13 – 995.973,412
415LLaMA 13Bmeta975.24959.58 – 990.92,391
418StableLM Tuned Alpha 7BOrganization not supplied953.27940.65 – 965.883,287

What this ranking can tell you

  • The population is the models in this source board, including variants and models without an available API price.
  • Ranks use the published confidence bounds: one plus the number of models whose lower bound exceeds this model’s upper bound. Shared ranks are not proof of equal performance.

Check the source

The original evidence is retained byte for byte. The downloadable board includes the source URLs, revision and SHA-256 hashes.

Download this board and provenance →

Source files and licences

Explore other model types →Read the benchmark guide →

Evidence & Ask