Independent model evidence
LLM Leaderboard
Capability scores, Arena rankings, benchmark results, specifications and pricing in one place. Each signal stays separate for clearer model selection.
Data as of 2026-08-11
Models393Model products
Task charts4Benchmark rankings
Scored models277Latest scored version per model
Text Arena rows254Model results
Performance bands
Three named bands replace letter grades. LLMBoard uses score thresholds, while Arena datasets use relative rank bands without blending their methods.
The latest scored version of each unique model, grouped into three readable performance bands.
LeadersTop signal band
High performersStrong evidence
CompetitiveSolid results
DeepSeek-V4-Pro73.8Qwen3.7 Plus73.8Muse Spark73.2Seed 2.1 Turbo73.1Claude Sonnet 4.672.6GPT-5.2-Pro71.6GPT-5.271.4MiniMax M371.3Hy371.0GLM 5.169.6Seed 2.0 Pro69.5Claude Opus 4.569.5Gemini 3.5 Flash Cyber68.9Grok 4 Heavy68.2Qwen3.6 Plus67.5Gemini 3 Pro67.3GLM 567.2Kimi K2.7 Code66.8Qwen3.5 397B A17B66.3Kimi K2.566.0Gemini 3 Flash64.8MiMo V2 Pro64.0GPT-5.3-Codex62.9Nemotron 3 Ultra62.9GPT-5.162.1MiMo61.8GPT-5.1-Instant61.3Kimi K2 Thinking61.0LongCat Flash Thinking60.8Qwen3.6 27B60.5GPT-5.4-mini60.5Step 3.5 Flash60.4Gemma 4 31B60.1
Capability at each price point
Compare LLMBoard scores with an 8:1 blend of official input and output API prices. Models without official PAYG prices are excluded.
LLMBoard scoreOfficial API price blend (8:1 input/output), USD / 1M
Efficient frontier128 models with official PAYG prices
Best LLMs by task
Each chart uses one benchmark with results for multiple models. Scores are not compared across different benchmarks.
Coding: SWE-Bench Verified
Math: AIME 2025
Speech-to-Text: FLEURS
LLM benchmark scores and pricing
Core capability, specification and price columns are visible by default. Use Columns to show more benchmarks.
| 1 | AN | Claude Opus 5 | 97.4 | 100.0 | 75.0 | 99.5 | 90.4 | N/A | 80.0% | 1M | Closed weights | $5 | $25 | N/A | N/A | N/A | N/A | N/A | 64.7% | N/A | N/A | N/A | N/A |
| 2 | AN | Claude Fable 5 | 95.8 | N/A | 100.0 | 97.8 | 94.6 | 89.2 | 80.0% | 1M | Closed weights | $10 | $50 | N/A | N/A | N/A | 95.0% | N/A | 64.5% | N/A | N/A | N/A | N/A |
| 3 | OP | GPT-5.6 Sol | 95.1 | 87.8 | 95.8 | 100.0 | 92.9 | 90.6 | 100.0% | 1.1M | Closed weights | $5 | $30 | 94.6% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 83.0% |
| 4 | AN | Claude Mythos Preview | 93.6 | 99.8 | 100.0 | 99.7 | 92.7 | 93.3 | 100.0% | N/A | Closed weights | N/A | N/A | 94.6% | N/A | N/A | 93.9% | N/A | 64.7% | N/A | N/A | N/A | N/A |
| 5 | MA | Kimi K3 | 93.0 | 97.0 | 50.0 | 95.7 | 94.1 | 97.9 | 100.0% | 1M | Open weights | $3 | $15 | 93.5% | N/A | N/A | N/A | N/A | 56.0% | N/A | N/A | N/A | 81.6% |
| 6 | AC | Qwen3.8 Max | 89.3 | 97.8 | N/A | 70.7 | 85.8 | 97.9 | 80.0% | 1M | Closed weights | $2 | $6 | 92.6% | N/A | N/A | N/A | N/A | 43.6% | N/A | N/A | N/A | 82.3% |
| 7 | ME | Muse Spark 1.1 | 88.3 | 87.5 | N/A | 96.7 | 75.7 | 89.4 | 80.0% | 1M | Closed weights | $1.25 | $4.25 | N/A | N/A | N/A | N/A | N/A | 62.1% | N/A | N/A | N/A | N/A |
| 8 | AN | Claude Opus 4.8 | 87.9 | 99.0 | 37.5 | 94.6 | 85.0 | 84.7 | 100.0% | 1M | Closed weights | $5 | $25 | 93.6% | N/A | N/A | 88.6% | N/A | 57.9% | N/A | N/A | N/A | N/A |
| 9 | OP | GPT-5.6 Terra | 87.6 | 71.4 | 50.0 | 71.9 | 79.1 | 66.0 | 100.0% | 1.1M | Closed weights | $2 | $12 | 92.9% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 80.7% |
| 10 | AN | Claude Opus 4.7 | 84.2 | 98.7 | N/A | 88.6 | 69.3 | 89.5 | 80.0% | 1M | Closed weights | $5 | $25 | 94.2% | N/A | N/A | 87.6% | N/A | 54.7% | N/A | N/A | N/A | N/A |
| 11 | AN | Claude Sonnet 5 | 84.0 | N/A | 62.5 | 71.7 | 78.8 | 87.2 | 80.0% | 1M | Closed weights | $2 | $10 | N/A | N/A | N/A | 85.2% | N/A | 57.4% | N/A | N/A | N/A | N/A |
| 12 | OP | GPT-5.5 | 84.0 | 98.8 | 100.0 | 73.1 | 73.8 | 72.2 | 100.0% | 1.1M | Closed weights | $5 | $30 | 93.6% | N/A | N/A | N/A | N/A | 52.2% | N/A | N/A | N/A | 83.2% |
| 13 | ME | Muse Spark 1.2 | 82.3 | N/A | N/A | N/A | 62.1 | N/A | 20.0% | 1M | Closed weights | $1.25 | $4.25 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 14 | XA | Grok 4.5 | 82.2 | 96.6 | N/A | N/A | 64.9 | N/A | 40.0% | 500K | Closed weights | $2 | $6 | 93.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 15 | AN | Claude Opus 4.6 | 79.6 | 77.5 | 50.0 | 85.9 | 72.2 | 77.2 | 100.0% | 1M | Closed weights | $5 | $25 | 91.3% | N/A | 99.8% | 80.8% | N/A | 53.1% | N/A | N/A | N/A | 77.3% |
| 16 | GO | Gemini 3.6 Flash | 79.3 | N/A | N/A | N/A | 54.9 | 80.8 | 40.0% | 1M | Closed weights | $1.5 | $7.5 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 17 | ZA | GLM-5.2 | 79.3 | 92.7 | N/A | 89.5 | 56.5 | 100.0 | 80.0% | 1M | Open weights | $1.4 | $4.4 | 91.2% | N/A | N/A | N/A | N/A | 54.7% | N/A | N/A | N/A | N/A |
| 18 | GO | Gemini 3.5 Flash | 79.2 | 90.0 | N/A | 65.2 | 64.5 | 60.5 | 80.0% | 1M | Closed weights | $1.5 | $9 | N/A | N/A | N/A | N/A | N/A | 40.2% | N/A | N/A | N/A | 83.6% |
| 19 | AC | Qwen3.7 Max | 78.8 | 95.7 | N/A | 77.4 | 83.1 | 89.6 | 80.0% | 1M | Closed weights | $2.5 | $7.5 | 92.4% | 89.6% | N/A | 80.4% | N/A | 41.4% | N/A | N/A | N/A | N/A |
| 20 | BY | Seed 2.1 Pro | 78.7 | 80.1 | 91.7 | 58.8 | 64.3 | 93.1 | 100.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 55.7% | N/A | N/A | N/A | 82.7% |
| 21 | DE | DeepSeek-V4-Flash-0731 | 78.3 | N/A | N/A | N/A | 70.8 | N/A | 20.0% | 1M | Open weights | $0.14 | $0.28 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 22 | GO | Gemini 3.1 Pro | 77.5 | 91.8 | N/A | 82.6 | 55.9 | 74.1 | 80.0% | 1M | Closed weights | $2 | $12 | 94.3% | N/A | N/A | 80.6% | N/A | 51.4% | N/A | N/A | N/A | 80.5% |
| 23 | OP | GPT-5.4 | 77.1 | 90.3 | 83.3 | 72.2 | 57.8 | 71.2 | 100.0% | 1.1M | Closed weights | $2.5 | $15 | 92.8% | N/A | N/A | N/A | N/A | 39.8% | N/A | N/A | N/A | 81.2% |
| 24 | OP | GPT-5.6 Luna | 76.4 | 55.2 | 25.0 | 43.8 | 68.6 | 40.8 | 100.0% | 1.1M | Closed weights | $0.20 | $1.2 | 92.3% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 78.4% |
| 25 | OP | GPT-5.5 Pro | 75.8 | N/A | 50.0 | 80.6 | 94.7 | N/A | 60.0% | 1.1M | Closed weights | $30 | $180 | N/A | N/A | N/A | N/A | N/A | 57.2% | N/A | N/A | N/A | N/A |
| 26 | MA | Kimi K2.6 | 75.5 | 78.5 | N/A | 69.0 | 70.5 | 71.5 | 80.0% | 262.1K | Open weights | $0.95 | $4 | 90.5% | N/A | N/A | 80.2% | N/A | 36.4% | N/A | N/A | N/A | 80.1% |
| 27 | DE | DeepSeek-V4-Pro-Max | 73.8 | 90.1 | N/A | 86.0 | 63.2 | 85.4 | 80.0% | 1M | Closed weights | $0.435 | $0.87 | 90.1% | 87.5% | N/A | 80.6% | N/A | 48.2% | 93.5% | N/A | N/A | N/A |
| 28 | AC | Qwen3.7-Plus | 73.8 | 72.1 | 92.0 | 62.4 | 59.0 | 90.1 | 100.0% | 1M | Closed weights | $0.50 | $3 | 90.3% | 88.5% | N/A | 77.7% | N/A | 34.7% | N/A | N/A | N/A | 79.0% |
| 29 | ME | Muse Spark | 73.2 | 78.9 | 100.0 | 95.7 | 49.4 | 89.8 | 100.0% | N/A | Closed weights | N/A | N/A | 89.5% | N/A | N/A | 77.4% | N/A | 58.4% | N/A | N/A | N/A | 80.4% |
| 30 | BY | Seed 2.1 Turbo | 73.1 | 52.6 | 41.7 | 66.6 | 53.5 | 87.5 | 100.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 54.6% | N/A | N/A | N/A | 82.2% |
| 31 | AN | Claude Sonnet 4.6 | 72.6 | 70.1 | N/A | 78.3 | 62.2 | 72.3 | 80.0% | 1M | Closed weights | $3 | $15 | 89.9% | N/A | N/A | 79.6% | N/A | 49.0% | N/A | N/A | N/A | 75.6% |
| 32 | OP | GPT-5.2 Pro | 71.6 | 78.5 | 66.7 | 79.9 | 63.2 | 98.2 | 100.0% | 400K | Closed weights | $21 | $168 | 93.2% | N/A | 100.0% | N/A | N/A | 36.6% | N/A | N/A | N/A | N/A |
| 33 | OP | GPT-5.2 | 71.4 | 75.5 | 60.7 | 76.1 | 59.1 | 85.6 | 100.0% | 400K | Closed weights | $1.75 | $14 | 92.4% | N/A | 100.0% | 80.0% | N/A | 34.5% | N/A | N/A | N/A | 79.5% |
| 34 | MI | MiniMax M3 | 71.3 | 69.2 | 74.0 | 100.0 | 53.8 | 62.6 | 100.0% | 512K | Open weights | $0.30 | $1.2 | N/A | N/A | N/A | 80.5% | N/A | N/A | N/A | N/A | N/A | 78.1% |
| 35 | TE | Hy3 | 71.0 | 45.7 | 0.0 | 47.2 | 63.0 | N/A | 80.0% | 256K | Open weights | N/A | N/A | 90.4% | N/A | N/A | 78.0% | N/A | N/A | N/A | N/A | N/A | N/A |
| 36 | ZA | GLM-5.1 | 69.6 | 80.7 | N/A | 68.0 | 47.1 | 54.8 | 80.0% | 200K | Open weights | $1.4 | $4.4 | 86.2% | N/A | N/A | N/A | N/A | 52.3% | N/A | N/A | N/A | N/A |
| 37 | BY | Seed 2.0 Pro | 69.5 | 88.8 | N/A | N/A | 75.9 | 89.4 | 60.0% | 256K | Closed weights | N/A | N/A | 88.9% | N/A | 98.3% | 76.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 38 | AN | Claude Opus 4.5 | 69.5 | 61.3 | 100.0 | N/A | 71.1 | 78.9 | 80.0% | 200K | Closed weights | $5 | $25 | 87.0% | N/A | N/A | 80.9% | N/A | N/A | N/A | N/A | N/A | N/A |
| 39 | GO | Gemini 3.5 Flash Cyber | 68.9 | N/A | N/A | N/A | 100.0 | N/A | 20.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 40 | XA | Grok-4 Heavy | 68.2 | 88.2 | N/A | 76.8 | 86.1 | 98.2 | 80.0% | N/A | Closed weights | N/A | N/A | 88.4% | N/A | 100.0% | N/A | N/A | 50.7% | 79.4% | N/A | N/A | N/A |
| 41 | AC | Qwen3.6 Plus | 67.5 | 84.9 | 82.0 | 74.4 | 48.8 | 77.3 | 100.0% | 1M | Closed weights | $0.50 | $3 | 90.4% | 88.5% | N/A | 78.8% | N/A | 28.8% | N/A | N/A | N/A | 78.8% |
| 42 | GO | Gemini 3 Pro | 67.3 | 68.8 | 100.0 | 36.4 | 60.5 | 64.3 | 100.0% | 1M | Closed weights | N/A | N/A | 91.9% | N/A | 100.0% | 76.2% | N/A | 45.8% | N/A | N/A | N/A | 81.0% |
| 43 | ZA | GLM-5 | 67.2 | N/A | N/A | N/A | 61.1 | N/A | 20.0% | 204.8K | Open weights | $1 | $3.2 | N/A | N/A | N/A | 77.8% | N/A | N/A | N/A | N/A | N/A | N/A |
| 44 | MA | Kimi K2.7 Code | 66.8 | N/A | N/A | N/A | 35.3 | 29.7 | 40.0% | 262.1K | Open weights | $0.95 | $4 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 45 | AC | Qwen3.5-397B-A17B | 66.3 | 90.8 | N/A | 53.7 | 69.8 | 80.0 | 80.0% | 262.1K | Open weights | $0.60 | $3.6 | 88.4% | 87.8% | N/A | 76.4% | N/A | 28.7% | N/A | N/A | N/A | N/A |
| 46 | MA | Kimi K2.5 | 66.0 | 69.0 | 46.0 | 73.6 | 48.1 | 60.3 | 100.0% | 262.1K | Open weights | $0.60 | $3 | 87.6% | 87.1% | 96.1% | 76.8% | N/A | 50.2% | N/A | N/A | N/A | 78.5% |
| 47 | GO | Gemini 3 Flash | 64.8 | 71.1 | 96.0 | 69.6 | 46.1 | 57.9 | 100.0% | 1M | Closed weights | $0.50 | $3 | 90.4% | N/A | 99.7% | 78.0% | N/A | 43.5% | N/A | N/A | N/A | 81.2% |
| 48 | XI | MiMo-V2-Pro | 64.0 | N/A | N/A | N/A | 60.1 | N/A | 20.0% | 1M | Closed weights | $0.435 | $0.87 | N/A | N/A | N/A | 78.0% | N/A | N/A | N/A | N/A | N/A | N/A |
| 49 | OP | GPT-5.3 Codex | 62.9 | N/A | N/A | N/A | 54.0 | 40.5 | 40.0% | 400K | Closed weights | $1.75 | $14 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 50 | NV | Nemotron 3 Ultra (550B A55B) | 62.9 | 82.6 | N/A | 53.6 | 46.0 | 89.9 | 80.0% | 1M | Open weights | $0.50 | $2.5 | 87.0% | 86.8% | N/A | 70.7% | N/A | 37.4% | N/A | N/A | N/A | N/A |
| 51 | OP | GPT-5.1 | 62.1 | 86.5 | 96.8 | 50.0 | 70.9 | 77.9 | 100.0% | 400K | Closed weights | $1.25 | $10 | 88.1% | N/A | 94.0% | 76.3% | N/A | N/A | N/A | N/A | N/A | N/A |
| 52 | XI | MiMo-V2.5 | 61.8 | 33.9 | N/A | N/A | 43.8 | 64.3 | 60.0% | 1M | Open weights | $0.14 | $0.28 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 77.9% |
| 53 | OP | GPT-5.1 Instant | 61.3 | 86.5 | 96.8 | 50.0 | 70.9 | 77.9 | 100.0% | 400K | Closed weights | N/A | N/A | 88.1% | N/A | 94.0% | 76.3% | N/A | N/A | N/A | N/A | N/A | N/A |
| 54 | MA | Kimi K2-Thinking-0905 | 61.0 | 75.5 | N/A | 60.2 | 55.0 | 67.0 | 80.0% | 262.1K | Closed weights | $0.60 | $2.5 | 84.5% | 84.6% | 100.0% | 71.3% | N/A | 51.0% | N/A | N/A | N/A | N/A |
| 55 | ME | LongCat-Flash-Thinking-2601 | 60.8 | 63.5 | N/A | 28.6 | 76.2 | 93.4 | 80.0% | 128K | Closed weights | N/A | N/A | 80.5% | N/A | 99.6% | 70.0% | N/A | 25.2% | 82.8% | N/A | N/A | N/A |
| 56 | AC | Qwen3.6-27B | 60.5 | 79.4 | 83.8 | 54.8 | 45.5 | 72.7 | 100.0% | 262.1K | Open weights | $0.60 | $3.6 | 87.8% | 86.2% | N/A | 77.2% | N/A | 24.0% | N/A | N/A | N/A | 75.8% |
| 57 | OP | GPT-5.4 mini | 60.5 | 72.5 | N/A | 51.1 | 37.7 | 54.4 | 80.0% | 400K | Closed weights | $0.75 | $4.5 | 88.0% | N/A | N/A | N/A | N/A | 28.2% | N/A | N/A | N/A | 76.6% |
| 58 | ST | Step-3.5-Flash | 60.4 | N/A | N/A | 55.6 | 57.8 | 88.5 | 60.0% | 256K | Open weights | $0.10 | $0.30 | N/A | N/A | 97.3% | 74.4% | N/A | N/A | N/A | N/A | N/A | N/A |
| 59 | GO | Gemma 4 31B | 60.1 | 69.5 | 63.6 | 62.1 | 71.7 | 76.0 | 100.0% | 262.1K | Open weights | N/A | N/A | 84.3% | 85.2% | N/A | N/A | N/A | 26.5% | N/A | N/A | N/A | 76.9% |
| 60 | ZA | GLM-4.7 | 59.7 | 79.4 | N/A | 53.7 | 47.9 | 81.4 | 80.0% | 204.8K | Open weights | $0.60 | $2.2 | 85.7% | 84.3% | 95.7% | 73.8% | N/A | 42.8% | N/A | N/A | N/A | N/A |
| 61 | AC | Qwen3.5-122B-A10B | 59.2 | 61.7 | 87.8 | 73.4 | 51.6 | 68.5 | 100.0% | 262.1K | Open weights | $0.40 | $3.2 | 86.6% | 86.7% | N/A | 72.0% | N/A | 47.5% | N/A | N/A | N/A | 76.9% |
| 62 | OP | GPT-5.2 Codex | 58.9 | N/A | N/A | N/A | 52.8 | 55.4 | 40.0% | 400K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 63 | BA | ERNIE 5.0 | 58.7 | 77.3 | N/A | 62.0 | N/A | 78.8 | 60.0% | N/A | Closed weights | N/A | N/A | 85.0% | 87.0% | 87.0% | N/A | N/A | 39.0% | N/A | N/A | N/A | N/A |
| 64 | ME | Muse Glimmer-30B | 58.5 | 60.1 | N/A | 40.8 | 45.3 | 62.9 | 80.0% | 131.1K | Open weights | N/A | N/A | 83.5% | N/A | N/A | 76.0% | N/A | 22.0% | N/A | N/A | N/A | 74.0% |
| 65 | MI | MiniMax M2.7 | 58.4 | N/A | N/A | N/A | 37.7 | N/A | 20.0% | 204.8K | Open weights | $0.30 | $1.2 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 66 | DE | DeepSeek-V3.2-Speciale | 58.1 | N/A | N/A | 74.0 | 46.1 | 83.2 | 60.0% | 131.1K | Closed weights | $0.14 | $0.28 | N/A | N/A | 96.0% | 73.1% | N/A | 30.6% | N/A | N/A | N/A | N/A |
| 67 | AC | Qwen3.5-27B | 57.2 | 59.4 | 68.6 | 78.5 | 44.5 | 69.3 | 100.0% | 262.1K | Open weights | $0.30 | $2.4 | 85.5% | 86.1% | N/A | 72.4% | N/A | 48.5% | N/A | N/A | N/A | 75.0% |
| 68 | XA | Grok-4.20 Beta Reasoning | 57.1 | N/A | N/A | N/A | 4.0 | N/A | 20.0% | 2M | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 69 | ZA | GLM-5V-Turbo | 57.0 | 0.0 | N/A | N/A | 80.0 | 16.7 | 60.0% | 200K | Closed weights | $5 | $22 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 70 | GO | Gemini 3.5 Flash-Lite | 57.0 | N/A | N/A | N/A | 26.5 | 26.6 | 40.0% | 1M | Closed weights | $0.30 | $2.5 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 71 | XA | Grok-4 | 56.5 | 51.9 | N/A | 47.8 | 83.3 | 65.5 | 80.0% | 256K | Closed weights | N/A | N/A | 87.5% | N/A | 91.7% | N/A | N/A | 40.0% | 79.0% | N/A | N/A | N/A |
| 72 | AN | Claude Sonnet 4.5 | 56.0 | 72.1 | 33.3 | N/A | 90.8 | 62.9 | 80.0% | 200K | Closed weights | $3 | $15 | 83.4% | N/A | 87.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 73 | MI | MiniMax M2.5 | 55.6 | N/A | 0.0 | N/A | 60.5 | N/A | 40.0% | 204.8K | Open weights | $0.30 | $1.2 | N/A | N/A | N/A | 80.2% | N/A | N/A | N/A | N/A | N/A | N/A |
| 74 | AC | Qwen3.6-35B-A3B | 55.3 | 57.0 | 74.0 | 47.4 | 26.5 | 72.1 | 100.0% | 262.1K | Open weights | $0.248 | $1.49 | 86.0% | 85.2% | N/A | 73.4% | N/A | 21.4% | N/A | N/A | N/A | 75.3% |
| 75 | MI | MAI-Thinking-1 | 55.1 | 74.5 | 13.6 | 30.0 | 54.4 | 75.1 | 100.0% | N/A | Closed weights | N/A | N/A | 84.2% | 85.0% | 97.0% | 73.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 76 | XA | Grok-3 | 54.8 | 76.2 | 74.2 | N/A | 86.1 | 75.2 | 80.0% | 128K | Closed weights | N/A | N/A | 84.6% | N/A | 93.3% | N/A | N/A | N/A | 79.4% | N/A | N/A | N/A |
| 77 | ZA | GLM-4.6 | 54.2 | 65.2 | N/A | 29.9 | 50.4 | 76.1 | 80.0% | 204.8K | Open weights | $0.60 | $2.2 | 81.0% | N/A | 93.9% | 68.0% | N/A | 17.2% | N/A | N/A | N/A | N/A |
| 78 | XA | Grok 4 Fast | 54.0 | 79.4 | N/A | 50.5 | 53.2 | 82.1 | 80.0% | 2M | Closed weights | N/A | N/A | 85.7% | N/A | 92.0% | N/A | N/A | 20.0% | 80.0% | N/A | N/A | N/A |
| 79 | OP | GPT-5.5 Instant | 53.7 | 67.7 | 6.3 | N/A | N/A | 38.4 | 60.0% | 400K | Closed weights | N/A | N/A | 85.6% | N/A | 81.2% | N/A | N/A | N/A | N/A | N/A | N/A | 76.0% |
| 80 | MI | MiniMax M2.1 | 53.7 | 65.2 | N/A | 40.8 | 51.5 | 58.9 | 80.0% | 204.8K | Open weights | $0.30 | $1.2 | 81.0% | 88.0% | 81.0% | 67.0% | N/A | 22.0% | 78.0% | N/A | N/A | N/A |
| 81 | BY | Seed 2.0 Lite | 53.6 | 77.7 | N/A | N/A | 65.6 | 72.6 | 60.0% | N/A | Closed weights | N/A | N/A | 85.1% | N/A | 93.0% | 73.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 82 | XI | MiMo-V2-Omni | 53.3 | N/A | N/A | N/A | 37.3 | N/A | 20.0% | 262.1K | Closed weights | $0.14 | $0.28 | N/A | N/A | N/A | 74.8% | N/A | N/A | N/A | N/A | N/A | N/A |
| 83 | GO | Gemma 4 26B-A4B | 52.6 | 57.3 | 54.5 | 47.2 | 67.5 | 63.8 | 100.0% | 262.1K | Open weights | N/A | N/A | 82.3% | 82.6% | N/A | N/A | N/A | 17.2% | N/A | N/A | N/A | 73.8% |
| 84 | OP | o3 | 52.6 | 50.1 | 63.8 | 47.3 | 51.0 | 62.1 | 100.0% | 200K | Closed weights | $2 | $8 | 83.3% | N/A | 86.4% | 69.1% | N/A | 14.7% | N/A | N/A | N/A | 76.4% |
| 85 | AM Nova 2 ProAmazon | Nova 2 Pro | 52.5 | 71.4 | N/A | N/A | 57.3 | 70.2 | 60.0% | N/A | Closed weights | N/A | N/A | 81.4% | 81.6% | 92.3% | 70.0% | N/A | N/A | 74.6% | N/A | N/A | 63.5% |
| 86 | AN | Claude Opus 4.1 | 52.4 | 64.2 | 66.7 | N/A | 75.8 | 57.4 | 80.0% | 200K | Closed weights | N/A | N/A | 80.9% | N/A | 78.0% | 74.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 87 | AC | Qwen3.5-35B-A3B | 52.0 | 39.3 | 52.4 | 59.2 | 42.7 | 58.2 | 100.0% | 262.1K | Open weights | $0.25 | $2 | 84.2% | 85.3% | N/A | 69.2% | N/A | 47.4% | N/A | N/A | N/A | 75.1% |
| 88 | GO | Gemini 3.1 Flash-Lite | 51.9 | 71.8 | 80.0 | 27.2 | 10.3 | 50.1 | 100.0% | 1M | Closed weights | $0.25 | $1.5 | 86.9% | N/A | N/A | N/A | N/A | 16.0% | N/A | N/A | N/A | 76.8% |
| 89 | XI | MiMo-V2-Flash | 51.3 | 73.0 | N/A | 38.4 | 44.9 | 60.0 | 80.0% | 262.1K | Open weights | $0.14 | $0.28 | 83.7% | 84.9% | 94.1% | 73.4% | N/A | 22.1% | N/A | N/A | N/A | N/A |
| 90 | XA | Grok-4.1 Thinking | 51.2 | N/A | 0.0 | N/A | N/A | 75.0 | 40.0% | 256K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 91 | MI | MAI-Code-1-Flash | 50.4 | 76.2 | N/A | 20.0 | 31.1 | 55.7 | 80.0% | 256K | Closed weights | N/A | N/A | 84.6% | N/A | N/A | 71.6% | N/A | 18.0% | N/A | N/A | N/A | N/A |
| 92 | GO | Gemini 2.5 Pro Preview 06-05 | 49.9 | 81.1 | 70.7 | 39.1 | 66.1 | 72.6 | 100.0% | 1M | Closed weights | $1.25 | $10 | 86.4% | N/A | 88.0% | 67.2% | N/A | 21.6% | 69.0% | N/A | N/A | N/A |
| 93 | OP | GPT-5 Medium | 49.8 | 86.5 | N/A | N/A | N/A | 55.8 | 40.0% | 400K | Closed weights | $1.25 | $10 | 88.1% | N/A | 88.9% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 94 | OP | GPT-5.1 Codex | 49.5 | N/A | N/A | N/A | 49.5 | N/A | 20.0% | 400K | Closed weights | N/A | N/A | N/A | N/A | N/A | 73.7% | N/A | N/A | N/A | N/A | N/A | N/A |
| 95 | ZA | GLM-4.5 | 49.3 | 61.4 | N/A | 56.8 | 58.4 | 84.5 | 80.0% | 131.1K | Open weights | $0.60 | $2.2 | 79.1% | 84.6% | N/A | 64.2% | N/A | 14.4% | 72.9% | N/A | N/A | N/A |
| 96 | MA | Mistral Medium 3.5 | 49.2 | N/A | N/A | 25.0 | 38.3 | 48.6 | 60.0% | 262.1K | Open weights | $1.5 | $7.5 | N/A | N/A | 86.3% | 77.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 97 | OP | GPT-5.4 nano | 49.1 | 54.5 | N/A | 45.6 | 19.8 | 35.6 | 80.0% | 400K | Closed weights | $0.20 | $1.25 | 82.8% | N/A | N/A | N/A | N/A | 24.3% | N/A | N/A | N/A | 66.1% |
| 98 | AC | Qwen3-235B-A22B-Thinking-2507 | 48.5 | 71.4 | N/A | 46.6 | 40.4 | 80.0 | 80.0% | 262.1K | Closed weights | N/A | N/A | 81.1% | 84.4% | 92.3% | N/A | N/A | 18.2% | N/A | N/A | N/A | N/A |
| 99 | XA | Grok-3 Mini | 48.4 | 73.6 | N/A | N/A | 90.3 | 61.1 | 60.0% | 128K | Closed weights | N/A | N/A | 84.0% | N/A | 90.8% | N/A | N/A | N/A | 80.4% | N/A | N/A | N/A |
| 100 | XI | MiMo-V2.5-Pro | 46.7 | 70.0 | 88.2 | 82.7 | 50.1 | 72.7 | 100.0% | 1M | Open weights | $0.435 | $0.87 | 66.7% | 68.5% | N/A | 78.9% | 89.4% | 34.0% | N/A | 86.2% | N/A | N/A |
| 101 | XA | Grok-4.1 | 46.6 | N/A | N/A | N/A | N/A | 50.0 | 20.0% | 256K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 102 | OP | GPT OSS 20B High | 46.5 | 52.6 | N/A | N/A | N/A | 91.2 | 40.0% | 131.1K | Closed weights | N/A | N/A | 74.2% | N/A | 98.7% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 103 | AN | Claude Opus 4 | 46.4 | 37.7 | 33.3 | N/A | 68.6 | 50.3 | 80.0% | 200K | Closed weights | N/A | N/A | 79.6% | N/A | 75.5% | 72.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 104 | AC | Qwen3 VL 235B A22B Thinking | 45.8 | 53.9 | 45.3 | 48.7 | 61.6 | 62.2 | 100.0% | 262.1K | Closed weights | N/A | N/A | N/A | 83.8% | 89.7% | N/A | 90.6% | 13.6% | N/A | N/A | N/A | 69.3% |
| 105 | AN | Claude Haiku 4.5 | 45.5 | 48.9 | 0.0 | N/A | 55.1 | 33.0 | 80.0% | 200K | Closed weights | $1 | $5 | 73.0% | N/A | 80.7% | 73.3% | N/A | N/A | N/A | N/A | N/A | N/A |
| 106 | OP | o4-mini | 45.0 | 66.7 | 82.3 | 57.2 | 52.2 | 44.5 | 100.0% | 200K | Closed weights | $1.1 | $4.4 | 81.4% | N/A | 92.7% | 68.1% | N/A | 14.7% | N/A | N/A | N/A | N/A |
| 107 | OP | GPT-5 mini | 44.9 | 68.5 | N/A | 33.4 | N/A | 63.3 | 60.0% | 400K | Closed weights | $0.25 | $2 | 82.3% | N/A | 91.1% | N/A | N/A | 16.7% | N/A | N/A | N/A | N/A |
| 108 | LA | K-EXAONE-236B-A23B | 44.9 | N/A | N/A | N/A | 47.8 | 57.5 | 40.0% | 32.8K | Closed weights | N/A | N/A | N/A | 83.8% | 92.8% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 109 | NV | Nemotron 3 Super (120B A12B) | 44.8 | 70.0 | N/A | 60.8 | 23.5 | 64.5 | 80.0% | 262.1K | Open weights | $0.20 | $0.80 | 82.7% | 83.7% | 90.2% | 53.7% | N/A | 22.8% | 81.2% | N/A | N/A | N/A |
| 110 | SA | Sarvam-105B | 44.6 | 60.1 | N/A | 49.9 | 28.8 | 65.1 | 80.0% | 131.1K | Open weights | N/A | N/A | 78.7% | 81.7% | 96.7% | 45.0% | 90.6% | 11.2% | N/A | N/A | N/A | N/A |
| 111 | DE | DeepSeek-R1-0528 | 44.2 | 65.2 | N/A | 28.3 | 22.5 | 77.2 | 80.0% | 131.1K | Closed weights | N/A | N/A | 81.0% | 85.0% | 87.5% | 44.6% | N/A | 17.7% | 73.3% | N/A | N/A | N/A |
| 112 | OP | GPT OSS 120B High | 44.0 | 64.2 | N/A | N/A | 47.9 | 55.9 | 60.0% | 131.1K | Closed weights | N/A | N/A | 80.9% | 80.7% | 92.5% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 113 | MI | MiniMax M2 | 43.9 | 59.4 | N/A | 17.4 | 41.4 | 52.4 | 80.0% | 196.6K | Open weights | $0.30 | $1.2 | 78.0% | 82.0% | 78.0% | 69.4% | N/A | 12.5% | 83.0% | N/A | N/A | N/A |
| 114 | AMNova 2 OmniAmazon | Nova 2 Omni | 43.9 | 20.9 | N/A | N/A | 48.0 | 59.4 | 60.0% | N/A | Closed weights | N/A | N/A | N/A | 80.7% | 92.1% | N/A | N/A | N/A | N/A | N/A | N/A | 61.4% |
| 115 | OP | GPT-5 Codex | 43.6 | N/A | N/A | N/A | 64.9 | N/A | 20.0% | 400K | Closed weights | N/A | N/A | N/A | N/A | N/A | 74.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 116 | ST | Step3-VL-10B | 43.6 | N/A | 75.8 | 72.2 | N/A | 77.2 | 60.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | 87.7% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 117 | AC | Qwen3 VL 235B A22B Instruct | 43.2 | 65.5 | 45.3 | 44.6 | 59.3 | 62.5 | 100.0% | 262.1K | Closed weights | N/A | N/A | N/A | 81.8% | 74.7% | N/A | 88.8% | N/A | N/A | N/A | N/A | 68.1% |
| 118 | AMNova 2 LiteAmazon | Nova 2 Lite | 43.0 | 35.7 | N/A | N/A | 35.5 | 73.6 | 60.0% | 1M | Closed weights | $0.33 | $2.75 | 79.6% | 80.9% | 91.0% | 64.5% | N/A | N/A | 71.0% | N/A | N/A | 61.8% |
| 119 | AC | Qwen3-235B-A22B-Instruct-2507 | 42.4 | 61.1 | 0.0 | 20.8 | 40.2 | 65.8 | 100.0% | 262.1K | Open weights | $0.70 | $2.8 | 77.5% | 83.0% | 70.3% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 120 | OP | GPT-5.3 Chat | 42.2 | N/A | N/A | N/A | N/A | 31.3 | 20.0% | 128K | Closed weights | $1.75 | $14 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 121 | CO | Command A+ | 41.9 | 33.1 | 67.7 | 86.8 | 33.3 | 51.8 | 100.0% | 128K | Open weights | $2.5 | $10 | N/A | N/A | 90.0% | N/A | N/A | N/A | N/A | N/A | N/A | 63.0% |
| 122 | ZA | GLM-4.5-Air | 41.5 | 54.3 | N/A | 51.1 | 48.2 | 74.9 | 80.0% | 131.1K | Open weights | $0.20 | $1.1 | 75.0% | 81.4% | N/A | 57.6% | N/A | 10.6% | 70.7% | N/A | N/A | N/A |
| 123 | AC | Qwen3.5-9B | 41.4 | 58.9 | N/A | 28.1 | 33.5 | 46.6 | 80.0% | 262.1K | Open weights | N/A | N/A | 81.7% | 82.5% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 124 | AC | Qwen3-Next-80B-A3B-Thinking | 40.9 | 58.2 | N/A | 37.5 | 41.2 | 64.5 | 80.0% | 131.1K | Open weights | $0.50 | $6 | 77.2% | 82.7% | 87.8% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 125 | XA | Grok 4.3 | 40.7 | N/A | N/A | N/A | 28.0 | N/A | 20.0% | 1M | Closed weights | $1.25 | $2.5 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 126 | AC | Qwen3 Max | 40.7 | 33.0 | N/A | N/A | 38.0 | 57.6 | 60.0% | 262.1K | Closed weights | $1.2 | $6 | 62.0% | N/A | 81.6% | 69.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 127 | AC | Qwen3 VL 32B Thinking | 40.5 | 65.5 | 64.8 | 60.6 | 60.2 | 58.1 | 100.0% | N/A | Closed weights | N/A | N/A | 73.1% | 82.1% | 83.7% | N/A | 88.7% | N/A | N/A | N/A | N/A | 68.1% |
| 128 | DE | DeepSeek-V3.1 | 39.9 | 53.6 | N/A | 14.6 | 31.4 | 61.6 | 80.0% | 131.1K | Open weights | N/A | N/A | 74.9% | 83.7% | 49.8% | 66.0% | N/A | 15.9% | 56.4% | N/A | N/A | N/A |
| 129 | AN | Claude Sonnet 4 | 39.5 | 56.2 | 62.9 | N/A | 65.9 | 38.6 | 80.0% | 200K | Closed weights | N/A | N/A | 75.4% | N/A | 70.5% | 72.7% | N/A | N/A | N/A | N/A | N/A | N/A |
| 130 | IN | Mercury 2 | 39.3 | 51.7 | N/A | N/A | 35.2 | 56.6 | 60.0% | 128K | Closed weights | $0.25 | $0.75 | 74.0% | N/A | 91.1% | N/A | N/A | N/A | 67.0% | N/A | N/A | N/A |
| 131 | AN | Claude 3.7 Sonnet | 38.7 | 76.8 | 66.1 | 56.5 | 60.5 | 51.3 | 100.0% | 200K | Closed weights | N/A | N/A | 84.8% | N/A | 54.8% | 70.3% | N/A | N/A | N/A | N/A | N/A | N/A |
| 132 | ZA | GLM-4.7-Flash | 38.5 | 55.8 | N/A | 20.1 | 17.7 | 64.6 | 80.0% | 200K | Open weights | N/A | N/A | 75.2% | N/A | 91.6% | 59.2% | N/A | 14.4% | N/A | N/A | N/A | N/A |
| 133 | GO | Gemma 4 12B | 38.2 | 51.8 | 36.4 | 32.8 | 29.3 | 41.9 | 100.0% | N/A | Closed weights | N/A | N/A | 78.8% | 77.2% | N/A | N/A | N/A | 5.2% | N/A | N/A | N/A | 69.1% |
| 134 | GO | Gemini 2.5 Flash | 38.1 | 70.6 | 79.0 | 14.1 | 46.1 | 52.5 | 100.0% | 1M | Closed weights | $0.30 | $2.5 | 82.8% | N/A | 72.0% | 60.4% | N/A | 11.0% | N/A | N/A | N/A | N/A |
| 135 | CO | North Mini Code 1.0 | 37.4 | N/A | N/A | N/A | 22.5 | N/A | 20.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | 67.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 136 | MA | Kimi K2-Instruct-0905 | 37.2 | 55.1 | N/A | 42.5 | 31.7 | 50.0 | 80.0% | N/A | Closed weights | $0.60 | $2.5 | 75.1% | 81.1% | 49.5% | 65.8% | 89.5% | 4.7% | 53.7% | N/A | N/A | N/A |
| 137 | MI | MiniMax M1 80K | 37.0 | 45.1 | N/A | 39.0 | 56.9 | 46.3 | 80.0% | 1M | Closed weights | N/A | N/A | 70.0% | 81.1% | 76.9% | 56.0% | N/A | 8.4% | 65.0% | N/A | N/A | N/A |
| 138 | ME | LongCat-Flash-Chat | 36.9 | 50.2 | N/A | 54.8 | 42.8 | 55.5 | 80.0% | 128K | Closed weights | N/A | N/A | 73.2% | 82.7% | 61.3% | 60.4% | 89.7% | N/A | 48.0% | N/A | 88.4% | N/A |
| 139 | AC | Qwen3-Next-80B-A3B-Instruct | 36.6 | 53.4 | N/A | 16.7 | 28.4 | 54.1 | 80.0% | 131.1K | Open weights | $0.50 | $2 | 72.9% | 80.6% | 69.5% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 140 | OP | o1 | 36.3 | 59.4 | 72.6 | 66.3 | 46.7 | 56.3 | 100.0% | 200K | Closed weights | $15 | $60 | 78.0% | N/A | N/A | 41.0% | 91.8% | N/A | N/A | 96.4% | 88.1% | N/A |
| 141 | OP | o3-mini | 36.3 | 58.1 | N/A | 56.3 | 36.2 | 63.9 | 80.0% | 200K | Closed weights | $1.1 | $4.4 | 77.2% | N/A | N/A | 49.3% | 86.9% | N/A | N/A | 97.9% | N/A | N/A |
| 142 | OP | GPT-4.5 | 36.2 | 43.8 | 69.3 | 85.0 | 40.5 | 52.8 | 100.0% | 128K | Closed weights | N/A | N/A | 69.5% | N/A | N/A | 38.0% | 90.8% | N/A | N/A | N/A | 88.0% | N/A |
| 143 | XA | Grok Code Fast 1 | 36.0 | N/A | N/A | N/A | 47.1 | N/A | 20.0% | 256K | Closed weights | N/A | N/A | N/A | N/A | N/A | 70.8% | N/A | N/A | N/A | N/A | N/A | N/A |
| 144 | AC | Qwen3-Coder 480B A35B Instruct | 35.5 | N/A | N/A | N/A | 43.4 | N/A | 20.0% | 262.1K | Open weights | $1.5 | $7.5 | N/A | N/A | N/A | 69.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 145 | MI | MiniMax M1 40K | 35.3 | 43.4 | N/A | 29.6 | 50.9 | 48.3 | 80.0% | N/A | Closed weights | N/A | N/A | 69.2% | 80.6% | 74.6% | 55.6% | N/A | 7.2% | 62.3% | N/A | N/A | N/A |
| 146 | AC | Qwen3 VL 32B Instruct | 35.2 | 58.8 | 70.6 | 48.9 | 46.4 | 43.9 | 100.0% | N/A | Closed weights | N/A | N/A | 68.9% | 78.6% | 66.2% | N/A | 86.4% | N/A | N/A | N/A | N/A | 65.3% |
| 147 | NV | Nemotron 3 Nano (30B A3B) | 35.2 | 54.3 | N/A | 25.0 | 9.7 | 65.2 | 80.0% | 262.1K | Open weights | N/A | N/A | 75.0% | 78.3% | 99.2% | 38.8% | N/A | 15.5% | N/A | N/A | N/A | N/A |
| 148 | SA | Sarvam-30B | 34.3 | 39.1 | N/A | 30.5 | 49.6 | 71.8 | 80.0% | 128K | Open weights | N/A | N/A | 66.5% | 80.0% | 96.7% | 34.0% | 85.1% | N/A | N/A | N/A | 92.1% | N/A |
| 149 | OP | o1-pro | 34.2 | 60.9 | N/A | N/A | N/A | 71.2 | 40.0% | 200K | Closed weights | $150 | $600 | 79.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 150 | GO | DiffusionGemma 26B-A4B | 34.2 | 33.4 | 45.5 | 34.0 | 18.6 | 40.5 | 100.0% | N/A | Closed weights | N/A | N/A | 73.2% | 77.6% | N/A | N/A | N/A | 11.9% | N/A | N/A | N/A | 54.3% |
| 151 | MA | Mistral Small 4 | 33.4 | 35.9 | N/A | N/A | 73.9 | 36.0 | 60.0% | 256K | Open weights | $0.15 | $0.60 | 71.2% | 78.0% | 83.8% | N/A | N/A | N/A | 63.6% | N/A | N/A | 60.0% |
| 152 | ME | LongCat-Flash-Lite | 33.0 | 40.3 | N/A | 69.3 | 29.6 | 37.5 | 80.0% | 256K | Closed weights | N/A | N/A | 66.8% | 78.3% | 63.2% | 54.4% | 85.5% | N/A | N/A | N/A | N/A | N/A |
| 153 | AC | Qwen3.5-4B | 32.4 | 45.4 | N/A | 18.8 | 20.6 | 35.5 | 80.0% | N/A | Closed weights | N/A | N/A | 76.2% | 79.1% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 154 | NV | Nemotron Nano 9B v2 | 32.4 | 34.3 | N/A | 87.1 | 75.0 | 52.9 | 80.0% | 131.1K | Open weights | N/A | N/A | 64.0% | N/A | 72.1% | N/A | N/A | N/A | 71.1% | N/A | N/A | N/A |
| 155 | AN | Claude 3.5 Sonnet | 32.1 | 80.4 | 45.2 | 76.1 | 48.8 | 80.4 | 100.0% | 200K | Closed weights | N/A | N/A | 67.2% | 77.6% | N/A | 49.0% | 90.4% | N/A | N/A | 78.3% | 93.7% | N/A |
| 156 | AC | Qwen3 30B A3B | 32.1 | 37.5 | N/A | N/A | 49.2 | 38.7 | 60.0% | 128K | Closed weights | N/A | N/A | 65.8% | N/A | 70.9% | N/A | N/A | N/A | 62.6% | N/A | N/A | N/A |
| 157 | OP | GPT-4.1 | 31.9 | 38.6 | 64.5 | 26.7 | 37.7 | 39.0 | 100.0% | 1M | Closed weights | $2 | $8 | 66.3% | N/A | 46.4% | 54.6% | 90.2% | 5.4% | N/A | N/A | N/A | N/A |
| 158 | AC | Qwen3 VL 30B A3B Thinking | 31.8 | 45.6 | 52.3 | 43.3 | 38.8 | 39.6 | 100.0% | 262.1K | Closed weights | N/A | N/A | 74.4% | 80.5% | 83.1% | N/A | 87.6% | N/A | N/A | N/A | N/A | 63.0% |
| 159 | AC | Qwen3 32B | 31.2 | N/A | N/A | N/A | 45.1 | 45.2 | 40.0% | 131.1K | Open weights | $0.70 | $2.8 | N/A | N/A | 72.9% | N/A | N/A | N/A | 65.7% | N/A | N/A | N/A |
| 160 | OP | GPT-5 nano | 31.1 | 47.2 | N/A | 16.8 | N/A | 47.8 | 60.0% | 400K | Closed weights | $0.05 | $0.40 | 71.2% | N/A | 85.2% | N/A | N/A | 8.7% | N/A | N/A | N/A | N/A |
| 161 | NV | Llama 3.1 Nemotron Ultra 253B v1 | 30.5 | 57.1 | N/A | 75.8 | 66.7 | 48.1 | 80.0% | N/A | Closed weights | N/A | N/A | 76.0% | N/A | 72.5% | N/A | N/A | N/A | 66.3% | N/A | N/A | N/A |
| 162 | MA | Kimi-k1.5 | 30.1 | N/A | 49.2 | 70.3 | N/A | 62.0 | 60.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 87.4% | N/A | N/A | N/A | N/A | N/A |
| 163 | GO | Gemini 2.0 Flash Thinking | 29.9 | 52.6 | 71.0 | N/A | N/A | 30.8 | 60.0% | N/A | Closed weights | N/A | N/A | 74.2% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 164 | MA | Ministral 3 (8B Reasoning 2512) | 29.0 | 40.8 | N/A | N/A | 55.6 | 37.2 | 60.0% | 262.1K | Closed weights | $0.10 | $0.10 | 66.8% | N/A | 78.7% | N/A | N/A | N/A | 61.6% | N/A | N/A | N/A |
| 165 | AC | Qwen3 VL 30B A3B Instruct | 28.8 | 31.7 | 44.0 | 28.7 | 26.8 | 36.7 | 100.0% | 262.1K | Closed weights | N/A | N/A | 70.4% | 77.8% | 69.3% | N/A | 85.0% | N/A | N/A | N/A | N/A | 60.4% |
| 166 | AC | Qwen3 VL 8B Thinking | 28.5 | 39.3 | 30.8 | 38.2 | 28.8 | 38.3 | 100.0% | 262.1K | Closed weights | N/A | N/A | 69.9% | 77.3% | 80.3% | N/A | 85.2% | N/A | N/A | N/A | N/A | 60.4% |
| 167 | GO | Gemini 2.0 Flash | 28.1 | 33.7 | 54.8 | 97.2 | 27.8 | 61.0 | 100.0% | 1M | Closed weights | N/A | N/A | 62.1% | 76.4% | N/A | N/A | N/A | N/A | 35.1% | 89.7% | N/A | N/A |
| 168 | MI | Phi 4 Reasoning Plus | 26.8 | 42.7 | N/A | N/A | 66.3 | 41.5 | 60.0% | N/A | Closed weights | $0.125 | $0.50 | 68.9% | 76.0% | 78.0% | N/A | N/A | N/A | 53.1% | N/A | N/A | N/A |
| 169 | DE | DeepSeek-V3 0324 | 26.0 | 42.1 | N/A | 32.3 | 36.1 | 41.9 | 80.0% | 163.8K | Closed weights | N/A | N/A | 68.4% | 81.2% | N/A | N/A | N/A | N/A | 49.2% | N/A | N/A | N/A |
| 170 | AC | Qwen2-VL-72B-Instruct | 25.5 | 57.1 | 34.4 | 18.2 | N/A | 81.3 | 80.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 46.2% |
| 171 | ME | Llama 4 Maverick | 24.9 | 53.8 | 61.3 | 58.6 | 43.2 | 79.5 | 100.0% | 1M | Closed weights | N/A | N/A | 69.8% | 80.5% | N/A | N/A | 85.5% | N/A | 43.4% | 61.2% | N/A | 59.6% |
| 172 | AC | QwQ-32B | 24.8 | 36.5 | N/A | 21.0 | 34.9 | 40.0 | 80.0% | N/A | Closed weights | $0.287 | $0.861 | 65.2% | N/A | N/A | N/A | N/A | N/A | 63.4% | N/A | N/A | N/A |
| 173 | AC | Qwen3 VL 8B Instruct | 24.8 | 39.2 | 16.0 | 21.0 | 29.3 | 27.1 | 100.0% | 262.1K | Closed weights | N/A | N/A | N/A | 71.6% | 45.9% | N/A | 80.7% | N/A | N/A | N/A | N/A | 55.9% |
| 174 | OP | GPT-4.1 mini | 24.8 | 35.6 | 58.1 | 28.4 | 13.1 | 30.9 | 100.0% | 1M | Closed weights | $0.40 | $1.6 | 65.0% | N/A | 40.2% | 23.6% | 87.5% | 3.7% | N/A | N/A | N/A | N/A |
| 175 | ME | Llama 3.1 405B Instruct | 24.5 | 61.1 | N/A | 76.5 | 87.7 | 68.0 | 80.0% | 128K | Closed weights | N/A | N/A | 50.7% | 73.3% | N/A | N/A | 87.3% | N/A | N/A | 73.8% | 89.0% | N/A |
| 176 | GO | Gemma 4 E4B | 24.4 | 22.2 | 18.2 | 25.8 | 18.2 | 31.7 | 100.0% | 131.1K | Open weights | N/A | N/A | 58.6% | 69.4% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 52.6% |
| 177 | MA | Devstral Medium | 24.0 | N/A | N/A | N/A | 26.9 | N/A | 20.0% | 128K | Closed weights | $0.40 | $2 | N/A | N/A | N/A | 61.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 178 | OP | GPT-4o | 23.9 | 42.9 | 30.2 | 19.8 | 10.8 | 23.7 | 100.0% | 128K | Closed weights | $2.5 | $10 | 70.1% | 74.7% | N/A | 33.2% | 85.7% | 5.3% | N/A | N/A | N/A | 59.9% |
| 179 | AC | Qwen3 VL 4B Thinking | 23.0 | 27.2 | 28.3 | 27.5 | 25.5 | 25.8 | 100.0% | 262.1K | Closed weights | N/A | N/A | 64.1% | 73.6% | 74.5% | N/A | 81.5% | N/A | N/A | N/A | N/A | 57.0% |
| 180 | AC | Qwen2.5 VL 72B Instruct | 22.7 | 42.5 | 44.6 | 20.8 | 12.6 | 37.2 | 100.0% | 131.1K | Open weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 51.1% |
| 181 | NV | Llama-3.3 Nemotron Super 49B v1 | 22.4 | 39.5 | N/A | 64.5 | 96.9 | 48.0 | 80.0% | 131.1K | Open weights | N/A | N/A | 66.7% | N/A | 58.4% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 182 | OP | MiniCPM-SALA | 22.3 | N/A | N/A | N/A | 69.6 | 26.3 | 40.0% | N/A | Closed weights | N/A | N/A | N/A | 67.0% | 78.3% | N/A | N/A | N/A | N/A | N/A | 95.1% | N/A |
| 183 | MI | Phi 4 Reasoning | 22.0 | 37.5 | N/A | N/A | 73.6 | 30.5 | 60.0% | N/A | Closed weights | $0.125 | $0.50 | 65.8% | 74.3% | 62.9% | N/A | N/A | N/A | 53.8% | N/A | N/A | N/A |
| 184 | ME | Llama 3.3 70B Instruct | 22.0 | 24.9 | N/A | 68.6 | 66.9 | 68.7 | 80.0% | 128K | Open weights | N/A | N/A | 50.5% | 68.9% | N/A | N/A | 86.0% | N/A | N/A | 77.0% | 88.4% | N/A |
| 185 | MA | Pixtral Large | 21.2 | 82.1 | 38.7 | 63.2 | N/A | 65.6 | 80.0% | 128K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 186 | GO | Gemini 2.0 Flash-Lite | 21.0 | 26.6 | 43.5 | 86.0 | N/A | 39.7 | 80.0% | 1M | Closed weights | N/A | N/A | 51.5% | 71.6% | N/A | N/A | N/A | N/A | N/A | 86.8% | N/A | N/A |
| 187 | XA | Grok-2 | 21.0 | 29.2 | 41.9 | 62.4 | 66.9 | 45.3 | 100.0% | 128K | Closed weights | N/A | N/A | 56.0% | 75.5% | N/A | N/A | 87.5% | N/A | N/A | 76.1% | 88.4% | N/A |
| 188 | AC | Qwen2.5 72B Instruct | 20.9 | 22.5 | N/A | 80.1 | 60.3 | 54.9 | 80.0% | 131.1K | Closed weights | $1.4 | $5.6 | 49.0% | 71.1% | N/A | N/A | N/A | N/A | 55.5% | 83.1% | 86.6% | N/A |
| 189 | AMNova ProAmazon | Nova Pro | 20.9 | 65.3 | 66.1 | 80.7 | 52.7 | 75.0 | 100.0% | 300K | Closed weights | $0.80 | $3.2 | 46.9% | N/A | N/A | N/A | 85.9% | N/A | N/A | 76.6% | 89.0% | N/A |
| 190 | MA | Min istral 3 (3B Reasoning 2512) | 20.8 | 27.9 | N/A | N/A | 48.6 | 26.1 | 60.0% | 131.1K | Closed weights | $0.04 | $0.04 | 53.4% | N/A | 72.1% | N/A | N/A | N/A | 54.8% | N/A | N/A | N/A |
| 191 | GO | Gemini 1.5 Pro | 20.5 | 31.3 | 40.3 | 52.0 | 41.5 | 72.8 | 100.0% | 2.1M | Closed weights | N/A | N/A | 59.1% | 75.8% | N/A | N/A | 85.9% | N/A | N/A | 86.5% | 84.1% | N/A |
| 192 | MA | Magistral Small 2506 | 19.8 | 41.6 | N/A | N/A | 41.7 | 15.9 | 60.0% | 131.1K | Open weights | N/A | N/A | 68.2% | N/A | 62.8% | N/A | N/A | N/A | 51.3% | N/A | N/A | N/A |
| 193 | MA | Magistral Medium | 19.8 | 46.4 | N/A | 10.9 | 29.7 | 18.6 | 80.0% | N/A | Closed weights | N/A | N/A | 70.8% | N/A | 64.9% | N/A | N/A | 9.0% | 50.3% | N/A | N/A | N/A |
| 194 | AC | Qwen3 VL 4B Instruct | 19.3 | 20.8 | 12.1 | 12.9 | 17.8 | 19.6 | 100.0% | 262.1K | Closed weights | N/A | N/A | N/A | 67.1% | 46.6% | N/A | 77.2% | N/A | N/A | N/A | N/A | 53.2% |
| 195 | GO | Gemini 2.5 Flash-Lite | 19.1 | 35.2 | 59.7 | 3.3 | 9.8 | 36.1 | 100.0% | 1M | Closed weights | $0.10 | $0.40 | 64.6% | N/A | 49.8% | 31.6% | N/A | 5.1% | 33.7% | N/A | N/A | N/A |
| 196 | AC | Qwen2.5 VL 32B Instruct | 17.9 | 32.0 | 49.2 | 38.6 | 49.4 | 15.2 | 100.0% | N/A | Closed weights | N/A | N/A | 46.0% | 68.8% | N/A | N/A | 78.4% | N/A | N/A | 82.2% | 91.5% | 49.5% |
| 197 | MA | Devstral Small 1.1 | 17.1 | N/A | N/A | N/A | 16.4 | N/A | 20.0% | 128K | Open weights | $0.10 | $0.30 | N/A | N/A | N/A | 53.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 198 | OP | o1-mini | 16.8 | 32.6 | N/A | 12.9 | 90.8 | 59.1 | 80.0% | 128K | Closed weights | N/A | N/A | 60.0% | N/A | N/A | N/A | 85.2% | N/A | N/A | N/A | 92.4% | N/A |
| 199 | AN | Claude 3 Opus | 16.7 | 59.2 | N/A | 60.5 | 46.1 | 72.7 | 80.0% | 200K | Closed weights | N/A | N/A | 50.4% | 68.5% | N/A | N/A | 86.8% | N/A | N/A | 60.1% | 84.9% | N/A |
| 200 | XA | Grok-2 mini | 16.3 | 26.0 | 37.1 | 56.1 | 50.8 | 39.8 | 100.0% | N/A | Closed weights | N/A | N/A | 51.0% | 72.0% | N/A | N/A | 86.2% | N/A | N/A | 73.0% | 85.7% | N/A |
| 201 | MA | Mistral Small 3.2 24B Instruct | 15.9 | 57.7 | 35.5 | 45.8 | N/A | 36.4 | 80.0% | N/A | Closed weights | N/A | N/A | 46.1% | 69.1% | N/A | N/A | 80.5% | N/A | N/A | 69.4% | N/A | N/A |
| 202 | MA | Mistral Large 3 (675B Instruct 2512) | 15.8 | 16.9 | N/A | 70.0 | 24.3 | 36.4 | 80.0% | 262.1K | Open weights | $0.50 | $1.5 | 43.9% | N/A | N/A | N/A | N/A | N/A | 34.4% | N/A | N/A | N/A |
| 203 | GO | Gemma 3 27B | 15.8 | 20.4 | 20.0 | 69.1 | 39.2 | 50.1 | 100.0% | 131.1K | Closed weights | N/A | N/A | 42.4% | 67.5% | N/A | N/A | N/A | N/A | 29.7% | 89.0% | 87.8% | N/A |
| 204 | AMNova 2 SonicAmazon | Nova 2 Sonic | 15.7 | N/A | N/A | N/A | 70.0 | 3.6 | 40.0% | 1M | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 205 | DE | DeepSeek R1 Distill Qwen 7B | 15.7 | 23.2 | N/A | 25.8 | 29.9 | 61.5 | 80.0% | N/A | Closed weights | N/A | N/A | 49.1% | N/A | N/A | N/A | N/A | N/A | 37.6% | N/A | N/A | N/A |
| 206 | DE | DeepSeek-V2.5 | 15.2 | N/A | N/A | 69.4 | 38.2 | 60.9 | 60.0% | 8.2K | Closed weights | N/A | N/A | N/A | N/A | N/A | 16.8% | 80.4% | N/A | N/A | 74.7% | 89.0% | N/A |
| 207 | AC | QvQ-72B-Preview | 14.9 | N/A | 53.2 | 37.4 | N/A | N/A | 40.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 208 | AC | Qwen2.5 32B Instruct | 14.8 | 30.0 | N/A | 81.1 | 68.3 | 53.6 | 80.0% | N/A | Closed weights | $0.70 | $2.8 | 49.5% | 69.0% | N/A | N/A | 83.3% | N/A | N/A | 83.1% | 88.4% | N/A |
| 209 | OP | GPT-4 Turbo | 14.6 | 21.5 | N/A | 70.3 | 55.4 | 69.2 | 80.0% | 128K | Closed weights | $10 | $30 | 48.0% | N/A | N/A | N/A | 86.5% | N/A | N/A | 72.6% | 87.1% | N/A |
| 210 | ME | Llama 4 Scout | 14.1 | 56.3 | 46.8 | 44.3 | 23.8 | 60.0 | 100.0% | 10M | Closed weights | N/A | N/A | 57.2% | 74.3% | N/A | N/A | 79.6% | N/A | 32.8% | 50.3% | N/A | N/A |
| 211 | MI | Phi 4 Mini Reasoning | 13.8 | 27.5 | N/A | 41.9 | N/A | N/A | 40.0% | N/A | Closed weights | $0.075 | $0.30 | 52.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 212 | AMNova LiteAmazon | Nova Lite | 13.2 | 51.1 | 35.5 | 59.9 | 34.2 | 42.6 | 100.0% | 300K | Closed weights | $0.06 | $0.24 | 42.0% | N/A | N/A | N/A | 80.5% | N/A | N/A | 73.3% | 85.4% | N/A |
| 213 | ME | Llama 3.1 70B Instruct | 13.2 | 51.8 | N/A | 77.6 | 61.2 | 41.9 | 80.0% | 128K | Closed weights | N/A | N/A | 41.7% | 66.4% | N/A | N/A | 83.6% | N/A | N/A | N/A | 80.5% | N/A |
| 214 | AC | Qwen2.5 VL 7B Instruct | 12.8 | 37.6 | 23.8 | 8.4 | 6.7 | 16.9 | 100.0% | N/A | Closed weights | $0.35 | $1.05 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 38.3% |
| 215 | DE | DeepSeek R1 Distill Llama 8B | 12.4 | 22.5 | N/A | 9.7 | 31.9 | 46.1 | 80.0% | N/A | Closed weights | N/A | N/A | 49.0% | N/A | N/A | N/A | N/A | N/A | 39.6% | N/A | N/A | N/A |
| 216 | GO | Gemma 4 E2B | 11.6 | 11.0 | 9.1 | 19.4 | 8.1 | 19.9 | 100.0% | 131.1K | Open weights | N/A | N/A | 43.4% | 60.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 44.2% |
| 217 | GO | Gemma 3 12B | 11.2 | 14.1 | 10.0 | 57.3 | 32.4 | 51.9 | 100.0% | 131.1K | Closed weights | N/A | N/A | 40.9% | 60.6% | N/A | N/A | N/A | N/A | 24.6% | 83.8% | 85.4% | N/A |
| 218 | ME | Llama 3.2 90B Instruct | 10.8 | 35.0 | 30.6 | 32.5 | N/A | 41.3 | 80.0% | 128K | Closed weights | N/A | N/A | 46.7% | N/A | N/A | N/A | 86.0% | N/A | N/A | 68.0% | N/A | 45.2% |
| 219 | GO | Gemini 1.5 Flash | 10.7 | 26.0 | 33.9 | 40.4 | 23.1 | 46.6 | 100.0% | 1M | Closed weights | N/A | N/A | 51.0% | 67.3% | N/A | N/A | 78.9% | N/A | N/A | 77.9% | 74.3% | N/A |
| 220 | NV | Llama 3.1 Nemotron Nano 8B V1 | 10.4 | 28.8 | N/A | 45.2 | 84.4 | 14.7 | 80.0% | N/A | Closed weights | N/A | N/A | 54.1% | N/A | 47.1% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 221 | AC | Qwen2.5-Omni-7B | 10.2 | 21.8 | 27.7 | 35.3 | 26.1 | 25.1 | 100.0% | N/A | Closed weights | $0.10 | $0.40 | 30.8% | 47.0% | N/A | N/A | N/A | N/A | N/A | 71.5% | 78.7% | 36.6% |
| 222 | AC | Qwen2 72B Instruct | 9.8 | 22.8 | N/A | 61.0 | 46.6 | 51.9 | 80.0% | N/A | Closed weights | N/A | N/A | 42.4% | 64.4% | N/A | N/A | 82.3% | N/A | N/A | 59.7% | 86.0% | N/A |
| 223 | MI | Phi 4 | 9.4 | 29.6 | N/A | 56.1 | 38.5 | 18.1 | 80.0% | 16K | Closed weights | $0.125 | $0.50 | 56.1% | 70.4% | N/A | N/A | 84.8% | N/A | N/A | 80.4% | 82.6% | N/A |
| 224 | AN | Claude 3.5 Haiku | 9.3 | 13.7 | N/A | 56.8 | 19.9 | 38.0 | 80.0% | 200K | Closed weights | N/A | N/A | 41.6% | 65.0% | N/A | 40.6% | N/A | N/A | N/A | 69.4% | 88.1% | N/A |
| 225 | MA | Mistral Small 3.1 24B Instruct | 8.4 | 18.9 | 53.0 | 40.7 | 59.2 | 19.6 | 100.0% | N/A | Closed weights | N/A | N/A | 46.0% | 66.8% | N/A | N/A | 80.6% | N/A | N/A | 69.3% | 88.4% | N/A |
| 226 | AC | Qwen2.5 14B Instruct | 8.2 | 21.4 | N/A | 62.1 | 51.2 | 32.7 | 80.0% | N/A | Closed weights | $0.35 | $1.4 | 45.5% | 63.7% | N/A | N/A | 79.7% | N/A | N/A | 80.0% | 83.5% | N/A |
| 227 | OP | GPT-4o mini | 8.1 | 12.0 | 29.0 | 42.9 | 28.5 | 55.3 | 100.0% | 128K | Closed weights | $0.15 | $0.60 | 40.2% | N/A | N/A | 8.7% | 82.0% | N/A | N/A | 70.2% | 87.2% | N/A |
| 228 | NR | Hermes 3 70B | 8.0 | 29.7 | 35.7 | 34.0 | N/A | 68.8 | 80.0% | 131.1K | Closed weights | N/A | N/A | 66.1% | 47.2% | N/A | N/A | 79.1% | N/A | N/A | 20.8% | N/A | N/A |
| 229 | MA | Mistral Small 3 24B Instruct | 7.5 | 18.0 | N/A | 48.6 | 43.9 | 29.1 | 80.0% | 32K | Closed weights | N/A | N/A | 45.3% | 66.3% | N/A | N/A | N/A | N/A | N/A | 70.6% | 84.8% | N/A |
| 230 | MI | Phi-4-multimodal-instruct | 7.4 | 25.6 | 17.7 | 36.8 | N/A | 25.0 | 80.0% | 128K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 38.5% |
| 231 | MA | Mistral Large 2 | 7.1 | N/A | N/A | 63.8 | 86.9 | 54.5 | 60.0% | 128K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 84.0% | N/A | N/A | N/A | 92.0% | N/A |
| 232 | AC | Qwen2.5 7B Instruct | 6.5 | 9.4 | N/A | 58.4 | 37.6 | 24.6 | 80.0% | 131.1K | Closed weights | $0.175 | $0.70 | 36.4% | 56.3% | N/A | N/A | N/A | N/A | 28.7% | 75.5% | 84.8% | N/A |
| 233 | MI | Phi-3.5-MoE-instruct | 4.9 | 60.9 | 100.0 | 34.3 | 39.7 | 57.6 | 100.0% | N/A | Closed weights | N/A | N/A | 36.8% | 45.3% | N/A | N/A | 78.9% | N/A | N/A | 59.5% | 70.7% | N/A |
| 234 | OP | GPT-4 | 4.6 | 8.6 | N/A | 36.3 | 10.8 | 74.9 | 80.0% | 8.2K | Closed weights | $30 | $60 | 35.7% | N/A | N/A | N/A | 86.4% | N/A | N/A | 42.0% | 67.0% | N/A |
| 235 | AC | Qwen2.5-Coder 32B Instruct | 4.4 | 39.4 | N/A | 46.2 | 68.0 | 33.5 | 80.0% | 128K | Closed weights | $0.287 | $0.861 | N/A | 50.4% | N/A | N/A | 75.1% | N/A | 31.4% | 57.2% | 92.7% | N/A |
| 236 | OP | GPT-4.1 nano | 4.3 | 24.0 | 19.4 | 21.1 | 0.0 | 6.1 | 100.0% | 1M | Closed weights | $0.10 | $0.40 | 50.3% | N/A | N/A | N/A | 80.1% | N/A | N/A | N/A | N/A | N/A |
| 237 | AMNova MicroAmazon | Nova Micro | 4.3 | 40.6 | 0.0 | 38.3 | 17.3 | 13.0 | 100.0% | 128K | Closed weights | $0.035 | $0.14 | 40.0% | N/A | N/A | N/A | 77.6% | N/A | N/A | 69.3% | 81.1% | N/A |
| 238 | IB | Granite 3.3 8B Instruct | 3.8 | N/A | N/A | 13.4 | 80.8 | 49.7 | 60.0% | 128K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 65.5% | N/A | N/A | N/A | 89.7% | N/A |
| 239 | GO | Gemini Diffusion | 3.6 | 12.7 | N/A | N/A | 36.8 | 23.2 | 60.0% | N/A | Closed weights | N/A | N/A | 40.4% | N/A | 23.3% | 22.9% | N/A | N/A | 30.9% | N/A | 89.6% | N/A |
| 240 | AN | Claude 3 Sonnet | 3.5 | 48.8 | N/A | 38.7 | 20.0 | 53.6 | 80.0% | 200K | Closed weights | N/A | N/A | 40.4% | 56.8% | N/A | N/A | 79.0% | N/A | N/A | 43.1% | 73.0% | N/A |
| 241 | NV | Llama 3.1 Nemotron 70B Instruct | 3.1 | 33.3 | N/A | 53.2 | N/A | 48.5 | 60.0% | 128K | Open weights | N/A | N/A | N/A | N/A | N/A | N/A | 80.2% | N/A | N/A | N/A | N/A | N/A |
| 242 | AC | Qwen3.5-2B | 2.8 | 18.5 | N/A | N/A | 7.6 | 11.0 | 60.0% | N/A | Closed weights | N/A | N/A | 51.6% | 66.5% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 243 | AL | Jamba 1.5 Large | 2.7 | 46.1 | N/A | 31.9 | N/A | 27.4 | 60.0% | 256K | Closed weights | N/A | N/A | 36.9% | 53.5% | N/A | N/A | 81.2% | N/A | N/A | N/A | N/A | N/A |
| 244 | MA | Codestral-22B | 1.6 | N/A | N/A | N/A | 45.4 | N/A | 20.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 81.1% | N/A |
| 245 | XA | Grok-1.5V | 1.3 | 28.0 | 13.7 | 11.8 | N/A | N/A | 60.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 246 | GO | Gemma 2 27B | 0.1 | 69.3 | 97.1 | 25.6 | 8.6 | 64.2 | 100.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 75.2% | N/A | N/A | 42.3% | 51.8% | N/A |
| 247 | DE | DeepSeek VL2 Tiny | 0.0 | 16.6 | 1.6 | 15.8 | N/A | 0.0 | 80.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 248 | GO | Gemma 3n E2B Instructed | 0.0 | 1.8 | N/A | 12.5 | 7.0 | 12.4 | 80.0% | N/A | Closed weights | N/A | N/A | 24.8% | 40.5% | 6.7% | N/A | 60.1% | N/A | 13.2% | N/A | 66.5% | N/A |
| 249 | MA | Mistral NeMo Instruct | 0.0 | 83.3 | 33.1 | N/A | N/A | 26.5 | 60.0% | 128K | Closed weights | $0.15 | $0.15 | N/A | N/A | N/A | N/A | 68.0% | N/A | N/A | N/A | N/A | N/A |
| 250 | ME | Llama 3.2 3B Instruct | 0.0 | 29.1 | N/A | 16.7 | N/A | 10.7 | 60.0% | 128K | Closed weights | N/A | N/A | 32.8% | N/A | N/A | N/A | 63.4% | N/A | N/A | 48.0% | N/A | N/A |
| 251 | MI | Phi-3.5-vision-instruct | 0.0 | 18.7 | 3.2 | 2.6 | N/A | 37.5 | 80.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 252 | IB | IBM Granite 4.0 Tiny Preview | 0.0 | N/A | N/A | 7.7 | 36.9 | 13.2 | 60.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 60.4% | N/A | N/A | N/A | 82.4% | N/A |
| 253 | ME | Llama 3.2 11B Instruct | 0.0 | 27.3 | 8.1 | 16.8 | N/A | 26.1 | 80.0% | 128K | Closed weights | N/A | N/A | 32.8% | N/A | N/A | N/A | 73.0% | N/A | N/A | 51.9% | N/A | 33.0% |
| 254 | AL | Jamba 1.5 Mini | 0.0 | 34.8 | N/A | 14.9 | N/A | 7.5 | 60.0% | 256.1K | Closed weights | N/A | N/A | 32.3% | 42.5% | N/A | N/A | 69.7% | N/A | N/A | N/A | N/A | N/A |
| 255 | OP | GPT-3.5 Turbo | 0.0 | 5.2 | 0.0 | 13.9 | 12.3 | 13.6 | 100.0% | 16.4K | Closed weights | $0.50 | $1.5 | 30.8% | N/A | N/A | N/A | 69.8% | N/A | N/A | 43.1% | 68.0% | N/A |
| 256 | MI | Phi-3.5-mini-instruct | 0.0 | 50.7 | 62.5 | 24.4 | 18.7 | 31.5 | 100.0% | 128K | Closed weights | N/A | N/A | 30.4% | 47.4% | N/A | N/A | 69.0% | N/A | N/A | 48.5% | 62.8% | N/A |
| 257 | GO | Gemini 1.5 Flash 8B | 0.0 | 11.2 | 16.1 | 24.5 | N/A | 13.1 | 80.0% | 1M | Closed weights | N/A | N/A | 38.4% | 58.7% | N/A | N/A | N/A | N/A | N/A | 58.7% | N/A | N/A |
| 258 | AC | Qwen3.5-0.8B | 0.0 | 3.3 | N/A | N/A | 0.0 | 1.2 | 60.0% | N/A | Closed weights | N/A | N/A | 11.9% | 42.3% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 259 | MA | Pixtral-12B | 0.0 | 28.3 | 11.3 | 23.8 | 16.9 | 20.0 | 100.0% | 128K | Open weights | $0.15 | $0.15 | N/A | N/A | N/A | N/A | 69.2% | N/A | N/A | 48.1% | 72.0% | N/A |
| 260 | GO | Gemma 3n E4B Instructed | 0.0 | 8.0 | N/A | 37.5 | 16.9 | 38.2 | 80.0% | 32K | Closed weights | N/A | N/A | 23.7% | 50.6% | 11.6% | N/A | 64.9% | N/A | 13.2% | N/A | 75.0% | N/A |
| 261 | OP | GPT-5.1 Codex Mini | 0.0 | N/A | N/A | N/A | N/A | 5.3 | 20.0% | 400K | Closed weights | N/A | N/A | N/A | N/A | 42.1% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 262 | GO | Gemma 3n E2B Instructed LiteRT (Preview) | 0.0 | 5.2 | 15.1 | 12.3 | 7.0 | 12.5 | 100.0% | N/A | Closed weights | N/A | N/A | 24.8% | 40.5% | 6.7% | N/A | 60.1% | N/A | 13.2% | N/A | 66.5% | N/A |
| 263 | GO | MedGemma 4B IT | 0.0 | N/A | 0.0 | N/A | N/A | N/A | 20.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 264 | MA | Ministral 8B Instruct | 0.0 | 48.5 | 17.6 | 19.1 | 0.0 | 26.1 | 100.0% | 131.1K | Open weights | N/A | N/A | N/A | N/A | N/A | N/A | 65.0% | N/A | N/A | 54.5% | 34.8% | N/A |
| 265 | AN | Claude 3 Haiku | 0.0 | 37.0 | N/A | 29.2 | 27.7 | 44.5 | 80.0% | 200K | Closed weights | N/A | N/A | 33.3% | N/A | N/A | N/A | 75.2% | N/A | N/A | 38.9% | 75.9% | N/A |
| 266 | GO | Gemma 3n E4B Instructed LiteRT Preview | 0.0 | 21.1 | 41.2 | 31.7 | 16.9 | 29.0 | 100.0% | N/A | Closed weights | N/A | N/A | 23.7% | 50.6% | 11.6% | N/A | 64.9% | N/A | 13.2% | N/A | 75.0% | N/A |
| 267 | GO | Gemma 3 4B | 0.0 | 1.7 | 0.0 | 38.9 | 10.8 | 26.2 | 100.0% | 131.1K | Closed weights | N/A | N/A | 30.8% | 43.6% | N/A | N/A | N/A | N/A | 12.6% | 75.6% | 71.3% | N/A |
| 268 | AC | Qwen2.5-Coder 7B Instruct | 0.0 | 12.1 | N/A | 19.9 | 50.5 | 16.0 | 80.0% | N/A | Closed weights | $0.144 | $0.287 | N/A | 40.1% | N/A | N/A | 67.6% | N/A | 18.2% | 46.6% | 88.4% | N/A |
| 269 | XA | Grok-1.5 | 0.0 | 9.0 | 13.7 | 26.9 | 21.5 | 13.3 | 100.0% | N/A | Closed weights | N/A | N/A | 35.9% | 51.0% | N/A | N/A | 81.3% | N/A | N/A | 50.6% | 74.1% | N/A |
| 270 | GO | Gemma 2 9B | 0.0 | 48.0 | 72.3 | 18.4 | 2.3 | 41.3 | 100.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 71.3% | N/A | N/A | 36.6% | 40.2% | N/A |
| 271 | CO | Command R+ | 0.0 | 42.4 | N/A | 10.6 | N/A | 58.2 | 60.0% | 128K | Closed weights | $0.15 | $0.60 | N/A | N/A | N/A | N/A | 75.7% | N/A | N/A | N/A | N/A | N/A |
| 272 | GO | Gemma 3 1B | 0.0 | 0.4 | N/A | 6.9 | 1.0 | 2.5 | 80.0% | N/A | Closed weights | N/A | N/A | 19.2% | 14.7% | N/A | N/A | N/A | N/A | 1.9% | 48.0% | 41.5% | N/A |
| 273 | GO | Gemini 1.0 Pro | 0.0 | 3.4 | 4.8 | 4.1 | N/A | 40.2 | 80.0% | 32.8K | Closed weights | N/A | N/A | 27.9% | N/A | N/A | N/A | 71.8% | N/A | N/A | 32.6% | N/A | N/A |
| 274 | ME | Llama 3.1 8B Instruct | 0.0 | 29.3 | N/A | 10.3 | 49.2 | 10.2 | 80.0% | 131.1K | Closed weights | N/A | N/A | 30.4% | 48.3% | N/A | N/A | 69.4% | N/A | N/A | N/A | 72.6% | N/A |
| 275 | AC | Qwen2 7B Instruct | 0.0 | 3.0 | N/A | 14.9 | 17.1 | 17.3 | 80.0% | N/A | Closed weights | N/A | N/A | 25.3% | 44.1% | N/A | N/A | 70.5% | N/A | 26.6% | 49.6% | 79.9% | N/A |
| 276 | BA | ERNIE 4.5 | 0.0 | 25.9 | 0.0 | 0.0 | 0.0 | 0.1 | 100.0% | 128K | Closed weights | N/A | N/A | 74.0% | 16.0% | N/A | N/A | 41.9% | N/A | N/A | 12.4% | N/A | N/A |
| 277 | MI | Phi 4 Mini | 0.0 | 45.0 | 62.5 | 35.6 | N/A | 25.1 | 80.0% | 128K | Open weights | $0.075 | $0.30 | 25.2% | 52.8% | N/A | N/A | 67.3% | N/A | N/A | 64.0% | N/A | N/A |
Main price columns show official vendor API PAYG rates. Third-party offers remain on the dedicated pricing and model detail pages; unavailable official prices display as N/A.
Leaderboard highlights
A quick read of the strongest current model signals.
Top overallClaude Opus 597.4 LLMBoard scoreTop open-weight modelKimi K3Rank #5Lowest official input priceNova Micro$0.04 / 1M tokensLargest context windowLlama 4 Scout10M tokensStrongest reasoningClaude Opus 5100.0 category scoreStrongest codingGemini 3.5 Flash Cyber100.0 category scoreMost recent scored releaseMuse Glimmer 30B2026-08-10Broadest evidenceQwen3.5 122B A10B100% category coverage
About this leaderboard
Common questions about the current rankings and prices.
Common questions about llmboard.ai rankings.
What is the highest-ranked model right now?
Claude Opus 5 is currently ranked first with an LLMBoard score of 97.4.
How are models ranked?
Each model appears once using its current scored version. Benchmark results are combined within comparable evaluation families, while Arena ratings and prices remain separate.
How many models are tracked?
The catalog contains 393 model products, including 277 with a current LLMBoard score.
Why do some prices show N/A?
N/A means the vendor's official API does not list a valid standard PAYG price. Third-party offers are tracked separately and never replace the official price.
How often is this page updated?
The page reads the current API on each request. Benchmark and price dates show when each underlying record was last updated.