Benchmark category
Published multimodal evaluations and source-native model rankings. Each benchmark keeps its original scale and methodology.
Data as of 2026-08-07
Select a benchmark to inspect model-level results, evidence fields and scoring direction.
| MMMU-Pro | MMMU-Pro | multimodal | Score | 65 | featured | B | No |
| MMMU | MMMU | multimodal | Score | 63 | featured | B | No |
| CharXiv-R | CharXiv-R | multimodal | Score | 47 | featured | B | No |
| MathVista | MathVista | multimodal | Score | 39 | featured | B | No |
| AI2D | AI2D | multimodal | Score | 32 | featured | B | No |
| MathVision | MathVision | multimodal | Score | 32 | featured | B | No |
| DocVQA | DocVQA | multimodal | Score | 26 | featured | B | No |
| VideoMMMU | VideoMMMU | multimodal | Score | 26 | featured | B | No |
| ChartQA | ChartQA | multimodal | Score | 24 | featured | B | No |
| LVBench | LVBench | multimodal | Score | 24 | featured | B | No |
| ScreenSpot Pro | ScreenSpot Pro | multimodal | Score | 24 | featured | C | No |
| MathVista-Mini | MathVista-Mini | multimodal | Score | 23 | featured | B | No |
| PolyMATH | PolyMATH | multimodal | Score | 23 | featured | B | No |
| MMStar | MMStar | multimodal | Score | 22 | featured | B | No |
| OSWorld-Verified | OSWorld-Verified | multimodal | Score | 22 | featured | B | No |
| OSWorld | OSWorld | multimodal | Score | 20 | featured | B | No |
| CC-OCR | CC-OCR | multimodal | Score | 18 | featured | B | No |
| MMBench-V1.1 | MMBench-V1.1 | multimodal | Score | 18 | featured | B | No |
| MM-MT-Bench | MM-MT-Bench | multimodal | Score | 17 | featured | B | No |
| MVBench | MVBench | multimodal | Score | 17 | featured | B | No |
| Video-MME | Video-MME | multimodal | Score | 17 | featured | B | No |
| CharXiv-D | CharXiv-D | multimodal | Score | 16 | featured | B | No |
| OmniDocBench 1.5 | OmniDocBench 1.5 | multimodal | Score | 16 | featured | B | No |
| ScreenSpot | ScreenSpot | multimodal | Score | 16 | featured | B | No |
| TextVQA | TextVQA | multimodal | Score | 15 | featured | B | No |
| BLINK | BLINK | multimodal | Score | 13 | featured | B | No |
| SimpleVQA | SimpleVQA | multimodal | Score | 13 | featured | B | No |
| CharadesSTA | CharadesSTA | multimodal | Score | 12 | featured | B | No |
| InfoVQAtest | InfoVQAtest | multimodal | Score | 12 | featured | B | No |
| MedXpertQA | MedXpertQA | multimodal | Score | 12 | featured | B | No |
| DocVQAtest | DocVQAtest | multimodal | Score | 11 | featured | B | No |
| MMMU (val) | MMMU (val) | multimodal | Score | 11 | featured | B | No |
| MuirBench | MuirBench | multimodal | Score | 11 | featured | B | No |
| MLVU | MLVU | multimodal | Score | 10 | featured | B | No |
| VideoMME w sub. | VideoMME w sub. | multimodal | Score | 10 | featured | B | No |
| VideoMME w/o sub. | VideoMME w/o sub. | multimodal | Score | 10 | featured | B | No |
High-coverage benchmarks with at least two published model results.
How this category is assembled on llmboard.ai.
This page groups benchmarks whose primary or display category matches multimodal. It does not average incompatible metrics into a new category score.
Open an individual benchmark to inspect score direction, evidence level, participant count and source-native results.
Category membership is derived from the current benchmark registry response.