llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksmultimodalMMMU (validation)

multimodal benchmark

MMMU (validation)

Validation set of the Massive Multi-discipline Multimodal Understanding and Reasoning benchmark. Features college-level multimodal questions across 6 core disciplines (Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, Tech & Engineering) spanning 30 subjects and 183 subfields with diverse image types including charts, diagrams, maps, and tables.

Updated Aug 11, 2026

Models4
Model coverage4
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

MMMU (validation) Ranking

Higher score ranks better on this benchmark.

4 rows
Columns

Show columns

1ANClaude Opus 4.5Anthropic80.7%100.0%4CAug 11, 2026
2ANClaude Opus 4.1Anthropic77.1%66.7%4CAug 11, 2026
3ANClaude Opus 4Anthropic76.5%33.3%4CAug 11, 2026
4ANClaude Haiku 4.5Anthropic73.2%0.0%4CAug 11, 2026

MMMU (validation) Score Distribution

A closer view of the leading scores on this benchmark.

MMMU (validation)

MMMU (validation) Highlights

The leading models and scores on this benchmark.

Rank #1Claude Opus 4.580.7%Rank #2Claude Opus 4.177.1%Rank #3Claude Opus 476.5%Rank #4Claude Haiku 4.573.2%

What is MMMU (validation)?

What MMMU (validation) measures and how its scores work.

Validation set of the Massive Multi-discipline Multimodal Understanding and Reasoning benchmark. Features college-level multimodal questions across 6 core disciplines (Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, Tech & Engineering) spanning 30 subjects and 183 subfields with diverse image types including charts, diagrams, maps, and tables.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
MMMU (validation)
Modality
multimodal
Primary category
multimodal
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
mmmu-(validation)|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about MMMU (validation).

Which model scores highest on MMMU (validation)?

Claude Opus 4.5 is currently ranked first with 80.7%.

What does MMMU (validation) measure?

Validation set of the Massive Multi-discipline Multimodal Understanding and Reasoning benchmark. Features college-level multimodal questions across 6 core disciplines (Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, Tech & Engineering) spanning 30 subjects and 183 subfields with diverse image types including charts, diagrams, maps, and tables.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

4 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.

Rankings

OverallCodingText ArenaPricing

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai