llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksmultimodalMMMU

multimodal benchmark

MMMU

MMMU (Massive Multi-discipline Multimodal Understanding) is a benchmark designed to evaluate multimodal models on college-level subject knowledge and deliberate reasoning. Contains 11.5K meticulously collected multimodal questions from college exams, quizzes, and textbooks, covering six core disciplines: Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, and Tech & Engineering across 30 subjects and 183 subfields.

Updated Aug 7, 2026

Published models63
Registry coverage63
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

MMMU leaderboard

Sorted by the source-provided rank. Higher score is better according to the registry.

63 rows
Columns

Show columns

1ACQwen3.6 PlusAlibaba Cloud / Qwen Team86.0%100.0%63CAug 7, 2026
2OPGPT-5.1OpenAI85.4%98.4%63CAug 7, 2026
3OPGPT-5.1 InstantOpenAI85.4%96.8%63CAug 7, 2026
4OPGPT-5.1 ThinkingOpenAI85.4%95.2%63CAug 7, 2026
5OPGPT-5OpenAI84.2%93.5%63CAug 7, 2026
6ACQwen3.5-122B-A10BAlibaba Cloud / Qwen Team83.9%91.9%63CAug 7, 2026
7OPo3OpenAI82.9%90.3%63CAug 7, 2026
8ACQwen3.6-27BAlibaba Cloud / Qwen Team82.9%88.7%63CAug 7, 2026
9ACQwen3.5-27BAlibaba Cloud / Qwen Team82.3%87.1%63CAug 7, 2026
10GOGemini 2.5 Pro Preview 06-05Google82.0%85.5%63CAug 7, 2026
11ACQwen3.6-35B-A3BAlibaba Cloud / Qwen Team81.7%83.9%63CAug 7, 2026
12OPo4-miniOpenAI81.6%82.3%63CAug 7, 2026
13ACQwen3.5-35B-A3BAlibaba Cloud / Qwen Team81.4%80.7%63CAug 7, 2026
14GOGemini 2.5 FlashGoogle79.7%79.0%63CAug 7, 2026
15GOGemini 2.5 ProGoogle79.6%77.4%63CAug 7, 2026
16STStep3-VL-10BStepFun78.1%75.8%63CAug 7, 2026
17XAGrok-3xAI78.0%74.2%63CAug 7, 2026
18OPo1OpenAI77.6%72.6%63CAug 7, 2026
19GOGemini 2.0 Flash ThinkingGoogle75.4%71.0%63CAug 7, 2026
20OPGPT-4.5OpenAI75.2%69.3%63CAug 7, 2026
21COCommand A+Cohere75.1%67.7%63CAug 7, 2026
22ANClaude 3.7 SonnetAnthropic75.0%66.1%63CAug 7, 2026
23OPGPT-4.1OpenAI74.8%64.5%63CAug 7, 2026
24ANClaude Sonnet 4Anthropic74.4%62.9%63CAug 7, 2026
25MELlama 4 MaverickMeta73.4%61.3%63CAug 7, 2026
26GOGemini 2.5 Flash-LiteGoogle72.9%59.7%63CAug 7, 2026
27OPGPT-4.1 miniOpenAI72.7%58.1%63CAug 7, 2026
28OPGPT-4oOpenAI72.2%56.5%63CAug 7, 2026
29GOGemini 2.0 FlashGoogle70.7%54.8%63CAug 7, 2026
30ACQvQ-72B-PreviewAlibaba Cloud / Qwen Team70.3%53.2%63CAug 7, 2026
31ACQwen2.5 VL 72B InstructAlibaba Cloud / Qwen Team70.2%51.6%63CAug 7, 2026
32MAKimi-k1.5Moonshot AI70.0%50.0%63CAug 7, 2026
33ACQwen2.5 VL 32B InstructAlibaba Cloud / Qwen Team70.0%48.4%63CAug 7, 2026
34MELlama 4 ScoutMeta69.4%46.8%63CAug 7, 2026
35ANClaude 3.5 SonnetAnthropic68.3%45.2%63CAug 7, 2026
36GOGemini 2.0 Flash-LiteGoogle68.0%43.5%63CAug 7, 2026
37XAGrok-2xAI66.1%41.9%63CAug 7, 2026
38GOGemini 1.5 ProGoogle65.9%40.3%63CAug 7, 2026
39MAPixtral LargeMistral AI64.0%38.7%63CAug 7, 2026
40XAGrok-2 minixAI63.2%37.1%63CAug 7, 2026
41MAMistral Small 3.2 24B InstructMistral AI62.5%35.5%63CAug 7, 2026
42GOGemini 1.5 FlashGoogle62.3%33.9%63CAug 7, 2026
43AMNova ProAmazon61.7%32.3%63CAug 7, 2026
44MELlama 3.2 90B InstructMeta60.3%30.6%63CAug 7, 2026
45OPGPT-4o miniOpenAI59.4%29.0%63CAug 7, 2026
46MAMistral Small 3.1 24B BaseMistral AI59.3%27.4%63CAug 7, 2026
47MAMistral Small 3.1 24B InstructMistral AI59.3%25.8%63CAug 7, 2026
48ACQwen2.5-Omni-7BAlibaba Cloud / Qwen Team59.2%24.2%63CAug 7, 2026
49ACQwen2.5 VL 7B InstructAlibaba Cloud / Qwen Team58.6%22.6%63CAug 7, 2026
50AMNova LiteAmazon56.2%21.0%63CAug 7, 2026
51OPGPT-4.1 nanoOpenAI55.4%19.4%63CAug 7, 2026
52MIPhi-4-multimodal-instructMicrosoft55.1%17.7%63CAug 7, 2026
53GOGemini 1.5 Flash 8BGoogle53.7%16.1%63CAug 7, 2026
54XAGrok-1.5xAI53.6%14.5%63CAug 7, 2026
55XAGrok-1.5VxAI53.6%12.9%63CAug 7, 2026
56MAPixtral-12BMistral AI52.5%11.3%63CAug 7, 2026
57DEDeepSeek VL2DeepSeek51.1%9.7%63CAug 7, 2026
58MELlama 3.2 11B InstructMeta50.7%8.1%63CAug 7, 2026
59DEDeepSeek VL2 SmallDeepSeek48.0%6.5%63CAug 7, 2026
60GOGemini 1.0 ProGoogle47.9%4.8%63BAug 7, 2026
61MIPhi-3.5-vision-instructMicrosoft43.0%3.2%63CAug 7, 2026
62DEDeepSeek VL2 TinyDeepSeek40.7%1.6%63CAug 7, 2026
63OPGPT-3.5 TurboOpenAI0.0%0.0%63BAug 7, 2026

Score distribution

Top published rows on the benchmark's original scale.

MMMU

MMMU highlights

The top published results on this benchmark's own scale.

Rank #1Qwen3.6 Plus86.0%Rank #2GPT-5.185.4%Rank #3GPT-5.1 Instant85.4%Rank #4GPT-5.1 Thinking85.4%

What is MMMU?

Definition and scoring fields from the benchmark registry.

MMMU (Massive Multi-discipline Multimodal Understanding) is a benchmark designed to evaluate multimodal models on college-level subject knowledge and deliberate reasoning. Contains 11.5K meticulously collected multimodal questions from college exams, quizzes, and textbooks, covering six core disciplines: Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, and Tech & Engineering across 30 subjects and 183 subfields.

Scores are shown in ratio. The current registry marks this benchmark as not independently verified with evidence level B.

Family
MMMU
Modality
multimodal
Primary category
multimodal
Score direction
higher
LLMBoard eligible
No
Evaluation key
mmmu|llm-stats-current

Source-native results are preserved. Eligibility for the overall LLMBoard score is a separate policy decision.

FAQ

Common questions about MMMU.

Which model scores highest on MMMU?

Qwen3.6 Plus is currently ranked first with 86.0%.

What does MMMU measure?

MMMU (Massive Multi-discipline Multimodal Understanding) is a benchmark designed to evaluate multimodal models on college-level subject knowledge and deliberate reasoning. Contains 11.5K meticulously collected multimodal questions from college exams, quizzes, and textbooks, covering six core disciplines: Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, and Tech & Engineering across 30 subjects and 183 subfields.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

63 unique published model results are currently shown.

Does this benchmark affect the overall score?

This benchmark is preserved as source-native evidence but is not eligible for the current overall score.

Rankings

OverallCodingText ArenaPricing

Modalities

Image GenerationVideo GenerationSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai