llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksmultimodalAI2D

multimodal benchmark

AI2D

AI2D is a dataset of 4,903 illustrative diagrams from grade school natural sciences (such as food webs, human physiology, and life cycles) with over 15,000 multiple choice questions and answers. The benchmark evaluates diagram understanding and visual reasoning capabilities, requiring models to interpret diagrammatic elements, relationships, and structure to answer questions about scientific concepts represented in visual form.

Updated Aug 11, 2026

Models32
Model coverage32
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

AI2D Ranking

Higher score ranks better on this benchmark.

32 rows
Columns

Show columns

1ANClaude 3.5 SonnetAnthropic94.7%100.0%32CAug 11, 2026
2ACQwen3.6 PlusAlibaba Cloud / Qwen Team94.4%96.8%32CAug 11, 2026
3OPGPT-4oOpenAI94.2%93.5%32CAug 11, 2026
4MAPixtral LargeMistral AI93.8%90.3%32CAug 11, 2026
5ACQwen3.5-122B-A10BAlibaba Cloud / Qwen Team93.3%87.1%32CAug 11, 2026
6MAMistral Small 3.2 24B InstructMistral AI92.9%83.9%32CAug 11, 2026
7ACQwen3.5-27BAlibaba Cloud / Qwen Team92.9%80.7%32CAug 11, 2026
8ACQwen3.6-35B-A3BAlibaba Cloud / Qwen Team92.7%77.4%32CAug 11, 2026
9ACQwen3.5-35B-A3BAlibaba Cloud / Qwen Team92.6%74.2%32CAug 11, 2026
10MELlama 3.2 90B InstructMeta92.3%71.0%32CAug 11, 2026
11MELlama 3.2 11B InstructMeta91.1%67.7%32CAug 11, 2026
12ACQwen3 VL 235B A22B InstructAlibaba Cloud / Qwen Team89.7%64.5%32CAug 11, 2026
13ACQwen3 VL 32B InstructAlibaba Cloud / Qwen Team89.5%61.3%32CAug 11, 2026
14ACQwen3 VL 235B A22B ThinkingAlibaba Cloud / Qwen Team89.2%58.1%32CAug 11, 2026
15ACQwen3 VL 32B ThinkingAlibaba Cloud / Qwen Team88.9%54.8%32CAug 11, 2026
16ACQwen2.5 VL 72B InstructAlibaba Cloud / Qwen Team88.4%51.6%32CAug 11, 2026
17XAGrok-1.5VxAI88.3%48.4%32CAug 11, 2026
18ACQwen3 VL 30B A3B ThinkingAlibaba Cloud / Qwen Team86.9%45.2%32CAug 11, 2026
19ACQwen3 VL 8B InstructAlibaba Cloud / Qwen Team85.7%41.9%32CAug 11, 2026
20ACQwen3 VL 30B A3B InstructAlibaba Cloud / Qwen Team85.0%38.7%32CAug 11, 2026
21ACQwen3 VL 4B ThinkingAlibaba Cloud / Qwen Team84.9%35.5%32CAug 11, 2026
22ACQwen3 VL 8B ThinkingAlibaba Cloud / Qwen Team84.9%32.3%32CAug 11, 2026
23GOGemma 3 27BGoogle84.5%29.0%32CAug 11, 2026
24GOGemma 3 12BGoogle84.2%25.8%32CAug 11, 2026
25ACQwen3 VL 4B InstructAlibaba Cloud / Qwen Team84.1%22.6%32CAug 11, 2026
26ACQwen2.5-Omni-7BAlibaba Cloud / Qwen Team83.2%19.4%32CAug 11, 2026
27MIPhi-4-multimodal-instructMicrosoft82.3%16.1%32CAug 11, 2026
28DEDeepSeek VL2DeepSeek81.4%12.9%32CAug 11, 2026
29DEDeepSeek VL2 SmallDeepSeek80.0%9.7%32CAug 11, 2026
30MIPhi-3.5-vision-instructMicrosoft78.1%6.5%32CAug 11, 2026
31GOGemma 3 4BGoogle74.8%3.2%32CAug 11, 2026
32DEDeepSeek VL2 TinyDeepSeek71.6%0.0%32CAug 11, 2026

AI2D Score Distribution

A closer view of the leading scores on this benchmark.

AI2D

AI2D Highlights

The leading models and scores on this benchmark.

Rank #1Claude 3.5 Sonnet94.7%Rank #2Qwen3.6 Plus94.4%Rank #3GPT-4o94.2%Rank #4Pixtral Large93.8%

What is AI2D?

What AI2D measures and how its scores work.

AI2D is a dataset of 4,903 illustrative diagrams from grade school natural sciences (such as food webs, human physiology, and life cycles) with over 15,000 multiple choice questions and answers. The benchmark evaluates diagram understanding and visual reasoning capabilities, requiring models to interpret diagrammatic elements, relationships, and structure to answer questions about scientific concepts represented in visual form.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
AI2D
Modality
multimodal
Primary category
multimodal
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
ai2d|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about AI2D.

Which model scores highest on AI2D?

Claude 3.5 Sonnet is currently ranked first with 94.7%.

What does AI2D measure?

AI2D is a dataset of 4,903 illustrative diagrams from grade school natural sciences (such as food webs, human physiology, and life cycles) with over 15,000 multiple choice questions and answers. The benchmark evaluates diagram understanding and visual reasoning capabilities, requiring models to interpret diagrammatic elements, relationships, and structure to answer questions about scientific concepts represented in visual form.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

32 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.

Rankings

OverallCodingText ArenaPricing

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai