llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksmathPolyMATH

math benchmark

PolyMATH

Polymath is a challenging multi-modal mathematical reasoning benchmark designed to evaluate the general cognitive reasoning abilities of Multi-modal Large Language Models (MLLMs). The benchmark comprises 5,000 manually collected high-quality images of cognitive textual and visual challenges across 10 distinct categories, including pattern recognition, spatial reasoning, and relative reasoning.

Updated Aug 11, 2026

Models23
Model coverage23
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

PolyMATH Ranking

Higher score ranks better on this benchmark.

23 rows
Columns

Show columns

1ACQwen3.7 MaxAlibaba Cloud / Qwen Team86.5%100.0%23CAug 11, 2026
2ACQwen3.7-PlusAlibaba Cloud / Qwen Team84.0%95.5%23CAug 11, 2026
3ACQwen3.6 PlusAlibaba Cloud / Qwen Team77.4%90.9%23CAug 11, 2026
4ACQwen3.5-397B-A17BAlibaba Cloud / Qwen Team73.3%86.4%23CAug 11, 2026
5ACQwen3.5-27BAlibaba Cloud / Qwen Team71.2%81.8%23CAug 11, 2026
6ACQwen3.5-122B-A10BAlibaba Cloud / Qwen Team68.9%77.3%23CAug 11, 2026
7ACQwen3.5-35B-A3BAlibaba Cloud / Qwen Team64.4%72.7%23CAug 11, 2026
8ACQwen3-235B-A22B-Thinking-2507Alibaba Cloud / Qwen Team60.1%68.2%23CAug 11, 2026
9ACQwen3.5-9BAlibaba Cloud / Qwen Team57.3%63.6%23CAug 11, 2026
10ACQwen3-Next-80B-A3B-ThinkingAlibaba Cloud / Qwen Team56.3%59.1%23CAug 11, 2026
11ACQwen3 VL 32B ThinkingAlibaba Cloud / Qwen Team52.0%54.5%23CAug 11, 2026
12ACQwen3 VL 30B A3B ThinkingAlibaba Cloud / Qwen Team51.7%50.0%23CAug 11, 2026
13ACQwen3.5-4BAlibaba Cloud / Qwen Team51.1%45.5%23CAug 11, 2026
14ACQwen3-235B-A22B-Instruct-2507Alibaba Cloud / Qwen Team50.2%40.9%23CAug 11, 2026
15ACQwen3 VL 8B ThinkingAlibaba Cloud / Qwen Team47.5%36.4%23CAug 11, 2026
16ACQwen3-Next-80B-A3B-InstructAlibaba Cloud / Qwen Team45.9%31.8%23CAug 11, 2026
17ACQwen3 VL 4B ThinkingAlibaba Cloud / Qwen Team44.6%27.3%23CAug 11, 2026
18ACQwen3 VL 30B A3B InstructAlibaba Cloud / Qwen Team44.3%22.7%23CAug 11, 2026
19ACQwen3 VL 32B InstructAlibaba Cloud / Qwen Team40.5%18.2%23CAug 11, 2026
20ACQwen3 VL 8B InstructAlibaba Cloud / Qwen Team30.4%13.6%23CAug 11, 2026
21ACQwen3 VL 4B InstructAlibaba Cloud / Qwen Team28.8%9.1%23CAug 11, 2026
22ACQwen3.5-2BAlibaba Cloud / Qwen Team26.1%4.5%23CAug 11, 2026
23ACQwen3.5-0.8BAlibaba Cloud / Qwen Team8.2%0.0%23CAug 11, 2026

PolyMATH Score Distribution

A closer view of the leading scores on this benchmark.

PolyMATH

PolyMATH Highlights

The leading models and scores on this benchmark.

Rank #1Qwen3.7 Max86.5%Rank #2Qwen3.7-Plus84.0%Rank #3Qwen3.6 Plus77.4%Rank #4Qwen3.5-397B-A17B73.3%

What is PolyMATH?

What PolyMATH measures and how its scores work.

Polymath is a challenging multi-modal mathematical reasoning benchmark designed to evaluate the general cognitive reasoning abilities of Multi-modal Large Language Models (MLLMs). The benchmark comprises 5,000 manually collected high-quality images of cognitive textual and visual challenges across 10 distinct categories, including pattern recognition, spatial reasoning, and relative reasoning.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
PolyMATH
Modality
multimodal
Primary category
math
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
polymath|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about PolyMATH.

Which model scores highest on PolyMATH?

Qwen3.7 Max is currently ranked first with 86.5%.

What does PolyMATH measure?

Polymath is a challenging multi-modal mathematical reasoning benchmark designed to evaluate the general cognitive reasoning abilities of Multi-modal Large Language Models (MLLMs). The benchmark comprises 5,000 manually collected high-quality images of cognitive textual and visual challenges across 10 distinct categories, including pattern recognition, spatial reasoning, and relative reasoning.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

23 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.

Rankings

OverallCodingText ArenaPricing

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai