llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksmultimodalSimpleVQA

multimodal benchmark

SimpleVQA

SimpleVQA is a visual question answering benchmark focused on simple queries.

Updated Aug 7, 2026

Published models13
Registry coverage13
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

SimpleVQA leaderboard

Sorted by the source-provided rank. Higher score is better according to the registry.

13 rows
Columns

Show columns

1ACQwen3.7-PlusAlibaba Cloud / Qwen Team0.817 points100.0%13CAug 7, 2026
2ZAGLM-5V-TurboZhipu AI0.782 points91.7%13CAug 7, 2026
3BYSeed 2.1 ProByteDance0.745 points83.3%13CAug 7, 2026
4MEMuse SparkMeta0.713 points75.0%13CAug 7, 2026
5MAKimi K2.5Moonshot AI0.712 points66.7%13CAug 7, 2026
6BYSeed 2.1 TurboByteDance0.711 points58.3%13CAug 7, 2026
7ACQwen3.6 PlusAlibaba Cloud / Qwen Team0.673 points50.0%13CAug 7, 2026
8ACQwen3.5-122B-A10BAlibaba Cloud / Qwen Team0.617 points41.7%13CAug 7, 2026
9ACQwen3 VL 235B A22B ThinkingAlibaba Cloud / Qwen Team0.613 points33.3%13CAug 7, 2026
10ACQwen3.6-35B-A3BAlibaba Cloud / Qwen Team0.589 points25.0%13CAug 7, 2026
11ACQwen3.5-35B-A3BAlibaba Cloud / Qwen Team0.583 points16.7%13CAug 7, 2026
12ACQwen3.6-27BAlibaba Cloud / Qwen Team0.561 points8.3%13CAug 7, 2026
13ACQwen3.5-27BAlibaba Cloud / Qwen Team0.56 points0.0%13CAug 7, 2026

Score distribution

Top published rows on the benchmark's original scale.

SimpleVQA

SimpleVQA highlights

The top published results on this benchmark's own scale.

Rank #1Qwen3.7-Plus0.817 pointsRank #2GLM-5V-Turbo0.782 pointsRank #3Seed 2.1 Pro0.745 pointsRank #4Muse Spark0.713 points

What is SimpleVQA?

Definition and scoring fields from the benchmark registry.

SimpleVQA is a visual question answering benchmark focused on simple queries.

Scores are shown in points. The current registry marks this benchmark as not independently verified with evidence level B.

Family
SimpleVQA
Modality
multimodal
Primary category
multimodal
Score direction
higher
LLMBoard eligible
No
Evaluation key
simplevqa|llm-stats-current

Source-native results are preserved. Eligibility for the overall LLMBoard score is a separate policy decision.

FAQ

Common questions about SimpleVQA.

Which model scores highest on SimpleVQA?

Qwen3.7-Plus is currently ranked first with 0.817 points.

What does SimpleVQA measure?

SimpleVQA is a visual question answering benchmark focused on simple queries.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

13 unique published model results are currently shown.

Does this benchmark affect the overall score?

This benchmark is preserved as source-native evidence but is not eligible for the current overall score.

Rankings

OverallCodingText ArenaPricing

Modalities

Image GenerationVideo GenerationSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai