llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksmultimodalZEROBench

multimodal benchmark

ZEROBench

ZEROBench is a challenging vision benchmark designed to test models on zero-shot visual understanding tasks.

Updated Aug 7, 2026

Published models9
Registry coverage9
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

ZEROBench leaderboard

Sorted by the source-provided rank. Higher score is better according to the registry.

9 rows
Columns

Show columns

1MAKimi K3Moonshot AI0.41 points100.0%9CAug 7, 2026
2MEMuse SparkMeta0.33 points87.5%9CAug 7, 2026
3BYSeed 2.1 ProByteDance0.18 points75.0%9CAug 7, 2026
4MAKimi K2.5Moonshot AI0.11 points62.5%9CAug 7, 2026
5BYSeed 2.1 TurboByteDance0.11 points50.0%9CAug 7, 2026
6ACQwen3.5-27BAlibaba Cloud / Qwen Team0.1 points37.5%9CAug 7, 2026
7ACQwen3.5-122B-A10BAlibaba Cloud / Qwen Team0.09 points25.0%9CAug 7, 2026
8ACQwen3.5-35B-A3BAlibaba Cloud / Qwen Team0.08 points12.5%9CAug 7, 2026
9ACQwen3 VL 235B A22B ThinkingAlibaba Cloud / Qwen Team0.04 points0.0%9CAug 7, 2026

Score distribution

Top published rows on the benchmark's original scale.

ZEROBench

ZEROBench highlights

The top published results on this benchmark's own scale.

Rank #1Kimi K30.41 pointsRank #2Muse Spark0.33 pointsRank #3Seed 2.1 Pro0.18 pointsRank #4Kimi K2.50.11 points

What is ZEROBench?

Definition and scoring fields from the benchmark registry.

ZEROBench is a challenging vision benchmark designed to test models on zero-shot visual understanding tasks.

Scores are shown in points. The current registry marks this benchmark as not independently verified with evidence level B.

Family
ZEROBench
Modality
image
Primary category
multimodal
Score direction
higher
LLMBoard eligible
No
Evaluation key
zerobench|llm-stats-current

Source-native results are preserved. Eligibility for the overall LLMBoard score is a separate policy decision.

FAQ

Common questions about ZEROBench.

Which model scores highest on ZEROBench?

Kimi K3 is currently ranked first with 0.41 points.

What does ZEROBench measure?

ZEROBench is a challenging vision benchmark designed to test models on zero-shot visual understanding tasks.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

9 unique published model results are currently shown.

Does this benchmark affect the overall score?

This benchmark is preserved as source-native evidence but is not eligible for the current overall score.

Rankings

OverallCodingText ArenaPricing

Modalities

Image GenerationVideo GenerationSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai