llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksmathHiddenMath

math benchmark

HiddenMath

Google DeepMind's internal mathematical reasoning benchmark that introduces novel problems not encountered during model training to evaluate true mathematical reasoning capabilities rather than memorization

Updated Aug 11, 2026

Models13
Model coverage13
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

HiddenMath Ranking

Higher score ranks better on this benchmark.

13 rows
Columns

Show columns

1GOGemini 2.0 FlashGoogle63.0%100.0%13CAug 11, 2026
2GOGemma 3 27BGoogle60.3%91.7%13CAug 11, 2026
3GOGemini 2.0 Flash-LiteGoogle55.3%83.3%13CAug 11, 2026
4GOGemma 3 12BGoogle54.5%75.0%13CAug 11, 2026
5GOGemini 1.5 ProGoogle52.0%66.7%13CAug 11, 2026
6GOGemini 1.5 FlashGoogle47.2%58.3%13CAug 11, 2026
7GOGemma 3 4BGoogle43.0%50.0%13CAug 11, 2026
8GOGemma 3n E4B InstructedGoogle37.7%41.7%13CAug 11, 2026
9GOGemma 3n E4B Instructed LiteRT PreviewGoogle37.7%33.3%13CAug 11, 2026
10GOGemini 1.5 Flash 8BGoogle32.8%25.0%13CAug 11, 2026
11GOGemma 3n E2B InstructedGoogle27.7%16.7%13CAug 11, 2026
12GOGemma 3n E2B Instructed LiteRT (Preview)Google27.7%8.3%13CAug 11, 2026
13GOGemma 3 1BGoogle15.8%0.0%13CAug 11, 2026

HiddenMath Score Distribution

A closer view of the leading scores on this benchmark.

HiddenMath

HiddenMath Highlights

The leading models and scores on this benchmark.

Rank #1Gemini 2.0 Flash63.0%Rank #2Gemma 3 27B60.3%Rank #3Gemini 2.0 Flash-Lite55.3%Rank #4Gemma 3 12B54.5%

What is HiddenMath?

What HiddenMath measures and how its scores work.

Google DeepMind's internal mathematical reasoning benchmark that introduces novel problems not encountered during model training to evaluate true mathematical reasoning capabilities rather than memorization

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
HiddenMath
Modality
text
Primary category
math
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
hiddenmath|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about HiddenMath.

Which model scores highest on HiddenMath?

Gemini 2.0 Flash is currently ranked first with 63.0%.

What does HiddenMath measure?

Google DeepMind's internal mathematical reasoning benchmark that introduces novel problems not encountered during model training to evaluate true mathematical reasoning capabilities rather than memorization

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

13 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.

Rankings

OverallCodingText ArenaPricing

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai