llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksmathDROP

math benchmark

DROP

DROP (Discrete Reasoning Over Paragraphs) is a reading comprehension benchmark requiring discrete reasoning over paragraph content. It contains crowdsourced, adversarially-created questions that require resolving references and performing discrete operations like addition, counting, or sorting, demanding comprehensive paragraph understanding beyond paraphrase-and-entity-typing shortcuts.

Updated Aug 11, 2026

Models30
Model coverage30
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

DROP Ranking

Higher score ranks better on this benchmark.

30 rows
Columns

Show columns

1DEDeepSeek-V3DeepSeek91.6%100.0%30CAug 11, 2026
2ANClaude 3.5 SonnetAnthropic87.1%96.5%30CAug 11, 2026
3ANClaude 3.5 SonnetAnthropic87.1%93.1%30CAug 11, 2026
4XIMiMo-V2.5-ProXiaomi86.3%89.7%30CAug 11, 2026
5OPGPT-4 TurboOpenAI86.0%86.2%30CAug 11, 2026
6AMNova ProAmazon85.4%82.8%30CAug 11, 2026
7MELlama 3.1 405B InstructMeta84.8%79.3%30CAug 11, 2026
8OPGPT-4oOpenAI83.4%75.9%30CAug 11, 2026
9ANClaude 3.5 HaikuAnthropic83.1%72.4%30CAug 11, 2026
10ANClaude 3 OpusAnthropic83.1%69.0%30CAug 11, 2026
11OPGPT-4OpenAI80.9%65.5%30CAug 11, 2026
12AMNova LiteAmazon80.2%62.1%30CAug 11, 2026
13OPGPT-4o miniOpenAI79.7%58.6%30CAug 11, 2026
14MELlama 3.1 70B InstructMeta79.6%55.2%30CAug 11, 2026
15AMNova MicroAmazon79.3%51.7%30CAug 11, 2026
16MELongCat-Flash-ChatMeituan79.1%48.3%30CAug 11, 2026
17ANClaude 3 SonnetAnthropic78.9%44.8%30CAug 11, 2026
18ANClaude 3 HaikuAnthropic78.4%41.4%30CAug 11, 2026
19MIPhi 4Microsoft75.5%37.9%30CAug 11, 2026
20GOGemini 1.5 ProGoogle74.9%34.5%30CAug 11, 2026
21OPGPT-3.5 TurboOpenAI70.2%31.0%30BAug 11, 2026
22GOGemma 3n E4BGoogle60.8%27.6%30CAug 11, 2026
23GOGemma 3n E4B Instructed LiteRT PreviewGoogle60.8%24.1%30CAug 11, 2026
24MELlama 3.1 8B InstructMeta59.5%20.7%30CAug 11, 2026
25IBGranite 3.3 8B InstructIBM59.4%17.2%30CAug 11, 2026
26GOGemma 3n E2BGoogle53.9%13.8%30CAug 11, 2026
27GOGemma 3n E2B Instructed LiteRT (Preview)Google53.9%10.3%30CAug 11, 2026
28IBIBM Granite 4.0 Tiny PreviewIBM46.2%6.9%30CAug 11, 2026
29IBGranite 3.3 8B BaseIBM36.1%3.5%30CAug 11, 2026
30BAERNIE 4.5Baidu28.6%0.0%30CAug 11, 2026

DROP Score Distribution

A closer view of the leading scores on this benchmark.

DROP

DROP Highlights

The leading models and scores on this benchmark.

Rank #1DeepSeek-V391.6%Rank #2Claude 3.5 Sonnet87.1%Rank #3Claude 3.5 Sonnet87.1%Rank #4MiMo-V2.5-Pro86.3%

What is DROP?

What DROP measures and how its scores work.

DROP (Discrete Reasoning Over Paragraphs) is a reading comprehension benchmark requiring discrete reasoning over paragraph content. It contains crowdsourced, adversarially-created questions that require resolving references and performing discrete operations like addition, counting, or sorting, demanding comprehensive paragraph understanding beyond paraphrase-and-entity-typing shortcuts.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
DROP
Modality
text
Primary category
math
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
drop|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about DROP.

Which model scores highest on DROP?

DeepSeek-V3 is currently ranked first with 91.6%.

What does DROP measure?

DROP (Discrete Reasoning Over Paragraphs) is a reading comprehension benchmark requiring discrete reasoning over paragraph content. It contains crowdsourced, adversarially-created questions that require resolving references and performing discrete operations like addition, counting, or sorting, demanding comprehensive paragraph understanding beyond paraphrase-and-entity-typing shortcuts.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

30 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.

Rankings

OverallCodingText ArenaPricing

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai