llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksreasoningMT-Bench

reasoning benchmark

MT-Bench

MT-Bench is a challenging multi-turn benchmark that measures the ability of large language models to engage in coherent, informative, and engaging conversations. It uses strong LLMs as judges for scalable and explainable evaluation of multi-turn dialogue capabilities.

Updated Aug 7, 2026

Published models12
Registry coverage12
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

MT-Bench leaderboard

Sorted by the source-provided rank. Higher score is better according to the registry.

12 rows
Columns

Show columns

1ACQwen2.5 72B InstructAlibaba Cloud / Qwen Team0.935 points100.0%12CAug 7, 2026
2NVLlama-3.3 Nemotron Super 49B v1NVIDIA0.917 points90.9%12CAug 7, 2026
3DEDeepSeek-V2.5DeepSeek0.902 points81.8%12CAug 7, 2026
4NRHermes 3 70BNous Research8.99 points72.7%12CAug 7, 2026
5ACQwen2.5 7B InstructAlibaba Cloud / Qwen Team0.875 points63.6%12CAug 7, 2026
6MAMistral Large 2Mistral AI0.863 points54.5%12CAug 7, 2026
7ACQwen2 7B InstructAlibaba Cloud / Qwen Team0.841 points45.5%12CAug 7, 2026
8MAMistral Small 3 24B InstructMistral AI0.835 points36.4%12CAug 7, 2026
9MAMinistral 8B InstructMistral AI0.83 points27.3%12CAug 7, 2026
10NVLlama 3.1 Nemotron Nano 8B V1NVIDIA0.81 points18.2%12CAug 7, 2026
11MAPixtral-12BMistral AI0.768 points9.1%12CAug 7, 2026
12NVLlama 3.1 Nemotron 70B InstructNVIDIA0.09 points0.0%12CAug 7, 2026

Score distribution

Top published rows on the benchmark's original scale.

MT-Bench

MT-Bench highlights

The top published results on this benchmark's own scale.

Rank #1Qwen2.5 72B Instruct0.935 pointsRank #2Llama-3.3 Nemotron Super 49B v10.917 pointsRank #3DeepSeek-V2.50.902 pointsRank #4Hermes 3 70B8.99 points

What is MT-Bench?

Definition and scoring fields from the benchmark registry.

MT-Bench is a challenging multi-turn benchmark that measures the ability of large language models to engage in coherent, informative, and engaging conversations. It uses strong LLMs as judges for scalable and explainable evaluation of multi-turn dialogue capabilities.

Scores are shown in points. The current registry marks this benchmark as not independently verified with evidence level B.

Family
MT-Bench
Modality
text
Primary category
reasoning
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
mt-bench|llm-stats-current

Source-native results are preserved. Eligibility for the overall LLMBoard score is a separate policy decision.

FAQ

Common questions about MT-Bench.

Which model scores highest on MT-Bench?

Qwen2.5 72B Instruct is currently ranked first with 0.935 points.

What does MT-Bench measure?

MT-Bench is a challenging multi-turn benchmark that measures the ability of large language models to engage in coherent, informative, and engaging conversations. It uses strong LLMs as judges for scalable and explainable evaluation of multi-turn dialogue capabilities.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

12 unique published model results are currently shown.

Does this benchmark affect the overall score?

This benchmark is marked as eligible for the current LLMBoard capability methodology.

Rankings

OverallCodingText ArenaPricing

Modalities

Image GenerationVideo GenerationSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai