llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksreasoningMT-Bench

reasoning benchmark

MT-Bench

MT-Bench is a challenging multi-turn benchmark that measures the ability of large language models to engage in coherent, informative, and engaging conversations. It uses strong LLMs as judges for scalable and explainable evaluation of multi-turn dialogue capabilities.

Updated Aug 11, 2026

Models12
Model coverage12
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

MT-Bench Ranking

Higher score ranks better on this benchmark.

12 rows
Columns

Show columns

1ACQwen2.5 72B InstructAlibaba Cloud / Qwen Team0.935 points100.0%12CAug 11, 2026
2NVLlama-3.3 Nemotron Super 49B v1NVIDIA0.917 points90.9%12CAug 11, 2026
3DEDeepSeek-V2.5DeepSeek0.902 points81.8%12CAug 11, 2026
4NRHermes 3 70BNous Research8.99 points72.7%12CAug 11, 2026
5ACQwen2.5 7B InstructAlibaba Cloud / Qwen Team0.875 points63.6%12CAug 11, 2026
6MAMistral Large 2Mistral AI0.863 points54.5%12CAug 11, 2026
7ACQwen2 7B InstructAlibaba Cloud / Qwen Team0.841 points45.5%12CAug 11, 2026
8MAMistral Small 3 24B InstructMistral AI0.835 points36.4%12CAug 11, 2026
9MAMinistral 8B InstructMistral AI0.83 points27.3%12CAug 11, 2026
10NVLlama 3.1 Nemotron Nano 8B V1NVIDIA0.81 points18.2%12CAug 11, 2026
11MAPixtral-12BMistral AI0.768 points9.1%12CAug 11, 2026
12NVLlama 3.1 Nemotron 70B InstructNVIDIA0.09 points0.0%12CAug 11, 2026

MT-Bench Score Distribution

A closer view of the leading scores on this benchmark.

MT-Bench

MT-Bench Highlights

The leading models and scores on this benchmark.

Rank #1Qwen2.5 72B Instruct0.935 pointsRank #2Llama-3.3 Nemotron Super 49B v10.917 pointsRank #3DeepSeek-V2.50.902 pointsRank #4Hermes 3 70B8.99 points

What is MT-Bench?

What MT-Bench measures and how its scores work.

MT-Bench is a challenging multi-turn benchmark that measures the ability of large language models to engage in coherent, informative, and engaging conversations. It uses strong LLMs as judges for scalable and explainable evaluation of multi-turn dialogue capabilities.

Scores are shown in points. This benchmark is not independently verified and has an evidence level of B.

Family
MT-Bench
Modality
text
Primary category
reasoning
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
mt-bench|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about MT-Bench.

Which model scores highest on MT-Bench?

Qwen2.5 72B Instruct is currently ranked first with 0.935 points.

What does MT-Bench measure?

MT-Bench is a challenging multi-turn benchmark that measures the ability of large language models to engage in coherent, informative, and engaging conversations. It uses strong LLMs as judges for scalable and explainable evaluation of multi-turn dialogue capabilities.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

12 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.

Rankings

OverallCodingText ArenaPricing

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai