llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksreasoningTau2 Telecom

reasoning benchmark

Tau2 Telecom

τ²-Bench telecom domain evaluates conversational agents in a dual-control environment modeled as a Dec-POMDP, where both agent and user use tools in shared telecommunications troubleshooting scenarios that test coordination and communication capabilities.

Updated Aug 11, 2026

Models35
Model coverage35
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

Tau2 Telecom Ranking

Higher score ranks better on this benchmark.

35 rows
Columns

Show columns

1ANClaude Opus 4.6Anthropic99.3%100.0%35CAug 11, 2026
2MELongCat-Flash-Thinking-2601Meituan99.3%97.1%35CAug 11, 2026
3OPGPT-5.4OpenAI98.9%94.1%35CAug 11, 2026
4OPGPT-5.2OpenAI98.7%91.2%35CAug 11, 2026
5ANClaude Opus 4.5Anthropic98.2%88.2%35CAug 11, 2026
6OPGPT-5.5OpenAI98.0%85.3%35CAug 11, 2026
7ANClaude Sonnet 4.6Anthropic97.9%82.3%35CAug 11, 2026
8XIMiMo-V2-ProXiaomi96.8%79.4%35CAug 11, 2026
9OPGPT-5OpenAI96.7%76.5%35CAug 11, 2026
10OPGPT-5.1OpenAI95.6%73.5%35CAug 11, 2026
11OPGPT-5.1 InstantOpenAI95.6%70.6%35CAug 11, 2026
12OPGPT-5.1 ThinkingOpenAI95.6%67.7%35CAug 11, 2026
13OPGPT-5.4 miniOpenAI93.4%64.7%35CAug 11, 2026
14AMNova 2 ProAmazon92.7%61.8%35CAug 11, 2026
15OPGPT-5.4 nanoOpenAI92.5%58.8%35CAug 11, 2026
16MEMuse SparkMeta91.5%55.9%35CAug 11, 2026
17MIMiniMax M2MiniMax87.0%52.9%35CAug 11, 2026
18MIMiniMax M2.1MiniMax87.0%50.0%35CAug 11, 2026
19COCommand A+Cohere85.0%47.1%35CAug 11, 2026
20MELongCat-Flash-ThinkingMeituan83.1%44.1%35CAug 11, 2026
21ANClaude Haiku 4.5Anthropic83.0%41.2%35CAug 11, 2026
22AMNova 2 OmniAmazon80.0%38.2%35CAug 11, 2026
23AMNova 2 LiteAmazon76.0%35.3%35CAug 11, 2026
24MELongCat-Flash-ChatMeituan73.7%32.4%35CAug 11, 2026
25MELongCat-Flash-LiteMeituan72.8%29.4%35CAug 11, 2026
26MIMAI-Code-1-FlashMicrosoft71.7%26.5%35CAug 11, 2026
27MAKimi K2 InstructMoonshot AI65.8%23.5%35CAug 11, 2026
28MAKimi K2-Instruct-0905Moonshot AI65.8%20.6%35CAug 11, 2026
29NVNemotron 3 Super (120B A12B)NVIDIA64.4%17.6%35CAug 11, 2026
30OPo3OpenAI58.2%14.7%35CAug 11, 2026
31ACQwen3-235B-A22B-Thinking-2507Alibaba Cloud / Qwen Team45.6%11.8%35CAug 11, 2026
32ACQwen3-Next-80B-A3B-ThinkingAlibaba Cloud / Qwen Team43.9%8.8%35CAug 11, 2026
33NVNemotron 3 Nano (30B A3B)NVIDIA42.2%5.9%35CAug 11, 2026
34OPGPT-4oOpenAI23.5%2.9%35CAug 11, 2026
35ACQwen3-Next-80B-A3B-InstructAlibaba Cloud / Qwen Team13.2%0.0%35CAug 11, 2026

Tau2 Telecom Score Distribution

A closer view of the leading scores on this benchmark.

Tau2 Telecom

Tau2 Telecom Highlights

The leading models and scores on this benchmark.

Rank #1Claude Opus 4.699.3%Rank #2LongCat-Flash-Thinking-260199.3%Rank #3GPT-5.498.9%Rank #4GPT-5.298.7%

What is Tau2 Telecom?

What Tau2 Telecom measures and how its scores work.

τ²-Bench telecom domain evaluates conversational agents in a dual-control environment modeled as a Dec-POMDP, where both agent and user use tools in shared telecommunications troubleshooting scenarios that test coordination and communication capabilities.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
Tau2 Telecom
Modality
text
Primary category
reasoning
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
tau2-telecom|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about Tau2 Telecom.

Which model scores highest on Tau2 Telecom?

Claude Opus 4.6 is currently ranked first with 99.3%.

What does Tau2 Telecom measure?

τ²-Bench telecom domain evaluates conversational agents in a dual-control environment modeled as a Dec-POMDP, where both agent and user use tools in shared telecommunications troubleshooting scenarios that test coordination and communication capabilities.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

35 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.

Rankings

OverallCodingText ArenaPricing

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai