llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarksreasoningTau2 Retail

reasoning benchmark

Tau2 Retail

τ²-bench retail domain evaluates conversational AI agents in customer service scenarios within a dual-control environment where both agent and user can interact with tools. Tests tool-agent-user interaction, rule adherence, and task consistency in retail customer support contexts.

Updated Aug 7, 2026

Published models26
Registry coverage26
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

Tau2 Retail leaderboard

Sorted by the source-provided rank. Higher score is better according to the registry.

26 rows
Columns

Show columns

1ANClaude Opus 4.6Anthropic91.9%100.0%26CAug 7, 2026
2ANClaude Sonnet 4.6Anthropic91.7%96.0%26CAug 7, 2026
3ANClaude Opus 4.5Anthropic88.9%92.0%26CAug 7, 2026
4MELongCat-Flash-Thinking-2601Meituan88.6%88.0%26CAug 7, 2026
5ANClaude Haiku 4.5Anthropic83.2%84.0%26CAug 7, 2026
6OPGPT-5.2OpenAI82.0%80.0%26CAug 7, 2026
7OPGPT-5OpenAI81.1%76.0%26CAug 7, 2026
8OPo3OpenAI80.2%72.0%26CAug 7, 2026
9AMNova 2 OmniAmazon78.3%68.0%26CAug 7, 2026
10OPGPT-5.1OpenAI77.9%64.0%26CAug 7, 2026
11OPGPT-5.1 InstantOpenAI77.9%60.0%26CAug 7, 2026
12OPGPT-5.1 ThinkingOpenAI77.9%56.0%26CAug 7, 2026
13AMNova 2 ProAmazon77.7%52.0%26CAug 7, 2026
14AMNova 2 LiteAmazon76.5%48.0%26CAug 7, 2026
15MELongCat-Flash-LiteMeituan73.1%44.0%26CAug 7, 2026
16ACQwen3-235B-A22B-Thinking-2507Alibaba Cloud / Qwen Team71.9%40.0%26CAug 7, 2026
17MELongCat-Flash-ThinkingMeituan71.5%36.0%26CAug 7, 2026
18ACQwen3-235B-A22B-Instruct-2507Alibaba Cloud / Qwen Team71.3%32.0%26CAug 7, 2026
19MELongCat-Flash-ChatMeituan71.3%28.0%26CAug 7, 2026
20MAKimi K2 InstructMoonshot AI70.6%24.0%26CAug 7, 2026
21MAKimi K2-Instruct-0905Moonshot AI70.6%20.0%26CAug 7, 2026
22ACQwen3-Next-80B-A3B-ThinkingAlibaba Cloud / Qwen Team67.8%16.0%26CAug 7, 2026
23OPGPT-4oOpenAI63.4%12.0%26CAug 7, 2026
24NVNemotron 3 Super (120B A12B)NVIDIA62.8%8.0%26CAug 7, 2026
25ACQwen3-Next-80B-A3B-InstructAlibaba Cloud / Qwen Team57.3%4.0%26CAug 7, 2026
26NVNemotron 3 Nano (30B A3B)NVIDIA56.9%0.0%26CAug 7, 2026

Score distribution

Top published rows on the benchmark's original scale.

Tau2 Retail

Tau2 Retail highlights

The top published results on this benchmark's own scale.

Rank #1Claude Opus 4.691.9%Rank #2Claude Sonnet 4.691.7%Rank #3Claude Opus 4.588.9%Rank #4LongCat-Flash-Thinking-260188.6%

What is Tau2 Retail?

Definition and scoring fields from the benchmark registry.

τ²-bench retail domain evaluates conversational AI agents in customer service scenarios within a dual-control environment where both agent and user can interact with tools. Tests tool-agent-user interaction, rule adherence, and task consistency in retail customer support contexts.

Scores are shown in ratio. The current registry marks this benchmark as not independently verified with evidence level B.

Family
Tau2 Retail
Modality
text
Primary category
reasoning
Score direction
higher
LLMBoard eligible
No
Evaluation key
tau2-retail|llm-stats-current

Source-native results are preserved. Eligibility for the overall LLMBoard score is a separate policy decision.

FAQ

Common questions about Tau2 Retail.

Which model scores highest on Tau2 Retail?

Claude Opus 4.6 is currently ranked first with 91.9%.

What does Tau2 Retail measure?

τ²-bench retail domain evaluates conversational AI agents in customer service scenarios within a dual-control environment where both agent and user can interact with tools. Tests tool-agent-user interaction, rule adherence, and task consistency in retail customer support contexts.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

26 unique published model results are currently shown.

Does this benchmark affect the overall score?

This benchmark is preserved as source-native evidence but is not eligible for the current overall score.

Rankings

OverallCodingText ArenaPricing

Modalities

Image GenerationVideo GenerationSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai