llmboard.ai
Benchmarks
CompareRankings
llmboard.ai
Benchmarks
CompareRankings
HomeBenchmarkssafetyCyBench

safety benchmark

CyBench

CyBench is a suite of Capture-the-Flag (CTF) challenges measuring agentic cyber attack capabilities. It evaluates dual-use cybersecurity knowledge and measures the 'unguided success rate', where agents complete tasks end-to-end without guidance on appropriate subtasks.

Updated Aug 11, 2026

Models2
Model coverage2
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

CyBench Ranking

Higher score ranks better on this benchmark.

2 rows
Columns

Show columns

1ANClaude Mythos PreviewAnthropic100.0%100.0%2CAug 11, 2026
2XAGrok-4.1 ThinkingxAI39.0%0.0%2CAug 11, 2026

CyBench Score Distribution

A closer view of the leading scores on this benchmark.

CyBench

CyBench Highlights

The leading models and scores on this benchmark.

Rank #1Claude Mythos Preview100.0%Rank #2Grok-4.1 Thinking39.0%

What is CyBench?

What CyBench measures and how its scores work.

CyBench is a suite of Capture-the-Flag (CTF) challenges measuring agentic cyber attack capabilities. It evaluates dual-use cybersecurity knowledge and measures the 'unguided success rate', where agents complete tasks end-to-end without guidance on appropriate subtasks.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
CyBench
Modality
text
Primary category
safety
Score direction
higher
LLMBoard eligible
No
Evaluation key
cybench|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about CyBench.

Which model scores highest on CyBench?

Claude Mythos Preview is currently ranked first with 100.0%.

What does CyBench measure?

CyBench is a suite of Capture-the-Flag (CTF) challenges measuring agentic cyber attack capabilities. It evaluates dual-use cybersecurity knowledge and measures the 'unguided success rate', where agents complete tasks end-to-end without guidance on appropriate subtasks.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

2 model results are currently shown.

Does this benchmark affect the overall score?

No. This benchmark is shown for reference but does not contribute to the overall score.

Rankings

OverallCodingText ArenaPricing

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Benchmarks

All BenchmarksReasoningMathCoding

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai