BenchAtlas

Rankings / Anthropic

Claude Sonnet 5

proprietary

released 2026-06-30

BenchAtlas Index

as of 2026-09-11
76.0
max effort
rank #30
7 families · 4 categories · medium
75.7
xhigh effort
rank #31
8 families · 5 categories · high
74.9
max effort
rank #39
6 families · 4 categories · medium

Benchmark evidence

106 results
agentic coding
Release 2026-06-25
tasks_counted=3 · livebench_version=2026-06-25
xhigh effort59.4 %independentLiveBench
τ²-Bench
subset=banking
max effort37.3 %independentArtificial Analysis
τ²-Bench
subset=banking
high effort15.7 %independentArtificial Analysis
coding
Release 2026-06-25
tasks_counted=2 · livebench_version=2026-06-25
xhigh effort80.7 %independentLiveBench
SciCodemax effort54.3 %independentArtificial Analysis
SciCodehigh effort54.3 %independentArtificial Analysis
SciCodexhigh effort54.1 %independentArtificial Analysis
SciCodemedium effort51.6 %independentArtificial Analysis
SciCodelow effort50.1 %independentArtificial Analysis
SciCodehigh effort48.6 %independentArtificial Analysis
data analysis
Release 2026-06-25
tasks_counted=3 · livebench_version=2026-06-25
xhigh effort71.7 %independentLiveBench
external indices
AA Coding Indexmax effort71.5 pointsindependentArtificial Analysis
AA Coding Indexhigh effort66.4 pointsindependentArtificial Analysis
Intelligence Index v4.1max effort38.4 pointsindependentArtificial Analysis
Intelligence Index v4.1high effort32.0 pointsindependentArtificial Analysis
Intelligence Index v4.1high effort28.9 pointsindependentArtificial Analysis
Intelligence Index v4.1medium effort28.4 pointsindependentArtificial Analysis
Intelligence Index v4.1low effort24.7 pointsindependentArtificial Analysis
ECIhigh effort156.2 pointsindependentEpoch AI Benchmarking Hub
ECIxhigh effort156.2 pointsindependentEpoch AI Benchmarking Hub
ECImax effort156.2 pointsindependentEpoch AI Benchmarking Hub
ECI16K budget156.2 pointsindependentEpoch AI Benchmarking Hub
ECIlow effort156.2 pointsindependentEpoch AI Benchmarking Hub
ECImedium effort156.2 pointsindependentEpoch AI Benchmarking Hub
ECI156.2 pointsindependentEpoch AI Benchmarking Hub
Vals Indexmax effort59.6 pointsindependentVals AI
factuality
SimpleQA Verifiedmax effort33.7 %independentEpoch AI Benchmarking Hub
2026-08-27
SimpleQA Verifiedxhigh effort32.9 %independentEpoch AI Benchmarking Hub
2026-08-27
SimpleQA Verifiedxhigh effort25.0 %independentEpoch AI Benchmarking Hub
2026-07-01
SimpleQA Verifiedmax effort22.3 %independentEpoch AI Benchmarking Hub
2026-06-30
human preference
Coding (style control)older version
arena=text · category=coding · style_control=true
high effort1522.0
1510.11534.0
communityLMArena Leaderboard Dataset
Coding (style control)older version
arena=text · category=coding · style_control=true
1521.2
1513.91528.5
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
high effort1517.0
1497.41536.5
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
high effort1510.7
1500.71520.6
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
1510.1
1499.41520.7
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1505.0
1498.61511.3
communityLMArena Leaderboard Dataset
Chinese (style control)older version
arena=text · category=chinese · style_control=true
1498.6
1485.01512.2
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1497.3
1490.21504.4
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
high effort1492.8
1484.71500.9
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
high effort1490.8
1479.81501.8
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1490.2
1484.71495.7
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1488.1
1479.31496.9
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
1486.9
1472.01501.7
communityLMArena Leaderboard Dataset
French (style control)older version
arena=text · category=french · style_control=true
1485.3
1465.81504.9
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
high effort1483.2
1468.01498.4
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1482.1
1475.81488.4
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
high effort1480.8
1470.91490.6
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
1480.7
1468.71492.6
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
1478.7
1465.51492.0
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
high effort1477.8
1451.91503.7
communityLMArena Leaderboard Dataset
German (style control)older version
arena=text · category=german · style_control=true
1476.9
1449.81504.0
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
high effort1475.7
1454.81496.6
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1473.9
1467.81480.0
communityLMArena Leaderboard Dataset
Math (style control)older version
arena=text · category=math · style_control=true
1473.8
1457.81489.7
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1472.2
1461.31483.1
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1471.5
1462.81480.3
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
high effort1471.0
1456.41485.6
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
high effort1470.6
1457.11484.0
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
high effort1470.0
1460.81479.1
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
high effort1469.5
1460.61478.5
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1467.8
1461.61473.9
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1465.3
1458.71471.9
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
high effort1465.2
1442.31488.2
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
high effort1464.9
1454.21475.7
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
high effort1463.4
1456.41470.3
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1463.3
1455.11471.5
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1462.4
1457.61467.1
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
high effort1459.3
1440.61477.9
communityLMArena Leaderboard Dataset
Spanish (style control)older version
arena=text · category=spanish · style_control=true
1454.9
1434.31475.5
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1451.8
1444.41459.2
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
high effort1451.7
1443.11460.4
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
high effort1448.0
1435.71460.2
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1447.8
1442.11453.4
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1437.4
1428.91445.8
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1432.7
1425.01440.4
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
high effort1430.3
1415.71445.0
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
high effort1429.9
1417.01442.7
communityLMArena Leaderboard Dataset
Korean (style control)older version
arena=text · category=korean · style_control=true
1426.8
1401.11452.4
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond
implementation=artificial-analysis
max effort91.1 %independentArtificial Analysis
GPQA Diamondxhigh effort90.5 %independentEpoch AI Benchmarking Hub
2026-07-01
GPQA Diamond
implementation=vals-ai
max effort88.9 %independentVals AI
GPQA Diamondmax effort80.3 %independentEpoch AI Benchmarking Hub
2026-08-06
GPQA Diamond
implementation=artificial-analysis
high effort80.0 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
max effort41.3 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
xhigh effort39.0 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
high effort35.7 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
medium effort30.0 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
low effort21.9 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
high effort19.0 %independentArtificial Analysis
MMLU-Pro
implementation=vals-ai
max effort87.5 %independentVals AI
language
Release 2026-06-25
tasks_counted=3 · livebench_version=2026-06-25
xhigh effort75.0 %independentLiveBench
long context instruction
AA-LCRmax effort82.0 %independentArtificial Analysis
AA-LCRxhigh effort76.7 %independentArtificial Analysis
AA-LCRhigh effort76.7 %independentArtificial Analysis
AA-LCRmedium effort73.7 %independentArtificial Analysis
AA-LCRhigh effort70.0 %independentArtificial Analysis
AA-LCRlow effort67.3 %independentArtificial Analysis
Release 2026-06-25
tasks_counted=4 · livebench_version=2026-06-25
xhigh effort63.9 %independentLiveBench
multimodal
MMMU
implementation=vals-ai
max effort83.0 %independentVals AI
professional
CorpFinmax effort67.0 %independentVals AI
LegalBenchmax effort83.9 %independentVals AI
TaxEvalmax effort75.6 %independentVals AI
reasoning math
Release 2026-06-25
tasks_counted=4 · livebench_version=2026-06-25
xhigh effort92.9 %independentLiveBench
Release 2026-06-25
tasks_counted=4 · livebench_version=2026-06-25
xhigh effort88.7 %independentLiveBench
OTIS Mock AIME 2024–2025xhigh effort94.7 %independentEpoch AI Benchmarking Hub
2026-07-01
OTIS Mock AIME 2024–2025max effort80.0 %independentEpoch AI Benchmarking Hub
2026-08-06

Agent + model results

systems, not bare-model scores
agent + model Artificial Analysis harness + Claude Sonnet 5Terminal-Bench 2.180.5 %independentArtificial Analysis
agent + model Artificial Analysis harness + Claude Sonnet 5Terminal-Bench 2.175.3 %independentArtificial Analysis

These scores measure the whole agent system (scaffold, tools, budgets) — they are never merged into the bare model’s numbers.

Related variants