BenchAtlas

Rankings / Anthropic

Claude 3.5 Sonnet 20240620

released 2024-06-20

BenchAtlas Index

as of 2026-09-11
32.2
base configuration
rank #362
5 families · 3 categories · medium

Benchmark evidence

35 results
coding
LiveCodeBench v5older version
problems=279 · window_start=2024-08-01
32.0 %independentLiveCodeBench Leaderboard
external indices
ECI130.0 pointsindependentEpoch AI Benchmarking Hub
human preference
Coding (style control)older version
arena=text · category=coding · style_control=true
1398.9
1391.81406.0
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1373.2
1367.31379.1
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1366.9
1360.01373.8
communityLMArena Leaderboard Dataset
French (style control)older version
arena=text · category=french · style_control=true
1363.3
1339.61387.0
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1360.3
1354.71366.0
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1356.4
1349.11363.6
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
1354.3
1343.31365.3
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1354.0
1346.21361.7
communityLMArena Leaderboard Dataset
Spanish (style control)older version
arena=text · category=spanish · style_control=true
1351.4
1328.81374.0
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
1349.3
1337.71360.8
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1348.8
1341.61356.1
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1348.8
1344.21353.3
communityLMArena Leaderboard Dataset
Chinese (style control)older version
arena=text · category=chinese · style_control=true
1344.8
1335.41354.3
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1344.1
1336.01352.2
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
1343.3
1332.11354.6
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1342.7
1339.21346.1
communityLMArena Leaderboard Dataset
Math (style control)older version
arena=text · category=math · style_control=true
1341.7
1334.11349.2
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
1339.3
1331.51347.2
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1337.5
1332.31342.6
communityLMArena Leaderboard Dataset
German (style control)older version
arena=text · category=german · style_control=true
1333.9
1319.01348.8
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1331.4
1326.61336.2
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1330.0
1323.91336.1
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1320.6
1312.31328.8
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1311.1
1303.81318.3
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1303.7
1296.11311.3
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1296.2
1290.91301.4
communityLMArena Leaderboard Dataset
Korean (style control)older version
arena=text · category=korean · style_control=true
1290.4
1270.81310.0
communityLMArena Leaderboard Dataset
Japanese (style control)older version
arena=text · category=japanese · style_control=true
1284.4
1268.21300.7
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond54.0 %independentEpoch AI Benchmarking Hub
2025-01-27
reasoning math
FrontierMath1.0 %independentEpoch AI Benchmarking Hub
2025-03-07
FrontierMath Tier 4older version0.0 %independentEpoch AI Benchmarking Hub
2025-07-01
MATH Level 551.7 %independentEpoch AI Benchmarking Hub
2025-01-27
OTIS Mock AIME 2024–20256.5 %independentEpoch AI Benchmarking Hub
2025-02-25

Related variants