BenchAtlas

Rankings / Anthropic

Claude 3.5 Haiku 20241022

released 2024-10-22

BenchAtlas Index

as of 2026-07-14
Not enough benchmark coverage for a composite score (needs ≥4 families across ≥3 categories). The per-benchmark evidence below stands on its own — sparse coverage is an evidence gap, not a low score.

Benchmark evidence

42 results
external indices
ECI127.5 pointsindependentEpoch AI Benchmarking Hub
factuality
SimpleQA Verified6.7 %independentEpoch AI Benchmarking Hub
2025-11-28
human preference
Coding (style control)older version
arena=text · category=coding · style_control=true
1385.1
1379.11391.1
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1364.6
1359.61369.5
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1357.1
1351.51362.8
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
1350.9
1341.11360.7
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1344.2
1339.61348.8
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
1344.0
1333.11355.0
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1343.2
1337.11349.3
communityLMArena Leaderboard Dataset
French (style control)older version
arena=text · category=french · style_control=true
1342.6
1319.91365.3
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1341.8
1335.61348.1
communityLMArena Leaderboard Dataset
Polish (style control)older version
arena=text · category=polish · style_control=true
1337.5
1324.31350.6
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1336.4
1332.41340.4
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1326.3
1320.01332.5
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1323.7
1320.51326.9
communityLMArena Leaderboard Dataset
Spanish (style control)older version
arena=text · category=spanish · style_control=true
1322.0
1300.81343.1
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1317.7
1309.91325.4
communityLMArena Leaderboard Dataset
Chinese (style control)older version
arena=text · category=chinese · style_control=true
1316.0
1306.21325.7
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1315.8
1308.91322.6
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1314.6
1309.91319.2
communityLMArena Leaderboard Dataset
German (style control)older version
arena=text · category=german · style_control=true
1314.4
1299.01329.8
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
1312.8
1302.21323.3
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1312.6
1307.51317.8
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1304.6
1298.21311.0
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1304.4
1300.31308.6
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1304.0
1298.31309.8
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
1299.4
1291.51307.2
communityLMArena Leaderboard Dataset
Math (style control)older version
arena=text · category=math · style_control=true
1286.4
1278.91293.9
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1269.4
1264.71274.1
communityLMArena Leaderboard Dataset
Korean (style control)older version
arena=text · category=korean · style_control=true
1268.2
1249.41286.9
communityLMArena Leaderboard Dataset
Japanese (style control)older version
arena=text · category=japanese · style_control=true
1241.5
1224.81258.2
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond38.1 %independentEpoch AI Benchmarking Hub
2025-03-12
GPQA Diamond
implementation=vals-ai
37.9 %independentVals AI
MMLU-Pro
implementation=vals-ai
64.1 %independentVals AI
professional
CorpFin50.8 %independentVals AI
LegalBench70.3 %independentVals AI
TaxEval57.4 %independentVals AI
reasoning math
AIME
implementation=vals-ai
3.3 %independentVals AI
FrontierMath0.3 %independentEpoch AI Benchmarking Hub
2025-03-07
MATH-500
implementation=vals-ai
64.2 %independentVals AI
MATH Level 546.4 %independentEpoch AI Benchmarking Hub
2025-03-12
OTIS Mock AIME 2024–20254.3 %independentEpoch AI Benchmarking Hub
2025-02-25