BenchAtlas

Rankings / Anthropic

Claude 3.5 Haiku 20241022

released 2024-10-22

BenchAtlas Index

as of 2026-09-11
Not enough benchmark coverage for a composite score (needs ≥4 families across ≥3 categories). The per-benchmark evidence below stands on its own — sparse coverage is an evidence gap, not a low score.

Benchmark evidence

42 results
external indices
ECI127.2 pointsindependentEpoch AI Benchmarking Hub
factuality
SimpleQA Verified6.7 %independentEpoch AI Benchmarking Hub
2025-11-28
human preference
Coding (style control)older version
arena=text · category=coding · style_control=true
1385.5
1379.41391.5
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1364.5
1359.61369.5
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1354.8
1348.91360.7
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
1351.8
1341.91361.6
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
1345.6
1334.61356.6
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1344.6
1338.51350.7
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1344.4
1339.81349.0
communityLMArena Leaderboard Dataset
French (style control)older version
arena=text · category=french · style_control=true
1343.0
1320.91365.1
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1342.2
1335.91348.4
communityLMArena Leaderboard Dataset
Polish (style control)older version
arena=text · category=polish · style_control=true
1338.8
1325.81351.9
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1335.4
1331.31339.5
communityLMArena Leaderboard Dataset
Spanish (style control)older version
arena=text · category=spanish · style_control=true
1332.9
1312.61353.2
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1327.6
1321.31333.9
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1324.0
1320.81327.3
communityLMArena Leaderboard Dataset
Chinese (style control)older version
arena=text · category=chinese · style_control=true
1320.9
1311.51330.2
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1318.2
1310.71325.7
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
1315.4
1304.81326.1
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1315.4
1310.71320.1
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1315.1
1308.21322.0
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1312.9
1307.81318.1
communityLMArena Leaderboard Dataset
German (style control)older version
arena=text · category=german · style_control=true
1311.7
1296.31327.0
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1306.5
1302.41310.7
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1304.7
1298.21311.2
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1304.0
1298.21309.8
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
1299.6
1291.61307.6
communityLMArena Leaderboard Dataset
Math (style control)older version
arena=text · category=math · style_control=true
1286.3
1278.71293.9
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1269.5
1264.71274.2
communityLMArena Leaderboard Dataset
Korean (style control)older version
arena=text · category=korean · style_control=true
1268.7
1250.11287.4
communityLMArena Leaderboard Dataset
Japanese (style control)older version
arena=text · category=japanese · style_control=true
1242.1
1225.61258.6
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond38.1 %independentEpoch AI Benchmarking Hub
2025-03-12
GPQA Diamond
implementation=vals-ai
37.9 %independentVals AI
MMLU-Pro
implementation=vals-ai
64.1 %independentVals AI
professional
CorpFin50.8 %independentVals AI
LegalBench70.3 %independentVals AI
TaxEval57.4 %independentVals AI
reasoning math
AIME
implementation=vals-ai
3.3 %independentVals AI
FrontierMath0.3 %independentEpoch AI Benchmarking Hub
2025-03-07
MATH-500
implementation=vals-ai
64.2 %independentVals AI
MATH Level 546.4 %independentEpoch AI Benchmarking Hub
2025-03-12
OTIS Mock AIME 2024–20254.3 %independentEpoch AI Benchmarking Hub
2025-02-25