BenchAtlas

Rankings / Mistral AI

Mistral Medium 2505

released 2025-05-07

BenchAtlas Index

as of 2026-09-11
Not enough benchmark coverage for a composite score (needs ≥4 families across ≥3 categories). The per-benchmark evidence below stands on its own — sparse coverage is an evidence gap, not a low score.

Benchmark evidence

41 results
external indices
ECI134.1 pointsindependentEpoch AI Benchmarking Hub
human preference
Coding (style control)older version
arena=text · category=coding · style_control=true
1433.0
1425.01441.0
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1422.0
1415.41428.5
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
1418.7
1404.91432.4
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1409.6
1401.81417.4
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
1409.4
1396.51422.3
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1408.8
1400.41417.2
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1403.3
1395.01411.5
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1402.4
1396.51408.4
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1400.6
1394.61406.6
communityLMArena Leaderboard Dataset
German (style control)older version
arena=text · category=german · style_control=true
1392.9
1374.11411.7
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1391.7
1383.71399.8
communityLMArena Leaderboard Dataset
Polish (style control)older version
arena=text · category=polish · style_control=true
1391.5
1379.81403.3
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1387.3
1382.61392.1
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1387.0
1378.21395.7
communityLMArena Leaderboard Dataset
Chinese (style control)older version
arena=text · category=chinese · style_control=true
1386.0
1372.91399.2
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1384.4
1373.41395.4
communityLMArena Leaderboard Dataset
Spanish (style control)older version
arena=text · category=spanish · style_control=true
1379.6
1354.11405.1
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
1378.7
1365.01392.4
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1369.8
1362.21377.4
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1369.4
1363.81375.0
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1366.1
1359.61372.5
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1366.0
1358.81373.1
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1363.7
1354.11373.4
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1354.7
1346.41362.9
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
1353.6
1341.21366.0
communityLMArena Leaderboard Dataset
Math (style control)older version
arena=text · category=math · style_control=true
1347.8
1335.61359.9
communityLMArena Leaderboard Dataset
Japanese (style control)older version
arena=text · category=japanese · style_control=true
1326.1
1306.01346.2
communityLMArena Leaderboard Dataset
Korean (style control)older version
arena=text · category=korean · style_control=true
1316.2
1292.31340.2
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond59.5 %independentEpoch AI Benchmarking Hub
2025-05-07
MMLU-Pro
implementation=vals-ai
75.3 %independentVals AI
multimodal
MMMU
implementation=vals-ai
63.0 %independentVals AI
professional
CorpFin50.7 %independentVals AI
LegalBench62.0 %independentVals AI
MedQA78.2 %independentVals AI
TaxEval70.3 %independentVals AI
reasoning math
AIME
implementation=vals-ai
42.3 %independentVals AI
FrontierMath0.3 %independentEpoch AI Benchmarking Hub
2025-05-07
MATH-500
implementation=vals-ai
87.0 %independentVals AI
MATH Level 581.6 %independentEpoch AI Benchmarking Hub
2025-05-07
OTIS Mock AIME 2024–202532.2 %independentEpoch AI Benchmarking Hub
2025-05-07

Related variants