BenchAtlas

Rankings / Google DeepMind

Gemini 1.5 Pro 002

released 2024-09-24

BenchAtlas Index

as of 2026-07-14
29.6
base configuration
rank #359
8 families · 4 categories · medium

Benchmark evidence

40 results
external indices
ECI132.7 pointsindependentEpoch AI Benchmarking Hub
human preference
Chinese (style control)older version
arena=text · category=chinese · style_control=true
1372.3
1362.41382.3
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
1366.4
1355.31377.5
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1359.7
1352.71366.6
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1358.4
1351.01365.8
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1356.8
1349.61364.0
communityLMArena Leaderboard Dataset
Coding (style control)older version
arena=text · category=coding · style_control=true
1356.4
1349.51363.3
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1356.0
1351.61360.5
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1355.8
1349.91361.6
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1354.6
1347.91361.3
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
1354.2
1341.81366.7
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1353.7
1347.81359.6
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
1353.4
1345.71361.1
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1351.1
1347.71354.4
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1350.9
1345.31356.5
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1349.9
1342.11357.6
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1341.2
1336.41345.9
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1339.0
1334.01343.9
communityLMArena Leaderboard Dataset
Math (style control)older version
arena=text · category=math · style_control=true
1338.9
1331.51346.2
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1336.6
1329.81343.4
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
1336.1
1325.11347.1
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1331.1
1322.91339.3
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1328.9
1322.01335.8
communityLMArena Leaderboard Dataset
Korean (style control)older version
arena=text · category=korean · style_control=true
1325.0
1301.51348.6
communityLMArena Leaderboard Dataset
Japanese (style control)older version
arena=text · category=japanese · style_control=true
1317.4
1299.81334.9
communityLMArena Leaderboard Dataset
German (style control)older version
arena=text · category=german · style_control=true
1313.4
1296.71330.1
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1312.5
1307.21317.8
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond
implementation=vals-ai
58.3 %independentVals AI
GPQA Diamond57.2 %independentEpoch AI Benchmarking Hub
2025-01-27
Humanity's Last Exam
contamination=This model was used as an initial filter for the dataset. · implementation=scale
4.6 %
3.85.4
independentScale Labs
MMLU-Pro
implementation=vals-ai
75.3 %independentVals AI
multimodal
MMMU
implementation=vals-ai
65.5 %independentVals AI
professional
CorpFin40.5 %independentVals AI
LegalBench69.1 %independentVals AI
MedQA76.5 %independentVals AI
TaxEval59.5 %independentVals AI
reasoning math
AIME
implementation=vals-ai
18.8 %independentVals AI
MATH-500
implementation=vals-ai
82.8 %independentVals AI
MATH Level 570.4 %independentEpoch AI Benchmarking Hub
2025-01-27
OTIS Mock AIME 2024–202523.1 %independentEpoch AI Benchmarking Hub
2025-02-25

Related variants