BenchAtlas

Rankings / OpenAI

O1 Preview (2024-09-12)

proprietary

released 2024-09-12

BenchAtlas Index

as of 2026-07-14
41.7
base configuration
rank #281
5 families · 3 categories · medium

Benchmark evidence

34 results
coding
LiveCodeBench v5older version
problems=279 · window_start=2024-08-01
42.6 %independentLiveCodeBench Leaderboard
external indices
AA Coding Index34.0 pointsindependentArtificial Analysis
Intelligence Index v4.117.0 pointsindependentArtificial Analysis
ECI135.8 pointsindependentEpoch AI Benchmarking Hub
human preference
Coding (style control)older version
arena=text · category=coding · style_control=true
1416.5
1407.1–1425.8
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1413.3
1403.8–1422.7
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1409.5
1403.2–1415.7
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1407.2
1399.3–1415.0
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
1397.7
1387.3–1408.1
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1396.5
1388.8–1404.2
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
1390.8
1376.5–1405.2
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1390.2
1380.9–1399.4
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1389.2
1380.1–1398.3
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1388.4
1383.4–1393.4
communityLMArena Leaderboard Dataset
Math (style control)older version
arena=text · category=math · style_control=true
1386.1
1376.4–1395.8
communityLMArena Leaderboard Dataset
Chinese (style control)older version
arena=text · category=chinese · style_control=true
1385.7
1373.3–1398.1
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1381.4
1371.8–1391.1
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1381.2
1373.2–1389.1
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1380.8
1373.9–1387.6
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
1380.3
1365.8–1394.9
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1372.0
1362.4–1381.5
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1366.0
1358.6–1373.3
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
1365.3
1350.0–1380.7
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1365.3
1355.4–1375.2
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1358.9
1352.5–1365.3
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1358.0
1348.2–1367.7
communityLMArena Leaderboard Dataset
German (style control)older version
arena=text · category=german · style_control=true
1353.4
1332.1–1374.7
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1353.3
1342.8–1363.8
communityLMArena Leaderboard Dataset
Japanese (style control)older version
arena=text · category=japanese · style_control=true
1348.0
1324.2–1371.8
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond50.3 %independentEpoch AI Benchmarking Hub
2025-01-27
professional
MedQAhigh effort93.0 %independentVals AI
reasoning math
MATH-500
implementation=artificial-analysis
92.4 %independentArtificial Analysis
MATH Level 581.7 %independentEpoch AI Benchmarking Hub
2025-01-27
OTIS Mock AIME 2024–202531.1 %independentEpoch AI Benchmarking Hub
2025-03-07

Agent + model results

systems, not bare-model scores
agent + model W&B Programmer O1 crosscheck5 + O1 Preview (2024-09-12)SWE-bench Verified64.6 %unverifiedSWE-bench Leaderboard

These scores measure the whole agent system (scaffold, tools, budgets) — they are never merged into the bare model’s numbers.