O1 Pro

released 2025-03-19

BenchAtlas Index

as of 2026-07-14

Not enough benchmark coverage for a composite score (needs ≥4 families across ≥3 categories). The per-benchmark evidence below stands on its own — sparse coverage is an evidence gap, not a low score.

Benchmark evidence

3 results

external indices

Intelligence Index v4.1

18.9 points

independent

Artificial Analysis

factuality

MASK

61.6 %

60.7–62.5

independent

Scale Labs

knowledge science

Humanity's Last Exam

contamination=9% (216 prompts) failed due to a post-training bug and were counted as failures. OpenAI has been informed and is working on a fix. --- Potential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. · implementation=scale

8.1 %

7.0–9.2

independent

Scale Labs