O3 20250416

release date unknown

BenchAtlas Index

as of 2026-07-14

Not enough benchmark coverage for a composite score (needs ≥4 families across ≥3 categories). The per-benchmark evidence below stands on its own — sparse coverage is an evidence gap, not a low score.

Benchmark evidence

0 results

No bare-model results yet.

Agent + model results

systems, not bare-model scores

agent + model mini-SWE-agent + O3 20250416	SWE-bench Verified	58.4 %	community	SWE-bench Leaderboard
agent + model mini-SWE-agent + O3 20250416	SWE-bench bash-only	58.4 %	community	SWE-bench Leaderboard
agent + model mini-SWE-agent + O3 20250416	SWE-bench Verified	0.3 usd_per_task	community	SWE-bench Leaderboard
agent + model mini-SWE-agent + O3 20250416	SWE-bench bash-only	0.3 usd_per_task	community	SWE-bench Leaderboard

These scores measure the whole agent system (scaffold, tools, budgets) — they are never merged into the bare model’s numbers.

Related variants

O3 (2025-04-16)