Rankings / Anthropic

Claude Sonnet 4 20250514 Bedrock

released 2025-05-14

BenchAtlas Index

as of 2026-07-14

Not enough benchmark coverage for a composite score (needs ≥4 families across ≥3 categories). The per-benchmark evidence below stands on its own — sparse coverage is an evidence gap, not a low score.

Benchmark evidence

16 results

reasoning math

ARC-AGI-1older version split=public_eval · model_type=CoT	thinking · 16K budget	56.8 %	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=public_eval · model_type=CoT	thinking · 8K budget	48.6 %	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=semi_private · model_type=CoT	thinking · 16K budget	40.0 %	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=semi_private · model_type=CoT	thinking · 8K budget	29.0 %	independent	ARC Prize Leaderboard
ARC-AGI-2 split=semi_private · model_type=CoT	thinking · 16K budget	5.9 %	independent	ARC Prize Leaderboard
ARC-AGI-2 split=public_eval · model_type=CoT	thinking · 16K budget	4.4 %	independent	ARC Prize Leaderboard
ARC-AGI-2 split=public_eval · model_type=CoT	thinking · 8K budget	2.9 %	independent	ARC Prize Leaderboard
ARC-AGI-2 split=semi_private · model_type=CoT	thinking · 8K budget	2.1 %	independent	ARC Prize Leaderboard
ARC-AGI-2 split=public_eval · model_type=CoT	thinking · 16K budget	0.5 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-2 split=semi_private · model_type=CoT	thinking · 16K budget	0.5 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=semi_private · model_type=CoT	thinking · 16K budget	0.4 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=public_eval · model_type=CoT	thinking · 16K budget	0.3 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-2 split=public_eval · model_type=CoT	thinking · 8K budget	0.3 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-2 split=semi_private · model_type=CoT	thinking · 8K budget	0.3 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=semi_private · model_type=CoT	thinking · 8K budget	0.2 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=public_eval · model_type=CoT	thinking · 8K budget	0.2 usd_per_task	independent	ARC Prize Leaderboard