BenchAtlas

Rankings / Anthropic

Claude 3.7

released 2025-02-24

BenchAtlas Index

as of 2026-07-14
Not enough benchmark coverage for a composite score (needs ≥4 families across ≥3 categories). The per-benchmark evidence below stands on its own — sparse coverage is an evidence gap, not a low score.

Benchmark evidence

24 results
reasoning math
ARC-AGI-1older version
split=semi_private · model_type=CoT
thinking · 16K budget28.6 %independentARC Prize Leaderboard
ARC-AGI-1older version
split=semi_private · model_type=CoT
thinking · 8K budget21.2 %independentARC Prize Leaderboard
ARC-AGI-1older version
split=semi_private · model_type=Base LLM
13.6 %independentARC Prize Leaderboard
ARC-AGI-1older version
split=semi_private · model_type=CoT
thinking · 1K budget11.6 %independentARC Prize Leaderboard
ARC-AGI-2
split=semi_private · model_type=CoT
thinking · 8K budget0.9 %independentARC Prize Leaderboard
ARC-AGI-2
split=public_eval · model_type=CoT
thinking · 16K budget0.8 %independentARC Prize Leaderboard
ARC-AGI-2
split=public_eval · model_type=CoT
thinking · 1K budget0.8 %independentARC Prize Leaderboard
ARC-AGI-2
split=semi_private · model_type=CoT
thinking · 16K budget0.7 %independentARC Prize Leaderboard
ARC-AGI-2
split=public_eval · model_type=CoT
thinking · 16K budget0.6 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-2
split=semi_private · model_type=CoT
thinking · 16K budget0.5 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-2
split=semi_private · model_type=CoT
thinking · 1K budget0.4 %independentARC Prize Leaderboard
ARC-AGI-2
split=semi_private · model_type=CoT
thinking · 8K budget0.4 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-2
split=public_eval · model_type=CoT
thinking · 8K budget0.4 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-1older version
split=semi_private · model_type=CoT
thinking · 16K budget0.3 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-1older version
split=semi_private · model_type=CoT
thinking · 8K budget0.2 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-2
split=semi_private · model_type=CoT
thinking · 1K budget0.1 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-2
split=public_eval · model_type=CoT
thinking · 1K budget0.1 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-2
split=public_eval · model_type=Base LLM
0.1 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-2
split=semi_private · model_type=Base LLM
0.1 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-1older version
split=semi_private · model_type=CoT
thinking · 1K budget0.1 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-1older version
split=semi_private · model_type=Base LLM
0.1 usd_per_taskindependentARC Prize Leaderboard
ARC-AGI-2
split=semi_private · model_type=Base LLM
0.0 %independentARC Prize Leaderboard
ARC-AGI-2
split=public_eval · model_type=Base LLM
0.0 %independentARC Prize Leaderboard
ARC-AGI-2
split=public_eval · model_type=CoT
thinking · 8K budget0.0 %independentARC Prize Leaderboard

Related variants

Claude 4.7Claude 2.0Claude 2.1Claude 2