Grok 3 Openrouter

released 2025-02-19

BenchAtlas Index

as of 2026-07-14

Not enough benchmark coverage for a composite score (needs ≥4 families across ≥3 categories). The per-benchmark evidence below stands on its own — sparse coverage is an evidence gap, not a low score.

Benchmark evidence

8 results

reasoning math

ARC-AGI-1older version split=public_eval · model_type=Base LLM	8.4 %	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=semi_private · model_type=Base LLM	5.5 %	independent	ARC Prize Leaderboard
ARC-AGI-2 split=semi_private · model_type=Base LLM	0.1 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-2 split=public_eval · model_type=Base LLM	0.1 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=semi_private · model_type=Base LLM	0.1 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-1older version split=public_eval · model_type=Base LLM	0.1 usd_per_task	independent	ARC Prize Leaderboard
ARC-AGI-2 split=public_eval · model_type=Base LLM	0.0 %	independent	ARC Prize Leaderboard
ARC-AGI-2 split=semi_private · model_type=Base LLM	0.0 %	independent	ARC Prize Leaderboard