Sources / epoch-ai

Epoch AI Benchmarking Hub

failingdefault: independent

epoch.ai/benchmarks · trust rank 90 · adapter epoch-ai

Observations

6,038

append-only score facts

Raw snapshots

immutable fetched payloads

Last success

2026-09-04 06:00Z

end of last succeeded/partial run

Freshness

194.3 h

hours since last success

License & attribution

CC-BY 4.0 — the cleanest license among our sources. Cited as: Epoch AI, "AI Benchmarking Hub", https://epoch.ai/benchmarks.

What we ingest

Per-benchmark CSVs from benchmark_data.zip: Epoch-run evals (FrontierMath, GPQA Diamond, MATH Level 5, SimpleQA Verified, SWE-bench Verified, OTIS Mock AIME) via their Inspect harness with stderr, plus the Epoch Capabilities Index. Epoch-run rows land as independent; third-party _external files carry lower default trust.

Ingestion runs

last 10 of the run history

Started	Duration	Status	Key stats
2026-09-12 06:00Z	0.4 s	failed Error: epoch-ai: epoch_capabilities_index.csv missing from zip — schema drift?	docs 1 · unchanged 0
2026-09-11 06:00Z	0.4 s	failed Error: epoch-ai: epoch_capabilities_index.csv missing from zip — schema drift?	docs 1 · unchanged 0
2026-09-10 06:00Z	0.2 s	failed Error: epoch-ai: epoch_capabilities_index.csv missing from zip — schema drift?	docs 1 · unchanged 0
2026-09-09 06:00Z	0.2 s	failed Error: epoch-ai: epoch_capabilities_index.csv missing from zip — schema drift?	docs 1 · unchanged 0
2026-09-08 06:00Z	0.2 s	failed Error: epoch-ai: epoch_capabilities_index.csv missing from zip — schema drift?	docs 1 · unchanged 0
2026-09-07 06:00Z	0.3 s	failed Error: epoch-ai: epoch_capabilities_index.csv missing from zip — schema drift?	docs 1 · unchanged 0
2026-09-06 06:00Z	0.2 s	failed Error: epoch-ai: epoch_capabilities_index.csv missing from zip — schema drift?	docs 1 · unchanged 0
2026-09-05 06:00Z	0.2 s	failed Error: epoch-ai: epoch_capabilities_index.csv missing from zip — schema drift?	docs 1 · unchanged 0
2026-09-04 06:00Z	22.7 s	partial	docs 1 · staged 1,649 · promoted 1,427 · blocked 3,542 · scoreAdded 270 · unchanged 0
2026-09-03 06:00Z	19.8 s	partial	docs 1 · staged 1,640 · promoted 1,427 · blocked 3,320 · scoreAdded 490 · unchanged 0

partial = run finished but some rows are blocked on identity review — nothing is published until every referenced model/agent/benchmark is resolved.

Raw snapshots

latest 5

Fetched	URL	SHA-256	Last re-fetch
2026-09-12 06:00Z	https://epoch.ai/data/benchmark_data.zip	a95242d0c836…	2026-09-12 06:00Z
2026-09-11 06:00Z	https://epoch.ai/data/benchmark_data.zip	3f640c10ce51…	2026-09-11 06:00Z
2026-09-10 06:00Z	https://epoch.ai/data/benchmark_data.zip	abf04b3bf41d…	2026-09-10 06:00Z
2026-09-09 06:00Z	https://epoch.ai/data/benchmark_data.zip	420e0a680fed…	2026-09-09 06:00Z
2026-09-08 06:00Z	https://epoch.ai/data/benchmark_data.zip	b3b849fff42f…	2026-09-08 06:00Z

Snapshots are immutable raw payloads — every published number traces back to one. Re-fetching an identical payload bumps the re-fetch time instead of storing a duplicate. Scores from this source appear on benchmark profiles and model pages with this source linked.