Sources / livebench

LiveBench

healthydefault: independent

livebench.ai · trust rank 85 · adapter livebench

Observations

291

append-only score facts

Raw snapshots

immutable fetched payloads

Last success

2026-09-12 07:00Z

end of last succeeded/partial run

Freshness

1.3 h

hours since last success

License & attribution

The LiveBench repository is Apache-2.0; the site CSVs themselves are unlabeled and are surfaced as facts with attribution and a link. Newest questions are deliberately withheld under their contamination policy.

What we ingest

Per-release table CSV paired with its same-version categories JSON; task scores average to category means (their method). Each dated release is a separate benchmark version, and inference-config slugs stay separate evaluated systems.

Ingestion runs

last 10 of the run history

Started	Duration	Status	Key stats
2026-09-12 07:00Z	2.0 s	partial	docs 3 · staged 399 · promoted 224 · blocked 4,865 · scoreAdded 0 · unchanged 3
2026-09-11 07:00Z	2.6 s	partial	docs 3 · staged 399 · promoted 224 · blocked 4,690 · scoreAdded 0 · unchanged 1
2026-09-10 07:00Z	2.0 s	partial	docs 3 · staged 392 · promoted 224 · blocked 4,515 · scoreAdded 0 · unchanged 3
2026-09-09 07:00Z	1.7 s	partial	docs 3 · staged 392 · promoted 224 · blocked 4,347 · scoreAdded 0 · unchanged 3
2026-09-08 07:00Z	1.9 s	partial	docs 3 · staged 392 · promoted 224 · blocked 4,179 · scoreAdded 0 · unchanged 1
2026-09-07 07:00Z	1.8 s	partial	docs 3 · staged 385 · promoted 224 · blocked 4,011 · scoreAdded 0 · unchanged 1
2026-09-06 07:00Z	1.4 s	partial	docs 3 · staged 378 · promoted 224 · blocked 3,850 · scoreAdded 0 · unchanged 3
2026-09-05 07:00Z	1.7 s	partial	docs 3 · staged 378 · promoted 224 · blocked 3,696 · scoreAdded 0 · unchanged 1
2026-09-04 07:00Z	1.8 s	partial	docs 3 · staged 371 · promoted 224 · blocked 3,542 · scoreAdded 1 · unchanged 1
2026-09-03 07:00Z	2.1 s	partial	docs 3 · staged 371 · promoted 224 · blocked 3,395 · scoreAdded 0 · unchanged 1

partial = run finished but some rows are blocked on identity review — nothing is published until every referenced model/agent/benchmark is resolved.

Raw snapshots

latest 5

Fetched	URL	SHA-256	Last re-fetch
2026-09-11 07:00Z	https://livebench.ai/cost_2026_06_25.csv	45a4026f169a…	2026-09-12 07:00Z
2026-09-11 07:00Z	https://livebench.ai/table_2026_06_25.csv	186ca65e7bb3…	2026-09-12 07:00Z
2026-09-08 07:00Z	https://livebench.ai/cost_2026_06_25.csv	c8c24e6f5091…	2026-09-10 07:00Z
2026-09-08 07:00Z	https://livebench.ai/table_2026_06_25.csv	a348f9388138…	2026-09-10 07:00Z
2026-09-07 07:00Z	https://livebench.ai/cost_2026_06_25.csv	d121c05b440f…	2026-09-07 07:00Z

Snapshots are immutable raw payloads — every published number traces back to one. Re-fetching an identical payload bumps the re-fetch time instead of storing a duplicate. Scores from this source appear on benchmark profiles and model pages with this source linked.