Sources / vals-ai

Vals AI

healthydefault: independent

www.vals.ai · trust rank 70 · adapter vals-ai

Observations

1,112

append-only score facts

Raw snapshots

418

immutable fetched payloads

Last success

2026-09-11 10:00Z

end of last succeeded/partial run

Freshness

22.3 h

hours since last success

License & attribution

No ToS page or license statement exists on vals.ai; attributed as "Vals AI (vals.ai)" with a link as good practice.

What we ingest

Leaderboard JSON from per-benchmark pages: accuracy, stderr, cost and full run configs across ~30 benchmarks including their own professional-domain (legal, finance, medical) evals, which land as independent. The Vals Index is stored as their own family, never merged with ours.

Ingestion runs

last 10 of the run history

Started	Duration	Status	Key stats
2026-09-11 10:00Z	13.4 s	partial	docs 11 · staged 1,152 · promoted 1,032 · blocked 4,005 · scoreAdded 0 · unchanged 0
2026-09-10 10:00Z	15.0 s	partial	docs 11 · staged 1,150 · promoted 1,032 · blocked 3,885 · scoreAdded 0 · unchanged 11
2026-09-09 10:00Z	13.9 s	partial	docs 11 · staged 1,150 · promoted 1,032 · blocked 3,767 · scoreAdded 0 · unchanged 0
2026-09-08 10:00Z	18.2 s	partial	docs 11 · staged 1,150 · promoted 1,032 · blocked 3,649 · scoreAdded 0 · unchanged 11
2026-09-07 10:00Z	14.8 s	partial	docs 11 · staged 1,150 · promoted 1,032 · blocked 3,531 · scoreAdded 0 · unchanged 0
2026-09-06 10:00Z	12.7 s	partial	docs 11 · staged 1,149 · promoted 1,032 · blocked 3,413 · scoreAdded 0 · unchanged 11
2026-09-05 10:00Z	15.8 s	partial	docs 11 · staged 1,149 · promoted 1,032 · blocked 3,296 · scoreAdded 0 · unchanged 0
2026-09-04 10:00Z	13.9 s	partial	docs 11 · staged 1,148 · promoted 1,032 · blocked 3,179 · scoreAdded 0 · unchanged 0
2026-09-03 10:00Z	17.9 s	partial	docs 11 · staged 1,147 · promoted 1,032 · blocked 3,063 · scoreAdded 0 · unchanged 0
2026-09-02 10:00Z	19.9 s	partial	docs 11 · staged 1,141 · promoted 1,032 · blocked 2,948 · scoreAdded 0 · unchanged 0

partial = run finished but some rows are blocked on identity review — nothing is published until every referenced model/agent/benchmark is resolved.

Raw snapshots

latest 5

Fetched	URL	SHA-256	Last re-fetch
2026-09-11 10:00Z	https://www.vals.ai/benchmarks/vals_index	57e47385f272…	2026-09-11 10:00Z
2026-09-11 10:00Z	https://www.vals.ai/benchmarks/mmmu	10f5dbfa9deb…	2026-09-11 10:00Z
2026-09-11 10:00Z	https://www.vals.ai/benchmarks/mmlu_pro	a96d65c8112f…	2026-09-11 10:00Z
2026-09-11 10:00Z	https://www.vals.ai/benchmarks/gpqa	e7b5208bf77a…	2026-09-11 10:00Z
2026-09-11 10:00Z	https://www.vals.ai/benchmarks/math500	e219e4b1529e…	2026-09-11 10:00Z

Snapshots are immutable raw payloads — every published number traces back to one. Re-fetching an identical payload bumps the re-fetch time instead of storing a duplicate. Scores from this source appear on benchmark profiles and model pages with this source linked.