Sources / vals-ai

Vals AI

healthydefault: independent

www.vals.ai · trust rank 70 · adapter vals-ai

Observations

1,036

append-only score facts

Raw snapshots

immutable fetched payloads

Last success

2026-07-14 00:16Z

end of last succeeded/partial run

Freshness

1.2 h

hours since last success

License & attribution

No ToS page or license statement exists on vals.ai; attributed as "Vals AI (vals.ai)" with a link as good practice.

What we ingest

Leaderboard JSON from per-benchmark pages: accuracy, stderr, cost and full run configs across ~30 benchmarks including their own professional-domain (legal, finance, medical) evals, which land as independent. The Vals Index is stored as their own family, never merged with ours.

Ingestion runs

last 3 of the run history

Started	Duration	Status	Key stats
2026-07-14 00:16Z	5.6 s	succeeded	docs 11 · promoted 0 · blocked 0 · scoreAdded 0 · unchanged 11
2026-07-14 00:09Z	5.7 s	succeeded	docs 11 · promoted 0 · blocked 0 · scoreAdded 0 · unchanged 11
2026-07-13 20:03Z	7.1 s	partial	docs 11 · staged 1,036 · promoted 0 · blocked 1,036 · scoreAdded 0 · unchanged 0

partial = run finished but some rows are blocked on identity review — nothing is published until every referenced model/agent/benchmark is resolved.

Raw snapshots

latest 5

Fetched	URL	SHA-256	Last re-fetch
2026-07-13 20:03Z	https://www.vals.ai/benchmarks/vals_index	ed43197ac520…	2026-07-14 00:16Z
2026-07-13 20:03Z	https://www.vals.ai/benchmarks/mmmu	fbab2c3e2f2b…	2026-07-14 00:16Z
2026-07-13 20:03Z	https://www.vals.ai/benchmarks/mmlu_pro	4a4e699eba45…	2026-07-14 00:16Z
2026-07-13 20:03Z	https://www.vals.ai/benchmarks/gpqa	0c51d101492d…	2026-07-14 00:16Z
2026-07-13 20:03Z	https://www.vals.ai/benchmarks/math500	e26048cb92a3…	2026-07-14 00:16Z

Snapshots are immutable raw payloads — every published number traces back to one. Re-fetching an identical payload bumps the re-fetch time instead of storing a duplicate. Scores from this source appear on benchmark profiles and model pages with this source linked.