Sources / scale-labs

Scale Labs

healthydefault: independent

labs.scale.com/leaderboard · trust rank 70 · adapter scale-labs

Observations

257

append-only score facts

Raw snapshots

immutable fetched payloads

Last success

2026-07-14 00:16Z

end of last succeeded/partial run

Freshness

1.2 h

hours since last success

License & attribution

scale.com terms grant an internal-purposes license and robots.txt allows the leaderboard, but republication is a legal gray zone — a wave-2 source, attributed and linked, to be reassessed before public launch.

What we ingest

Embedded payloads from labs.scale.com leaderboard pages: score plus 95% CI half-width per model configuration across their SEAL-lineage benchmarks (HLE, MultiChallenge, Fortress, …). Scale runs the evals, so rows land as independent.

Ingestion runs

last 3 of the run history

Started	Duration	Status	Key stats
2026-07-14 00:16Z	4.3 s	succeeded	docs 5 · staged 257 · promoted 257 · blocked 0 · scoreAdded 0 · unchanged 2
2026-07-14 00:09Z	4.6 s	succeeded	docs 5 · staged 257 · promoted 257 · blocked 0 · scoreAdded 0 · unchanged 0
2026-07-13 20:03Z	4.5 s	partial	docs 5 · staged 257 · promoted 0 · blocked 257 · scoreAdded 0 · unchanged 0

partial = run finished but some rows are blocked on identity review — nothing is published until every referenced model/agent/benchmark is resolved.

Raw snapshots

latest 5

Fetched	URL	SHA-256	Last re-fetch
2026-07-14 00:16Z	https://labs.scale.com/leaderboard/visual_language_understanding	cc85fb1245ea…	2026-07-14 00:16Z
2026-07-14 00:16Z	https://labs.scale.com/leaderboard/multichallenge	727c5453bd31…	2026-07-14 00:16Z
2026-07-14 00:16Z	https://labs.scale.com/leaderboard/humanitys_last_exam	397f2477b7a8…	2026-07-14 00:16Z
2026-07-14 00:09Z	https://labs.scale.com/leaderboard/visual_language_understanding	b47973c7f555…	2026-07-14 00:09Z
2026-07-14 00:09Z	https://labs.scale.com/leaderboard/mask	9c1d5f2ab64a…	2026-07-14 00:16Z

Snapshots are immutable raw payloads — every published number traces back to one. Re-fetching an identical payload bumps the re-fetch time instead of storing a duplicate. Scores from this source appear on benchmark profiles and model pages with this source linked.