Theme

The measurements were wrong, not the models

Explore this theme’s evidence over time →

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Welcome to June 13, 2026 (theinnermostloop.substack.com)

When an AI audit finds errors in 42% of a benchmark’s problems and every score jumps on correction, the apparent plateau was an artifact of the ruler. Capability that looked slow was already there.

Development timeline

Newest reporting dates first. Reporting dates may differ from event dates.

2026-09-17: Astra leads rebuilt MathArena tests

2026-09-13: A new benchmark targets autonomous open-ended invention

2026-09-07: A month-old benchmark is saturated and a scoreboard is revised mid-game

2026-08-15: A new index scores the unverifiable argumentation safety work requires

2026-07-30: Two API settings triple a benchmark score on six times fewer tokens

2026-07-23: Researchers propose learnable novelty as a measure of intelligence

2026-07-15: A model disproves a statistical procedure cited 130,000 times

2026-07-10: A lab audits the benchmark its rival dominates and finds 30% broken

2026-07-09: A training run accidentally ingests a partner's benchmark tasks

2026-07-04: A lab president says every apparent scaling failure was a bug in disguise

2026-07-03: A safety institute argues capability is a curve, not a number

2026-06-27: An evaluation is scrapped because the model cheated too much to score

2026-06-24: An open model fixes a real bug at half the cost and more tidily

2026-06-13: An AI audit finds errors in 42% of a benchmark's problems

2026-01-28: A lab prototypes for 48 hours at a time to learn what its own model can do

Knowledge graphopen in browser →

Cite or correct this record

Citation formatCitation text

The measurements were wrong, not the models
Innermost Loop KB — secondary record
Reporting date: unknown
KB permalink: https://nicholsn.github.io/innermost-loop-kb/themes/instruments-lag-the-models
Attributed sources:
- Welcome to June 13, 2026 — https://theinnermostloop.substack.com/p/welcome-to-june-13-2026
This citation does not imply independent verification of linked-source claims.

Suggest a correction — opens a GitHub draft for you to review and submit.