Development

A month-old benchmark is saturated and a scoreboard is revised mid-game

development2026-09-07

Claim

A month-old binary reverse-engineering test is already saturated and Astra hit 88% on logical induction against 33%, while OpenAI quietly revised launch figures to briefly halve its hallucination rate and lift an ARC-AGI-3 score to 99.99% that the foundation only matched with a heavy harness against 63% on the standard one, which Stanford called benchmaxxing.

Reported metric: 99.99% vs 63%

Reporting date: (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Knowledge graphopen in browser →

Reported in
Actor
Evidence for
Supersedes
Referenced by

Cite or correct this record

Suggest a correction — opens a GitHub draft for you to review and submit.