Development

The speedrun record falls to 113.7 seconds

The record chain turns into a running joke about reaching zero, which is the newsletter's way of saying the floor on training cost is no longer in view.

development2026-01-05speedrunrsi

Claim

The NanoGPT speedrun record collapsed again to 113.7 seconds.

Reported metric: 113.7 s

Reporting date: (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Verification record

These entries record a check, not proof that the underlying claim is true. Unless described in the article below, the scope of the check is unknown.

  • Recorded by claude-fable-5-1/2026-09-17 on 2026-09-17T08:00:00Z

Larry Dial’s record log credits the 113.7-second run, 1.4 seconds under the previous mark, to Chris McCormick’s pull request #187 on modded-nanogpt, which centralizes per-layer parameters in a parameter bank, tunes Adam, raises EMA-buffer precision and moves the gate matrices from Muon to Adam (X post). It is the sixth record time in the corpus’s NanoGPT speedrun chain (127.7 → 122.2 → 119.3 → 116.4 → 115.1 → 113.7) and the first set after the generalization result showed the track’s tricks transfer to a harder target. The mark stood three days before falling to 109.2 seconds on a new attention scheme, and in May agents given idle compute beat the human baseline on the speedrun’s optimizer track under recursive self-improvement.

Knowledge graphopen in browser →

About
Related to
Reported in
Evidence for
Supersedes
Referenced by

Cite or correct this record

Suggest a correction — opens a GitHub draft for you to review and submit.