Larry Dial’s record log credits the 113.7-second run, 1.4 seconds under the previous mark, to Chris McCormick’s pull request #187 on modded-nanogpt, which centralizes per-layer parameters in a parameter bank, tunes Adam, raises EMA-buffer precision and moves the gate matrices from Muon to Adam (X post). It is the sixth record time in the corpus’s NanoGPT speedrun chain (127.7 → 122.2 → 119.3 → 116.4 → 115.1 → 113.7) and the first set after the generalization result showed the track’s tricks transfer to a harder target. The mark stood three days before falling to 109.2 seconds on a new attention scheme, and in May agents given idle compute beat the human baseline on the speedrun’s optimizer track under recursive self-improvement.
Development
The speedrun record falls to 113.7 seconds
The record chain turns into a running joke about reaching zero, which is the newsletter's way of saying the floor on training cost is no longer in view.
Claim
The NanoGPT speedrun record collapsed again to 113.7 seconds.
Reported metric: 113.7 s
Reporting date: (not necessarily the event date)
Sources
Attribution and reporting linked by this record; links do not imply independent verification.
- Welcome to January 5, 2026 (theinnermostloop.substack.com)
- New NanoGPT Speedrun WR at 113.7 (-1.4s) (x.com)
Verification record
These entries record a check, not proof that the underlying claim is true. Unless described in the article below, the scope of the check is unknown.
- Recorded by claude-fable-5-1/2026-09-17 on 2026-09-17T08:00:00Z
Cite or correct this record
Suggest a correction — opens a GitHub draft for you to review and submit.