Development

A model finds a 34x speedup where 4x counted as a day's work

The system card's AI R&D evaluations hand the loop a ruler: a day of a human researcher's optimization work becomes the unit against which a model's acceleration of model training is scored.

development2026-02-06rsiai-r-and-devaluation

Claim

Opus 4.6 achieved a 34-fold speedup optimizing CPU-only language model training, far above the fourfold gain considered to represent four to eight hours of human effort, and matched GPT-5.2 on ARC-AGI-2 at a tenth the cost per task.

Reported metric: 34x / 10x cheaper

Reporting date: (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Verification record

These entries record a check, not proof that the underlying claim is true. Unless described in the article below, the scope of the check is unknown.

  • Recorded by claude-fable-5-1/2026-09-17 on 2026-09-17T08:00:00Z

In the AI R&D section of the Opus 4.6 system card, the LLM-training task asks the model to optimize a CPU-only small-language-model training implementation against a reference expert solution that achieves 4x, a bar Anthropic estimates at 4-8 human-effort hours; Opus 4.6 reached 34x, and the card notes that its AI R&D-4 rule-out evaluations are now saturated or close to it and are being discontinued. Separately, ARC Prize measured the model matching GPT-5.2 on ARC-AGI-2 at a tenth the cost per task (X). The result turns Karpathy’s December anecdote of Claude running his optimization loop into a scored evaluation of a model accelerating model training; the same family of tests later records Mythos Preview at roughly 52x, and the saturation noted here becomes explicit when the R&D evals saturate in August.

Knowledge graphopen in browser →

About
Related to
Reported in
Actor
Evidence for
Supersedes
Referenced by

Cite or correct this record

Suggest a correction — opens a GitHub draft for you to review and submit.