Development

Karpathy trains a GPT-2 grade model for $73

development2026-02-03

Claim

Andrej Karpathy trained a GPT-2 grade model for $73, signalling hyperdeflation in the cost of capability.

Reported metric: $73

Reporting date: 2026-02-03 (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Welcome to February 3, 2026 (theinnermostloop.substack.com)

Knowledge graphopen in browser →

Reported in

Welcome to February 3, 2026

Actor

Andrej Karpathy

Evidence for

The price of reasoning is deflating

Supersedes

Models distill to 4-bit with almost no loss

Referenced by

Cite or correct this record

Citation formatCitation text

Karpathy trains a GPT-2 grade model for $73
Innermost Loop KB — secondary record
Reporting date: 2026-02-03
KB permalink: https://nicholsn.github.io/innermost-loop-kb/developments/2026-02-03-gpt2-grade-model-for-73-dollars
Claim: Andrej Karpathy trained a GPT-2 grade model for $73, signalling hyperdeflation in the cost of capability.
Attributed sources:
- Welcome to February 3, 2026 — https://theinnermostloop.substack.com/p/welcome-to-february-3-2026
This citation does not imply independent verification of linked-source claims.

Suggest a correction — opens a GitHub draft for you to review and submit.