Development

Scaling laws are derived from the statistics of language itself

development2026-02-19

Claim

Researchers predicted data-limited language model scaling laws from first principles using simple statistical properties of natural language.

Reporting date: (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

The curve everyone has been extrapolating was a property of the corpus all along.

Knowledge graphopen in browser →

Reported in
Evidence for
Supersedes
Referenced by

Cite or correct this record

Suggest a correction — opens a GitHub draft for you to review and submit.