Development

A 10,000-parameter router beats every model by picking specialists

development2026-07-05

Claim

A hobbyist reverse-engineered Sakana's Fugu into tinyrouter, a roughly 10,000-parameter conductor that beat every individual model on MMLU by handing each question to the right specialist.

Reported metric: ~10k parameters

Reporting date: 2026-07-05 (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Welcome to July 5, 2026 (theinnermostloop.substack.com)

Knowledge graphopen in browser →

Reported in

Welcome to July 5, 2026

Actor

Sakana AI

Evidence for

Supersedes

A pioneer argues a model should learn to model itself

Referenced by

Cite or correct this record

Citation formatCitation text

A 10,000-parameter router beats every model by picking specialists
Innermost Loop KB — secondary record
Reporting date: 2026-07-05
KB permalink: https://nicholsn.github.io/innermost-loop-kb/developments/2026-07-05-a-ten-thousand-parameter-conductor-beats-every-model
Claim: A hobbyist reverse-engineered Sakana's Fugu into tinyrouter, a roughly 10,000-parameter conductor that beat every individual model on MMLU by handing each question to the right specialist.
Attributed sources:
- Welcome to July 5, 2026 — https://theinnermostloop.substack.com/p/welcome-to-july-5-2026
This citation does not imply independent verification of linked-source claims.

Suggest a correction — opens a GitHub draft for you to review and submit.