Jürgen Schmidhuber argues that the one constant across training and rollouts is the model itself, so a mind should learn to model itself in order to better predict its next token. Self-knowledge as a scaling objective.
Meanwhile a hobbyist reverse-engineered a commercial router into a ~10,000-parameter conductor that beat every model on MMLU by handing each question to the right specialist.