Andrej Karpathy joined Anthropic to lead pre-training — essentially training Claude to accelerate Claude. The corpus has recorded recursive self-improvement as a claim, a probability and a present phenomenon. Now it has a job title.
Google is processing 3.2 quadrillion tokens a month, up from 9.7 trillion two years ago.