Development

Two API settings triple a benchmark score on six times fewer tokens

development2026-07-30

Claim

Two API settings roughly tripled Sol's ARC-AGI-3 score on six times fewer tokens, with ARC Prize agreeing the result is real while defending its no-harness verified testing and promising to fold server-side state into fair comparisons.

Reported metric: 3x on 6x fewer tokens

Reporting date: 2026-07-30 (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Welcome to July 30, 2026 (theinnermostloop.substack.com)

Knowledge graphopen in browser →

Reported in

Welcome to July 30, 2026

Actor

Evidence for

Supersedes

A model autonomously rewrites the kernels behind an 80% price cut

Referenced by

Cite or correct this record

Citation formatCitation text

Two API settings triple a benchmark score on six times fewer tokens
Innermost Loop KB — secondary record
Reporting date: 2026-07-30
KB permalink: https://nicholsn.github.io/innermost-loop-kb/developments/2026-07-30-two-api-settings-triple-a-score
Claim: Two API settings roughly tripled Sol's ARC-AGI-3 score on six times fewer tokens, with ARC Prize agreeing the result is real while defending its no-harness verified testing and promising to fold server-side state into fair comparisons.
Attributed sources:
- Welcome to July 30, 2026 — https://theinnermostloop.substack.com/p/welcome-to-july-30-2026
This citation does not imply independent verification of linked-source claims.

Suggest a correction — opens a GitHub draft for you to review and submit.