Development

Autoformalization gets benchmarked against qualifying exams

development2026-03-20

Claim

Math Inc. launched FormalQualBench to benchmark autoformalization against graduate qualifying exams in Lean.

Reporting date: 2026-03-20 (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Welcome to March 20, 2026 (theinnermostloop.substack.com)

Knowledge graphopen in browser →

Reported in

Welcome to March 20, 2026

Actor

Math, Inc.

Evidence for

Supersedes

DeepMind decomposes general intelligence into ten faculties

Referenced by

Cite or correct this record

Citation formatCitation text

Autoformalization gets benchmarked against qualifying exams
Innermost Loop KB — secondary record
Reporting date: 2026-03-20
KB permalink: https://nicholsn.github.io/innermost-loop-kb/developments/2026-03-20-formalqualbench
Claim: Math Inc. launched FormalQualBench to benchmark autoformalization against graduate qualifying exams in Lean.
Attributed sources:
- Welcome to March 20, 2026 — https://theinnermostloop.substack.com/p/welcome-to-march-20-2026
This citation does not imply independent verification of linked-source claims.

Suggest a correction — opens a GitHub draft for you to review and submit.