Development

A frontier model refuses every task on a cybersecurity benchmark

development2026-07-19

Claim

On a private cybersecurity benchmark, Kimi K3 emerged as the workhorse for hunting vulnerabilities at near-frontier recall for a fraction of the cost, GPT-5.6 Sol took the crown at seven times the price, GLM 5.2 undercut everyone, and Fable 5 refused 100% of the tasks, turning safety into a service outage.

Reported metric: 100% refusal

Reporting date: (not necessarily the event date)

Sources

Attribution and reporting linked by this record; links do not imply independent verification.

Knowledge graphopen in browser →

Reported in
Actor
Evidence for
Supersedes
Referenced by

Cite or correct this record

Suggest a correction — opens a GitHub draft for you to review and submit.