It Runs, So It Ships: The Last Secure Code Benchmark and the 25% Problem
A new benchmark published on October 14 tested six frontier coding agents on 450 tasks built from 150 real vulnerabilities. The strongest of them produced code that was both functional and secure just 25.1% of the time, while every agent cleared 73% or more on functionality alone. The gap between code that works and code that is safe has become a measurable pipeline problem.