----------------🎯 AI===================DeepSeek V4 Pro 0813 topped a benchmark of 10 AI models for vulnerability discove...

----------------🎯 AI===================DeepSeek V4 Pro 0813 topped a benchmark of 10 AI models for vulnerability discovery, finding 28 of 32 bugs across three pooled runs. The benchmark burned 11.7 billion tokens testing each model three times on 32 freshly disclosed CVEs from real-world repositories.MethodologyThe researchers selected 32 vulnerabilities from recently disclosed CVEs to reduce the chance that models had already seen the vulnerability, write-up, or patch during training. The goal was to test vulnerability reasoning rather than memorization. Each model ran the complete 32-case set three times (96 runs total). The harness was a bounded version of their AI Code Analysis pipeline. The model under test replaced the primary stage responsible for code exploration and reasoning, with a 30-turn maximum and no internet access.Key Findings• DeepSeek V4 Pro 0813 found the most vulnerabilities: 28 of 32 across three pooled runs. Single-pass recall was 17.• Three DeepSeek Pro runs cos...

Read Original

Related