Why we no longer evaluate SWE-bench Verified

Ignore

OpenAI Blog · 2026-02-23 11:00 UTC

Not analyzed yet

Eligible for automatic cleanup in 3 day(s) unless marked Must Read.

Content

SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.

Open original article ↗

Your feedback

Keep this article

Protects it from automatic cleanup.