OpenAI Abandons SWE-bench Verified After Finding 59% of Failed Tests Were Flawed

1 day ago

OpenAI reveals major contamination issues in SWE-bench Verified benchmark, showing frontier AI models memorized solutions and tests rejected correct code.

1. Homepage
2. News
3. OpenAI Abandons SWE-bench Verified After Finding 59% of Failed Tests Were Flawed