AIThe New Stack26 minutes ago
New benchmark tests AI agents on large-scale refactoring
6 min read
AI coding agents achieve only a 41.2% resolve rate on a new refactoring benchmark from Shanghai Jiao Tong University, Peking University, and Douyin Group. The benchmark addresses gaps in existing tests, where nearly 60% of unsolved SWE-bench Verified instances contain flawed tests.
Level
Hype check
Tap to vote and see what everyone thinks.
Summary by ByteBrief
