AIHacker Newsabout 1 hour ago
MirrorCode benchmark tests AI on full programs
1 min read
MirrorCode, a benchmark co-developed with METR, tests AI models on reimplementing entire programs end-to-end without source code. Claude Opus 4.7 reimplemented gotree, a 16,000-line Go bioinformatics toolkit, in 14 hours for $251, a task estimated to take humans 2-17 weeks.
Level
Hype check
Tap to vote and see what everyone thinks.
Summary by ByteBrief
