Scale AI published SWE Atlas Refactoring Leaderboard, a new benchmark that evaluates agent capabilities of restructuring the code.
> It requires agents to produce twice as much lines of code than SWE Bench Pro.
> Claude Code with Opus 4.7 tops the leaderboard followed by Codex with GPT-5.5, GPT-5.4 and GPT-5.3.
> Refactoring is quite an important task for LLMs to handle as it often boils down to a quite boring engineering work.
Post #8023
968
šØ AI News | TestingCatalog Scale Labs debuts new Refactoring Leaderboard Scale Labsā SWE Atlas Refactoring Leaderboard tests whether AI coding agents can restructure real codebases without changing behavior. Opus 4.7 leads, but results show reliability, cleanup, and repeatability stillā¦

- ⤠4
- š 3