TGViewer
🚨 AI News | TestingCatalog 🚨 AI News | TestingCatalog @testingcatalog · 7.79K subscribers
Post #8023 968
🚨 AI News | TestingCatalog Scale Labs debuts new Refactoring Leaderboard Scale Labs’ SWE Atlas Refactoring Leaderboard tests whether AI coding agents can restructure real codebases without changing behavior. Opus 4.7 leads, but results show reliability, cleanup, and repeatability still…
Scale AI published SWE Atlas Refactoring Leaderboard, a new benchmark that evaluates agent capabilities of restructuring the code.

> It requires agents to produce twice as much lines of code than SWE Bench Pro.

> Claude Code with Opus 4.7 tops the leaderboard followed by Codex with GPT-5.5, GPT-5.4 and GPT-5.3.

> Refactoring is quite an important task for LLMs to handle as it often boils down to a quite boring engineering work.
  • ā¤ 4
  • šŸ‘ 3
More from @testingcatalog
  1. Oct 15, 2026NVIDIA šŸ”„: A new model is set to arrive next week, possibly at the upcoming NVIDIA GTC eve…
  2. Oct 15, 2026Post #9650
  3. Oct 14, 2026Mistral AI ā¤ļø New Material New Material is joining Mistral to help build its frontier solu…
  4. Oct 14, 2026Claude Managed Agents, the Messages API, and the Claude SDK now support OpenTelemetry trac…
  5. Oct 14, 2026Inworld launched Inworld Inference, an LLM inference API built for consumer AI apps, servi…
  6. Oct 14, 2026ANTHROPIC šŸ”„: Claude Code Desktop now has a new sessions hub, live session statuses on the…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →