New AI programming benchmark tests code mergeability; 40% of attempts with Opus 5.5 still failed to pass.

Beating AI Express (Dongcha) reports: Artificial Analysis has launched the FrontierCode 1.1 programming benchmark, which primarily assesses whether AI-generated code meets the merge standards of open-source project maintainers. Claude Opus 5.5 took first place with a 52.2% overall score, though only 58% of its attempts passed all mandatory checks—meaning over 40% failed to meet requirements.

The benchmark was developed by Cognition in partnership with maintainers from 36 open-source projects, w

@tonmelonfest