Loop engineering has emerged as a new skill for AI engineers.
But there is very little research measuring how effective it is.
The best results on full tasks in a new benchmark is ~25%.
LoopArena from AMAP evaluates the outer loop rather than the coding agent.
Post #4447
618