Google researchers built an AI that reads a problem, forms hypotheses, runs experiments, writes the paper, and simulates its own peer review.

It's called ScientistTwo.

They gave it 107 problems from papers accepted at ICLR, ICML, and NeurIPS, and it beat the published human result on 86 of them.

The average gain over the human method was 25.2%.
The average paper took about 2.5 days and cost about $3,765 in model and compute costs.

Nine human reviewers compared 33 of these AI papers with accepted human papers. Their overall verdict was a tie.