P-Zero Research's new TasteVal benchmark measures research taste: how well a model designs experiments and reads their results on eight real AI-development tasks, scored by how much compute it needs compared with human experts (the dashed 1x line).
Research taste is the skill that decides how quickly AI could start improving AI, and this curve is one reason Jack Clark now expects that in 2027 (wrote about that yesterday as well).
🄳🄾🄾🄼🄿🤖🅂🅃🄸🄽🄶
Post #269104
390
