TGViewer
Axis of Ordinary Axis of Ordinary @axisofordinary · 3.84K subscribers
Post #9478 788
Our initial evaluation suggested that GPT-6-Astra's score was in the late eighties followed closely by Opus 5.5

But, as we started to investigate the mistakes that the models might have made, the models, especially Astra, insisted that they were right and that it was the expert-supplied answers that were erroneous. When we went back to the experts it turned out, in multiple instances, that that the experts found some subtle errors buried deep inside their calculations. As they revised their answers, Astra's score started to inch up and it finally ended up with 98% (49/50).


Also:

I don't know of any individual who can solve any significant fraction of our final collection of problems without AI assistance. For instance, I can solve the problems I contributed myself and understand a few others. Most problems don't even make sense to me.


Paper: https://arxiv.org/abs/2610.16733
Quote from an author summary: https://www.facebook.com/suvrat.raju/posts/pfbid0v6GWqNBXbdiQz1HEuTdYtfeio85nww5D1kU2unqkgUa8WtASeYyHePm91bZZt6YJl
  • ❤ 2
  • 🔥 2
  • 🤩 1
  • 🤡 1
More from @axisofordinary
  1. Oct 16, 2026More links: 1. Claude traces the origins of NIST’s elliptic curves. A cryptographic detect…
  2. Oct 16, 2026“Do you think you are being treated as a scapegoat for his own problems?” Zelensky:
  3. Oct 16, 2026Sergey Brin says by the time people see Gemini 4 Argon, Google is internally already using…
  4. Oct 16, 2026Did you know that Ukraine is on its last legs?
  5. Oct 16, 2026GLM-5.3 sometimes reasons (unprompted) about how its current actions could become training…
  6. Oct 16, 2026Revolutionary hypothesis from David Reich, one of the great scientists of our age: modern…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →