TGViewer
Linkstream Linkstream @linkstream · 169 subscribers
Post #945 172
an impressive ELI5 and a long-awaited solution to reinforcement learning-caused mode collapse https://x.com/AntChen_/status/2019107535278784514?s=20
https://im-ant.github.io/mara
https://arxiv.org/abs/2510.20817
X (formerly Twitter) Anthony GX-Chen ✈️ ICLR 2026 (@AntChen_) on X RL causing diversity collapse in generative models (e.g. LLMs) is *not* a training failure. It’s what KL / entropy-regularized RL is provably *designed* to do. The good news: we have a simple, principled fix. Accepted to #ICLR2026 🧵🔽 [1/n]
Open in Telegram All posts from @linkstream
More from @linkstream
  1. Sep 30, 2026i started doing exactly this (models editing its own context) as a natural extension of sa…
  2. Sep 28, 2026cursed font factory https://bastardica.mitpit.com/
  3. Sep 25, 2026um, ahem, AlphaZero for text. Training language models without language. Loosely, natural…
  4. Sep 23, 2026umm ahem if you don't try to rein in new opus(5.5) you get one more qualitative step in ca…
  5. Sep 23, 2026nice https://fixupx.com/eyalsela/status/2102373749110587443?s=46
  6. Sep 21, 2026great writing, clear & thoughtful tldr: computers used to be math, and now they're about p…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →