TGViewer
Linkstream Linkstream @linkstream · 169 subscribers
Post #862 238
i wonder when we'll get to training over binary ops (and if this is fundamentally possible) bc 1-bit as shown in the article is more like dictionary training, the matrices still contain real numbers
https://arxiv.org/abs/2502.05003
arXiv.org QuEST: Stable Training of LLMs with 1-Bit Weights and Activations One approach to reducing the massive costs of large language models (LLMs) is the use of quantized or sparse representations for training or deployment. While post-training compression methods are...
Open in Telegram All posts from @linkstream
More from @linkstream
  1. Sep 30, 2026i started doing exactly this (models editing its own context) as a natural extension of sa…
  2. Sep 28, 2026cursed font factory https://bastardica.mitpit.com/
  3. Sep 25, 2026um, ahem, AlphaZero for text. Training language models without language. Loosely, natural…
  4. Sep 23, 2026umm ahem if you don't try to rein in new opus(5.5) you get one more qualitative step in ca…
  5. Sep 23, 2026nice https://fixupx.com/eyalsela/status/2102373749110587443?s=46
  6. Sep 21, 2026great writing, clear & thoughtful tldr: computers used to be math, and now they're about p…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →