phi-1: with datasets of higher quality, model with 1.3B parameters and 7B tokens can be quite competitive to gpt4 and other 100x larger models on coding tasks
https://arxiv.org/abs/2306.11644
Post #750
254
- Sep 30, 2026i started doing exactly this (models editing its own context) as a natural extension of sa…
- Sep 28, 2026cursed font factory https://bastardica.mitpit.com/
- Sep 25, 2026um, ahem, AlphaZero for text. Training language models without language. Loosely, natural…
- Sep 23, 2026umm ahem if you don't try to rein in new opus(5.5) you get one more qualitative step in ca…
- Sep 23, 2026nice https://fixupx.com/eyalsela/status/2102373749110587443?s=46
- Sep 21, 2026great writing, clear & thoughtful tldr: computers used to be math, and now they're about p…