Post #8534
326
Small-Scale Experiments: Are We There Yet? https://arxiv.org/abs/2608.11859
arXiv.org Small-Scale Experiments: Are We There Yet? Scaling laws promised cost-effective experiments; six years later, they have yet to fully deliver. Instead, researchers have found them unreliable at small scales (starting at 4M parameters) and...