Post #777 218 Nov 21, 2023, 23:32 UTC A chance of training on huge piles of retail GPUs and not just on the superclusters?https://huggingface.co/papers/2311.08105 huggingface.co Paper page - DiLoCo: Distributed Low-Communication Training of Language Models Join the discussion on this paper page ❤ 2