Databricks 开放了基于 Alpaca 的 Dolly，单个集群 (single-node cluster with node type having 8 A100 GPUs) 三小时可以完成训练
https://github.com/databrickslabs/dolly
Post #109
336
DPS Build 斯坦福开源了一个自行搭建 LLaMA 的架构指南 Alpaca，有人算了算了，大概花 $600 就能训练出一个表现类似 GPT3.5 的大语言模型。 https://crfm.stanford.edu/alpaca/ https://twitter.com/yanndubs/status/1635339256532205568GitHub GitHub - databrickslabs/dolly: Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform - databrickslabs/dolly