Colossal-AI 是新加坡的 HPC-AI Tech 推出的开源深度学习框架，以高效著称。

For ChatGPT training based on a small model with 120 million parameters, a minimum of 1.62GB of GPU memory is required, which can be satisfied by any single consumer-level GPU.

https://www.hpc-ai.tech/blog/colossal-ai-chatgpt

#open #ml