🤖 The cost of training AI:
Transformer (Google): $930
BERT-Large (Google): $3,288
RoBERTa Large (Meta): $160k
LaMDA (Google): $1.3M
Llama 2 70B (Meta): $3.9M
GPT-3 175B (davinci) (OpenAI): $4.3M
Megatron-Turing NLG 530B (Microsoft / NVIDIA): $6.4M
PaLM (540B) (Google): $12.4M
GPT-4 (OpenAI): $78.3M
Gemini Ultra (Google): $191.4M
According to The AI Index Report
Post #1797
7.29K
- 👍 8
- ❤ 1