OpenAI recently published GPT-3, the largest language model ever trained. GPT-3 has 175 billion parameters and would require 355 years and $4,600,000 to train - even with the lowest priced GPU cloud on the market
https://lambdalabs.com/blog/demystifying-gpt-3/#training-the-model
Post #151
267
