Post #620 263 Aug 16, 2019, 20:10 UTC hey look, you can train GPT-2 in under an hour** using about $40M worth of hardware. still impressive, thoughhttps://devblogs.nvidia.com/training-bert-with-gpus/ NVIDIA Technical Blog NVIDIA Clocks World’s Fastest BERT Training Time and Largest Transformer Based Model, Paving Path For Advanced Conversational AI NVIDIA DGX SuperPOD trains BERT-Large in just 47 minutes, and trains GPT-2 8B, the largest Transformer Network Ever with 8.3Bn parameters Conversational AI is an essential building block of human…