TGViewer
NVIDIA NVIDIA @nvidia · 6.93K subscribers
Post #2398 585
Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron

https://developer.nvidia.com/blog/advancing-emerging-optimizers-for-accelerated-llm-training-with-nvidia-megatron/
NVIDIA Technical Blog Advancing Emerging Optimizers for Accelerated LLM Training with NVIDIA Megatron Higher-order optimization algorithms such as Shampoo have been effectively applied in neural network training for at least a decade. These methods have achieved significant success more recently when…
Open in Telegram All posts from @nvidia
More from @nvidia
  1. Oct 3, 2026NVIDIA DGX Spark 64GB Gives Developers More Ways to Build and Scale Local AI https://blogs…
  2. Oct 1, 2026How NVIDIA GPUs Help Accelerate OpenAI’s GPT-6 Astra Ultrafast https://blogs.nvidia.com/bl…
  3. Oct 1, 2026Build Applications on NVIDIA BlueField Faster with NVIDIA DOCA Agent Skills https://develo…
  4. Oct 1, 2026Build Local AI Apps with C++ and NVIDIA TensorRT RTX Samples https://developer.nvidia.com/…
  5. Oct 1, 2026Fall Into 25 New Games on GeForce NOW This October https://blogs.nvidia.com/blog/geforce-n…
  6. Oct 1, 2026Productive, Durable, Fungible: How NVIDIA AI Factories Maximize Return on Investment https…
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →