Day 3: GLU Variants Improve Transformer
🔗 https://arxiv.org/pdf/2002.05202
Additional Resources:
⦁ 📄 Math behind SwiGLU
⦁ 📄 Article: What is SwiGLU? - J. Carlos Roldán
🛠 @LLMEngineers
Post #62
1.55K
🎯 100 Days of Reading LLM Papers Challenge
Day 3: GLU Variants Improve Transformer
🔗 https://arxiv.org/pdf/2002.05202
🛠 @LLMEngineers
Day 3: GLU Variants Improve Transformer
🔗 https://arxiv.org/pdf/2002.05202
🛠 @LLMEngineers
- 👍 5
- 🤩 1