Transformers working for RL! Two simple modifications: move layer-norm and add gating creates GTrXL: an incredibly stable and effective architecture for integrating experience through time in RL.
https://arxiv.org/abs/1910.06764
❇️ @AI_Python
✴️ @AI_Python_EN
Post #1990
77
Forwarded from DLeX: AI Python (Farzad)
