An Awesome Unified Framework of Online Learning Algorithms for Training Recurrent Neural Networks.

Authors here present a framework for compactly summarizing many recent results in efficient and/or biologically plausible online training of recurrent neural networks (RNN).

Their framework organizes algorithms according to several criteria:
(a) past vs. future facing,
(b) tensor structure,
(c) stochastic vs. deterministic, and
(d) closed form vs. numerical.

These axes reveal latent conceptual connections among several recent advances in online learning.

Paper: https://lnkd.in/dTcMbyK

✴️ @AI_Python_EN