I published the second part of my previous study for optimizing Deep Learning models, especially for NLP tasks. Here, I discovered 5 approaches, which can additionally reduce training and inference time by a factor of 1.5-2!

https://www.kaggle.com/code/vad13irt/optimization-approaches-for-transformers-part-2/notebook

Enjoy reading and using!