📰 Paper reading club: mixture of experts doing science

We come together to discuss advances in computer science, ground them down to applications, and see where to the wind is blowing. Read the papers at your own time and come discuss them with us. The talks will be given in English, discussion in En/Ru.

1. Empirical support and criticism of ACT, part 2

ACT is a therapy identified by the American Psychological Association as an empirically supported treatment for depression, anxiety, and OCD.

But how much empirically supported? We examine classical results and recent critiques. Please check part 1 recording if you weren't there.

2. Mixtral Of Experts

Making your transformer smarter without increasing the number of (active) parameters with Sparse MoE.

Prerequisites: DL101. We may recall transformers extremely briefly.

⏱ 12:00-14:30 Saturday, 27 January
📍 F0RTHSP4CE, Khorava St, 18
💰 free/donation
🗣 @cad215, @artempt239 (lang: 🇬🇧)
👮 @cad215
💬 event chat
🎥 recordings