"LLaVA-DyMoE. This framework introduces Token Assignment Guidance (TAG) that analyzes routing score distributions and steers ambiguous tokens toward frozen old experts while reserving new experts for genuinely novel patterns. Complementary Routing Score Regularization enforces clean separation between expert groups and encourages specialization.
The approach is both precise and practical. It achieves over 7% higher mean final accuracy and reduces forgetting by 12% compared to strong baselines, without sacrificing efficiency.
Accepted at CVPR 2026.
Paper: https://lnkd.in/equUfpgf
Project page: https://lnkd.in/evj25GMS
Code: https://lnkd.in/edMttMYt"
https://www.linkedin.com/mwlite/feed/#:~:text=LLaVA%2DDyMoE.%20This,lnkd.in/edMttMYt
Post #2817
504
Forwarded from E.A.
- 💩 2
- ❤ 1