DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models Preprint

Aghdam, Maryam Akhavan, Jin, Hongpeng, Wu, Yanzhao. (2024). DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models .

cited authors

  • Aghdam, Maryam Akhavan; Jin, Hongpeng; Wu, Yanzhao

authors

publication date

  • September 10, 2024

webpage

keywords

  • cs.LG