Towards Greater Leverage: Scaling Laws for Efficient MoE

paper
Ant Group
MoE scaling laws paper exploring efficient mixture-of-experts language models.
Paper (arXiv)

Paper

arXiv HTML
moescaling