Back to papers
September 8, 2026cs.LGcs.AIcs.CL

Hyperparameter Scaling Laws Across MoE Sparsity

Changxin Tian, Kunlong Chen, Jia Liu, Ziqi Liu, Zhiqiang Zhang, Jun Zhou
Read on arXivDownload PDF
Categories

cs.LG, cs.AI, cs.CL

Hyperparameter Scaling Laws Across MoE | One9Founders