MuonGS: Pretraining LLMs with Relaxed Weight-Norm Control

MuonGS: Pretraining LLMs with Relaxed Weight-Norm Control

来源：arXiv · arxiv.org