mlsanityData to 7 Oct 2026

MuonRec: Shifting the Optimizer Paradigm Beyond Adam in Scalable Generative Recommendation

arXiv 2603.00416 ↗First posted 28 Feb 2026cs.IR cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Recommender systems (RecSys) are increasingly emphasizing scaling, leveraging larger architectures and more interaction data to improve personalization. Yet, despite the optimizer's pivotal role in training, modern RecSys pipelines almost universally default to Adam/AdamW, with limited scrutiny of whether these choices are truly optimal for recommendation. In this work, we revisit optimizer design for scalable recommendation and introduce MuonRec, the first framework that brings the recently proposed Muon optimizer to RecSys training. Muon performs orthogonalized momentum updates for 2D weight matrices via Newton-Schulz iteration, promoting diverse update directions and improving optimization efficiency. We develop an open-source training recipe for recommendation models and evaluate it across both traditional sequential recommenders and modern generative recommenders. Extensive experiments demonstrate that MuonRec reduces converged training steps by an average of 32.4% while simultaneously improving final ranking quality. Specifically, MuonRec yields consistent relative gains in NDCG@10, averaging 12.6% across all settings, with particularly pronounced improvements in generative recommendation models. These results consistently outperform strong Adam/AdamW baselines, positioning Muon as a promising new optimizer standard for RecSys training. Our code is available.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

19 of 37 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2018Self-Attentive Sequential Recommendationcited by 1,169
  5. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  6. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  7. 2025Muon is Scalable for LLM Trainingcited by 381
  8. 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 213
  9. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 167
  10. 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 76
  11. 2025Practical Efficiency of Muon for Pretrainingcited by 74
  12. 2025NorMuon: Making Muon more efficient and scalablecited by 74
7 more
  1. 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 72
  2. 2024HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modelingcited by 63
  3. 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenderscited by 41
  4. 2023ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Predictioncited by 27
  5. 2024Lifelong Personalized Low-Rank Adaptation of Large Language Models for Recommendationcited by 16
  6. 2025MiniOneRec: An Open-Source Framework for Scaling Generative Recommendationcited by 16
  7. 2022Systematic Review of Newton-Schulz Iterations with Unified Factorizations : Integration in the Richardson Method and Application to Robust Failure Detection in Electrical Networkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.