mlsanityData to 7 Oct 2026

MoE in reinforcement learning and robotics

151 papers2 this weekMedium confidence in this grouping: mostly one topic, with blurry edgesMedium confidence in this grouping: mostly one topic, with blurry edges · About

Keywords: reinforcement, reinforcement learning, training, policy, driving

Key facts. MoE in reinforcement learning and robotics: 151 papers on arXiv since 2018 (data through 7 Oct 2026). 9 of its 151 mapped papers (6%) cite “Mixtures of Experts Unlock Parameter Scaling for Deep RL” (2024, arXiv 2402.08609). 8 of its 151 mapped papers (5%) cite “DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Driving” (2025, arXiv 2505.16278). 2 new papers 17 Sep–7 Oct.

What’s new

17 Sep – 7 Oct 2026

2 new since 17 Sep

  1. TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models also fits: MoE large language models
  2. Structuring MoE Expert Selection for Agentic Reinforcement Learning

Foundations

Most cited by papers here

  1. Mixtures of Experts Unlock Parameter Scaling for Deep RL2024cited by 9 here
  2. DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Driving2025cited by 8 here
  3. MENTOR: Mixture-of-Experts Network with Task-Oriented Perturbation for Visual Reinforcement Learning2024cited by 7 here
  4. Group Sequence Policy Optimization2025cited by 6 here
  5. Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routers2025cited by 6 here

Lineage

The papers this direction builds on, oldest first.

Each paper on the line cites the one before.

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 42 here
  2. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 31 here
  3. 2021Scaling Vision with Sparse Mixture of Expertscited by 17 here
  4. 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 9 here
  5. 2022Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Expertscited by 7 here
  6. 2023From Sparse to Soft Mixtures of Expertscited by 7 here
  7. 2024A Survey on Mixture of Experts in Large Language Modelscited by 5 here
  8. 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 8 here
16 more it builds on, not in this chain
  1. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 41 here
  2. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 13 here
  3. 2022Mixture-of-Experts with Expert Choice Routingcited by 10 here
  4. 2024Mixtral of Expertscited by 15 here
  5. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 19 here
  6. 2024Mixtures of Experts Unlock Parameter Scaling for Deep RLcited by 9 here
  7. 2024LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-trainingcited by 5 here
  8. 2024Mixture of Experts in a Mixture of RL settingscited by 5 here
  9. 2024MENTOR: Mixture-of-Experts Network with Task-Oriented Perturbation for Visual Reinforcement Learningcited by 7 here
  10. 2024Qwen2.5 Technical Reportcited by 5 here
  11. 2024DeepSeek-V3 Technical Reportcited by 15 here
  12. 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applicationscited by 5 here
  13. 2025Qwen3 Technical Reportcited by 14 here
  14. 2025Group Sequence Policy Optimizationcited by 6 here
  15. 2025Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routerscited by 6 here
  16. 2025Qwen3-VL Technical Reportcited by 6 here

The 24 most cited of 200.

Browse

30 of 151, ranked 6–35

  1. 6Mixture of Experts in a Mixture of RL settings20245
  2. 7Kimi K2: Open Agentic Intelligence20254
  3. 8Probabilistic Mixture-of-Experts for Efficient Deep Reinforcement Learning20214
  4. 9MoE-Loco: Mixture of Experts for Multitask Locomotion20253
  5. 10MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention20253
  6. 11GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models20253
  7. 12ReLibra: Routing-Replay-Guided Load Balancing for MoE Training in Reinforcement Learning20262
  8. 13Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence20262
  9. 14ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation20252
  10. 15Mastering Massive Multi-Task Reinforcement Learning via Mixture-of-Expert Decision Transformer20252
All 30
  1. 16GEMINUS: Dual-aware Global and Scene-Adaptive Mixture-of-Experts for End-to-End Autonomous Driving20252
  2. 17Towards Stable and Effective Reinforcement Learning for Mixture-of-Experts20252
  3. 18Stabilizing Reinforcement Learning with LLMs: Formulation and Practices20252
  4. 19Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning20252
  5. 20Acquiring Diverse Skills using Curriculum Reinforcement Learning with Mixture of Experts20242
  6. 21GeRM: A Generalist Robotic Model with Mixture-of-experts for Quadruped Robot20242
  7. 22MiniDrive: More Efficient Vision-Language Models with Multi-Level 2D Features as Text Tokens for Autonomous Driving20242
  8. 23MiMo-V2-Flash Technical Report20261
  9. 24Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillation20261
  10. 25MoE-GRPO: Optimizing Mixture-of-Experts via Reinforcement Learning in Vision-Language Models20261
  11. 26Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning20261
  12. 27Harnessing Routing Foresight for Micro-step-level MoE load balancing in RL Post-training20261
  13. 28InsightDrive: Insight Scene Representation for End-to-End Autonomous Driving20251
  14. 29Mixture-of-Experts Meets In-Context Reinforcement Learning20251
  15. 30Ring-lite: Scalable Reasoning via C3PO-Stabilized Reinforcement Learning for LLMs20251
  16. 31MoSE: Skill-by-Skill Mixture-of-Experts Learning for Embodied Autonomous Machines20251
  17. 32CBDES MoE: Hierarchically Decoupled Mixture-of-Experts for Functional Modules in Autonomous Driving20251
  18. 33A Knowledge-Driven Diffusion Policy for End-to-End Autonomous Driving Based on Expert Routing20251
  19. 34LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE20251
  20. 35Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning20241