mlsanityData to 7 Oct 2026

Multi-scale Mixture of World Models for Embodied Agents in Evolving Environments

arXiv 2607.00457 ↗First posted 1 Jul 2026cs.AIcited by 0

On the map: World models → World models for language agents

also in 1 more
Abstract (arXiv)

Embodied agents operating in the real world require multi-scale reasoning and knowledge adaptation as conditions change. We identify two challenges in applying Mixture of Experts (MoE) to this setting: routing lacks an explicit notion of scale, preventing targeted updates at specific scales, and a uniform update policy cannot accommodate the different rates at which knowledge at each scale becomes outdated. We present MuSix, a framework that addresses both challenges through scale-aware world model mixture and evolution. A two-stage routing mechanism grounds scale selection in experiential distance, a measure of situational novelty inspired by Construal Level Theory: a meta-router first maps this quantity to a weight over continuous scale space, then per-scale base routers select world models within the identified scale. For adaptation, scale-dependent forgetting rates allow low-scale knowledge to refresh rapidly while high-scale abstractions persist, and gated inter-scale transfer maintains coherence across the hierarchy. Experiments on EmbodiedBench and HAZARD show that MuSix improves over state-of-the-art baselines on multi-scale reasoning and dynamic adaptation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 19 of its 25 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

19 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Inner Monologue: Embodied Reasoning through Planning with Language Models12 Jul

Other references · 18

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  4. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  5. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
  6. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
  7. 2024Titans: Learning to Memorize at Test Timecited by 303
  8. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
  9. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  10. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
  11. 2023Scaling Vision-Language Models with Sparse Mixture of Expertscited by 88
  12. 2022Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Expertscited by 50
6 more
  1. 2024Theory on Mixture-of-Experts in Continual Learningcited by 50
  2. 2023SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledgecited by 49
  3. 2024HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environmentscited by 32
  4. 2024Mixture of Experts in a Mixture of RL settingscited by 21
  5. 2024Multi-Modal Grounded Planning and Efficient Replanning For Learning Embodied Agents with A Few Examplescited by 9
  6. 2024Reconciling Spatial and Temporal Abstractions for Goal Representationcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Test-Time Mixture of World Models for Embodied Agents in Dynamic Environments
  2. 2025World Model Implanting for Test-time Adaptation of Embodied Agents
  3. 2026ParallelWorld: Test-Time Scaling for Embodied Reasoning
  4. 2025World-in-World: World Models in a Closed-Loop World
  5. 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents
  6. 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
  7. 2025Align While Search: Belief-Guided Exploratory Inference for World-Grounded Embodied Agents
  8. 2026From Assumptions to Actions: Turning LLM Reasoning into Uncertainty-Aware Planning for Embodied Agents