mlsanityData to 14 Oct 2026

NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models

arXiv 2605.07794 ↗First posted 8 May 2026cs.ROcited by 7

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World Action Models (WAMs) are an emerging family of policies that tie robot action generation to future-observation modeling. In this work, we focus on the joint video--action modeling paradigm, where actions and imagined future observations are co-generated along a shared denoising or flow trajectory, so that perception, prediction, and control are coupled within one generative process. Existing WAMs typically realize this paradigm with a Mixture-of-Transformers (MoT), where video and action tokens interact through shared self-attention. This architecture can in principle assign a separate timestep tf to each predicted latent frame, yet current systems collapse this degree of freedom onto a single shared scalar t. Under the noise-as-masking view of Diffusion Forcing, this shared schedule imposes the unjustified prior that every predicted latent is equally reliable for action generation. We instead view the per-latent schedule as a learnable information-gating policy: by changing a latent frame's noise level, the policy modulates the reliability of its Key/Value contribution to the action tokens. We propose NoiseGate, which combines independent per-latent timestep sampling during backbone training, a lightweight Gating Policy Network that emits per-latent time increments during denoising, and task-reward optimization that trains the schedule policy without hand-crafted shape priors. Built on a joint video--action MoT backbone, NoiseGate delivers consistent gains on diverse RoboTwin random-scene manipulation tasks.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 35 of its 41 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

35 of 41 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  2. 2026World Action Models are Zero-shot Policies17 Feb
  3. 2025Motus: A Unified Latent Action World Model15 Dec
  4. 2025RynnVLA-002: A Unified Vision-Language-Action and World Model21 Nov
  5. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  6. 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr

Other references · 29

  1. 2020Denoising Diffusion Implicit Modelscited by 9,781
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  8. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  9. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  10. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  11. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  12. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
17 more
  1. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  2. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  3. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  4. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  5. 2025Unified Video Action Modelcited by 205
  6. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  7. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
  8. 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 151
  9. 2025What Can RL Bring to VLA Generalization? An Empirical Studycited by 108
  10. 2025ReinFlow: Fine-tuning Flow Matching Policy with Online Reinforcement Learningcited by 97
  11. 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
  12. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
  13. 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 64
  14. 2025RLinf: Flexible and Efficient Large-scale Reinforcement Learning via Macro-to-Micro Flow Transformationcited by 57
  15. 2025RLinf-VLA: A Unified and Efficient Framework for Reinforcement Learning of Vision-Language-Action Modelscited by 28
  16. 2025π_textttRL: Online RL Fine-tuning for Flow-based Vision-Language-Action Modelscited by 16
  17. 2026RL-VLA3: A Flexible and Asynchronous Reinforcement Learning Framework for VLA Trainingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight
  2. 2026Foresight Without Seeing: Latent Futures for World Action Models
  3. 2026Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination
  4. 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement
  5. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
  6. 2026SANTS: A State-Adaptive Scheduler for World Action Models
  7. 2026Beyond Future Prediction: Denoising as Generative Adaptation for Robot Control
  8. 2026MARS: Systematic Multi-Level Acceleration for World Action Models