mlsanityData to 7 Oct 2026

Beyond Future Prediction: Denoising as Generative Adaptation for Robot Control

arXiv 2609.28339 ↗First posted 23 Sep 2026cs.ROcited by 0

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Pretrained generative Diffusion Transformers (DiTs) capture rich pixel-level visual and language-conditioned structure through large-scale image and video generation training. A growing line of robot policies builds on this generative prior, but how it should be transferred to control remains unclear, and existing approaches commonly instantiate this transfer through future visual prediction. We ask a more basic question: what a pretrained generative DiT actually contributes to action learning, and how this prior should be adapted for control. We introduce NowWAM, a future-target-free co-training formulation that denoises the current observation and predicts robot actions from the same visual stream, directly coupling the native generative objective to the action-facing representation across the denoising trajectory. Under matched controlled settings, past and future visual targets perform comparably, while restricting training to the clean endpoint substantially reduces robustness, suggesting that a separate future target is not essential for generative adaptation, while the denoising trajectory remains an effective interface for control. On LIBERO-Plus, NowWAM reaches 87.7% with FLUX2-Klein, improving over the future-target co-training baseline by 6.1 points while halving training visual tokens (784 to 392) and reducing step time from 2.85 s to 1.63 s, a 1.8x speedup. With the pure text-to-image Z-Image backbone, NowWAM further reaches 87.8%, showing that strong control adaptation is not tied to video generation or image-editing backbones.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 58 of its 60 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

58 of 60 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026World Action Models are Zero-shot Policies17 Feb
  2. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning22 Jan
  3. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies27 Aug
  4. 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulation17 Jul
  5. 2024Prediction with Action: Visual Policy Learning via Joint Denoising Process27 Nov
  6. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation10 Oct
  7. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct
  8. 2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Planners3 Feb

Other references · 50

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  9. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  10. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  11. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  12. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
38 more
  1. 2023Emergent Correspondence from Image Diffusioncited by 437
  2. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  3. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
  4. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  5. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  6. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
  7. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  8. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  9. 2026Causal World Modeling for Robot Controlcited by 289
  10. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  11. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  12. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  13. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
  14. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  15. 2025Motus: A Unified Latent Action World Modelcited by 231
  16. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
  17. 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
  18. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  19. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
  20. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
  21. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
  22. 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 142
  23. 2023Unsupervised Semantic Correspondence Using Stable Diffusioncited by 120
  24. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
  25. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
  26. 2025Video Generators are Robot Policiescited by 86
  27. 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
  28. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 68
  29. 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
  30. 2023Text-image Alignment for Diffusion-based Perceptioncited by 42
  31. 2024CleanDIFT: Diffusion Features without Noisecited by 42
  32. 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 42
  33. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routingcited by 41
  34. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 33
  35. 2026RLDX-1 Technical Reportcited by 25
  36. 2026DIAL: Decoupling Intent and Action via Latent World Modeling for End-to-End VLAcited by 17
  37. 2025Deforming Videos to Masks: Flow Matching for Referring Video Segmentationcited by 10
  38. 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Foresight Without Seeing: Latent Futures for World Action Models
  2. 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control
  3. 2026VLS: Steering Pretrained Robot Policies via Vision-Language Models
  4. 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy
  5. 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models
  6. 2026Native Action-Prior Learning from Videos for World Action Models
  7. 2025Exploration and Adaptation in Non-Stationary Tasks with Diffusion Policies
  8. 2025Inference-Time Enhancement of Generative Robot Policies via Predictive World Modeling