Beyond Future Prediction: Denoising as Generative Adaptation for Robot Control
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Pretrained generative Diffusion Transformers (DiTs) capture rich pixel-level visual and language-conditioned structure through large-scale image and video generation training. A growing line of robot policies builds on this generative prior, but how it should be transferred to control remains unclear, and existing approaches commonly instantiate this transfer through future visual prediction. We ask a more basic question: what a pretrained generative DiT actually contributes to action learning, and how this prior should be adapted for control. We introduce NowWAM, a future-target-free co-training formulation that denoises the current observation and predicts robot actions from the same visual stream, directly coupling the native generative objective to the action-facing representation across the denoising trajectory. Under matched controlled settings, past and future visual targets perform comparably, while restricting training to the clean endpoint substantially reduces robustness, suggesting that a separate future target is not essential for generative adaptation, while the denoising trajectory remains an effective interface for control. On LIBERO-Plus, NowWAM reaches 87.7% with FLUX2-Klein, improving over the future-target co-training baseline by 6.1 points while halving training visual tokens (784 to 392) and reducing step time from 2.85 s to 1.63 s, a 1.8x speedup. With the pure text-to-image Z-Image backbone, NowWAM further reaches 87.8%, showing that strong control adaptation is not tied to video generation or image-editing backbones.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 58 of its 60 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
58 of 60 references.
Closest ancestors · 8
Same direction, newest first
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning22 Jan
- 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies27 Aug
- 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulation17 Jul
- 2024Prediction with Action: Visual Policy Learning via Joint Denoising Process27 Nov
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation10 Oct
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct
- 2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Planners3 Feb
Other references · 50
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
38 more
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2026Causal World Modeling for Robot Controlcited by 289
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Motus: A Unified Latent Action World Modelcited by 231
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 142
- 2023Unsupervised Semantic Correspondence Using Stable Diffusioncited by 120
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2025Video Generators are Robot Policiescited by 86
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 68
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
- 2023Text-image Alignment for Diffusion-based Perceptioncited by 42
- 2024CleanDIFT: Diffusion Features without Noisecited by 42
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 42
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routingcited by 41
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 33
- 2026RLDX-1 Technical Reportcited by 25
- 2026DIAL: Decoupling Intent and Action via Latent World Modeling for End-to-End VLAcited by 17
- 2025Deforming Videos to Masks: Flow Matching for Referring Video Segmentationcited by 10
- 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control
- 2026VLS: Steering Pretrained Robot Policies via Vision-Language Models
- 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy
- 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models
- 2026Native Action-Prior Learning from Videos for World Action Models
- 2025Exploration and Adaptation in Non-Stationary Tasks with Diffusion Policies
- 2025Inference-Time Enhancement of Generative Robot Policies via Predictive World Modeling