mlsanityData to 7 Oct 2026

Privileged Foresight Distillation: Zero-Cost Future Correction for World Action Models

arXiv 2604.25859 ↗First posted 28 Apr 2026cs.ROcited by 3

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World action models jointly predict future video and action during training, raising an open question about what role the future-prediction branch actually plays. A recent finding shows that this branch can be removed at inference with little to no loss on common manipulation benchmarks, suggesting that future information may act merely as a regularizer on the shared visual backbone. We propose instead that joint training induces an action-conditioned correction that privileged future observations impose on action denoising, and that current-only policies capture this correction only partially. Making the account precise, we formulate privileged foresight as a residual in the action-denoising direction -- the difference between what a model predicts given the true future and what it predicts given only the current frame -- and introduce Privileged Foresight Distillation (PFD), which transfers this residual from a training-time teacher into a small adapter on a current-only student. The teacher and student share the same backbone and differ only in the attention mask over video tokens; future video is never generated at inference. Controlled experiments verify that this gain reflects a genuine future-conditioned correction rather than a side effect of capacity or regularization. Empirically, PFD achieves consistent improvements on LIBERO and RoboTwin manipulation benchmarks while preserving the current-only inference interface at negligible added latency. This view reframes the role of future information in world action models: not as a target to predict, nor as a regularizer to absorb, but as a compressible correction to be distilled.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 14 of its 19 references that are in the map. First posted on arXiv 28 Apr 2026.

Builds on

14 of 19 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  2. 2026Causal World Modeling for Robot Control29 Jan
  3. 2025Motus: A Unified Latent Action World Model15 Dec

Other references · 11

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  3. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  4. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  5. 2023Mastering Diverse Domains through World Modelscited by 1,193
  6. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  7. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  8. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  9. 2019Learning by Cheatingcited by 361
  10. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  11. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Foresight Without Seeing: Latent Futures for World Action Models
  2. 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models
  3. 2026What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling
  4. 2026CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight
  5. 2026X-Foresight: A Joint Vision-Action Causal Forecasting Network via Predictive World Modeling
  6. 2026Beyond Future Prediction: Denoising as Generative Adaptation for Robot Control
  7. 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models
  8. 2026Faster-WAM: Efficient Inference-Time Future Conditioning for Robust World Action Models