Learning Foresight without Explicit Trajectories for 3D Diffusion Policies
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
3D diffusion policies are strong at generating geometrically grounded actions from current observations, but successful manipulation requires not only knowing what motion is feasible now, but also anticipating where the interaction is heading. Existing policies largely leave such foresight to emerge implicitly from action learning. We introduce Movement Trend Guidance, a simple but effective way to provide this foresight without introducing an explicit plan. From a short observation history, the policy learns a compact latent representation of interaction evolution. During training, sparse future gripper states supervise this representation; at inference, only the latent is retained as future-oriented conditioning alongside the current observation. The latent provides global conditioning for action generation, while an additional gated FiLM branch is used only at the UNet bottleneck. Despite adding only 3.52% more parameters to DP3, our method preserves the original dense-action and receding-horizon formulation and consistently improves upon DP3 across RoboTwin2.0, LIBERO-40, and DexArt. It reaches 62.8% vs. 56.1% in 50-task RoboTwin2.0 mixed training, 71.93% vs. 37.08% on LIBERO-40, and 72.0% vs. 49.0% on five real-robot tasks. These results show that a diffusion policy can benefit substantially from knowing where an interaction is heading, without being told exactly where to move.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 31 of its 35 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
31 of 35 references.
Closest ancestors · 6
Same direction, newest first
- 2026ForeDiffusion: Foresight-Conditioned Diffusion Policy via Future View Construction for Robot Manipulation19 Jan
- 2025FLARE: Robot Learning with Implicit World Modeling21 May
- 2024ManiCM: Real-time 3D Diffusion Policy via Consistency Model for Robotic Manipulation3 Jun
- 2024Behavior Generation with Latent Actions5 Mar
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representations16 Feb
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
Other references · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2020Point Transformercited by 1,462
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
13 more
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2022Behavior Transformers: Cloning k modes with one stonecited by 299
- 2026Causal World Modeling for Robot Controlcited by 289
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
- 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 135
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 135
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 64
- 2025Diffusion Trajectory-guided Policy for Long-horizon Robot Manipulationcited by 15
- 2026R3D: Revisiting 3D Policy Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ISS Policy : Scalable Diffusion Policy with Implicit Scene Supervision
- 20253D Flow Diffusion Policy: Visuomotor Policy Learning via Generating Flow in 3D Space
- 2025Exploration and Adaptation in Non-Stationary Tasks with Diffusion Policies
- 2026Learning Transferable Dynamics Priors from Action to World Modeling
- 20253D Dynamics-Aware Manipulation: Endowing Manipulation Policies with 3D Foresight
- 2026Implicit Drifting Policy: One-Step Action Generation via Conditional Expert Geometry
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026CLaD: Planning with Grounded Foresight via Cross-Modal Latent Dynamics ↗