Motion Policy Networks
Not on the map. Why?
Abstract (arXiv)
Collision-free motion generation in unknown environments is a core building block for robot manipulation. Generating such motions is challenging due to multiple objectives; not only should the solutions be optimal, the motion generator itself must be fast enough for real-time performance and reliable enough for practical deployment. A wide variety of methods have been proposed ranging from local controllers to global planners, often being combined to offset their shortcomings. We present an end-to-end neural model called Motion Policy Networks (MπNets) to generate collision-free, smooth motion from just a single depth camera observation. MπNets are trained on over 3 million motion planning problems in over 500,000 environments. Our experiments show that MπNets are significantly faster than global planners while exhibiting the reactivity needed to deal with dynamic scenes. They are 46% better than prior neural planners and more robust than local control policies. Despite being only trained in simulation, MπNets transfer well to the real robot with noisy partial point clouds. Code and data are publicly available at https://mpinets.github.io.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). Builds on 34 of its 67 references that are in the map. First posted on arXiv 21 Oct 2022.
Builds on
34 of 67 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2017Hindsight Experience Replaycited by 1,096
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2018An Algorithmic Perspective on Imitation Learningcited by 455
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
- 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 213
- 2017DART: Noise Injection for Robust Imitation Learningcited by 187
- 2015Learning Visual Features from Large Weakly Supervised Datacited by 165
22 more
- 2016Value Iteration Networkscited by 158
- 2020C-Learning: Learning to Achieve Goals via Recursive Classificationcited by 99
- 2017Learning Sampling Distributions for Robot Motion Planningcited by 79
- 2018Motion Planning Networkscited by 78
- 20196-DOF Grasping for Target-driven Object Manipulation in Cluttercited by 70
- 2015Seeing through the Human Reporting Bias: Visual Classifiers from Noisy Human-Centric Labelscited by 64
- 2017Continuous-Time Gaussian Process Motion Planning via Probabilistic Inferencecited by 49
- 2021STORM: An Integrated Framework for Fast Joint-Space Model-Predictive Control for Reactive Manipulationcited by 46
- 2018Riemannian Motion Policiescited by 45
- 2020Object Rearrangement Using Learned Implicit Collision Functionscited by 43
- 2014Batch Informed Trees (BIT*): Sampling-based Optimal Planning via the Heuristically Guided Search of Implicit Random Geometric Graphscited by 38
- 2020Grasping with Chopsticks: Combating Covariate Shift in Model-free Imitation Learning for Fine Manipulationcited by 37
- 2021NeRP: Neural Rearrangement Planning for Unknown Objectscited by 33
- 2021Differentiable Spatial Planning using Transformerscited by 25
- 2020Adaptively Informed Trees (AIT*): Fast Asymptotically Optimal Path Planning through Adaptive Heuristicscited by 20
- 2019Harnessing Reinforcement Learning for Neural Motion Planningcited by 19
- 2019LEGO: Leveraging Experience in Roadmap Generation for Sampling-Based Planningcited by 19
- 2021Geometric Fabrics: Generalizing Classical Mechanics to Capture the Physics of Behaviorcited by 17
- 2018Learning Implicit Sampling Distributions for Motion Planningcited by 16
- 2020Learning Obstacle Representations for Neural Motion Planningcited by 13
- 2020Learning Sampling Distributions Using Local 3D Workspace Decompositions for Motion Planning in High Dimensionscited by 12
- 2020Advanced BIT* (ABIT*): Sampling-Based Planning with Advanced Graph-Search Techniquescited by 10
Built on by
Citing papers per year: 2023: 10; 2024: 15; 2025: 18; 2026: 10.
53 papers.
Sort:
By area:
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2023Imitating Task and Motion Planning with Visuomotor Transformerscited by 63
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 62
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 51
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 50
- 2023EDMP: Ensemble-of-costs-guided Diffusion for Motion Planningcited by 49
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 40
- 2024Potential Based Diffusion Motion Planningcited by 40
- 2025Diffusion Models for Robotic Manipulation: A Surveycited by 39
- 2024Motion Planning Diffusion: Learning and Adapting Robot Motion Planning with Diffusion Modelscited by 32
38 more
- 2025HUMOTO: A 4D Dataset of Mocap Human Object Interactionscited by 30
- 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangementcited by 29
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenescited by 26
- 2023Chain-of-Thought Predictive Controlcited by 18
- 2024Neural MP: A Generalist Neural Motion Plannercited by 18
- 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generationcited by 17
- 2025Bootstrapped Model Predictive Controlcited by 13
- 2024Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulationcited by 10
- 2025ArticuBot: Learning Universal Articulated Object Manipulation Policy via Large Scale Simulationcited by 10
- 2024Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulationcited by 8
- 2023USA-Net: Unified Semantic and Affordance Representations for Robot Memorycited by 7
- 2025Deep Reactive Policy: Learning Reactive Manipulator Motion Planning for Dynamic Environmentscited by 7
- 2025Physics-informed Temporal Difference Metric Learning for Robot Motion Planningcited by 6
- 2024M3Bench: Benchmarking Whole-body Motion Generation for Mobile Manipulation in 3D Scenescited by 5
- 2026GeneralVLA: Generalizable Vision-Language-Action Models with Knowledge-Guided Trajectory Planningcited by 5
- 2023Leveraging Scene Embeddings for Gradient-Based Motion Planning in Latent Spacecited by 4
- 2024ARMOR: Egocentric Perception for Humanoid Robot Collision Avoidance and Motion Planningcited by 4
- 2025Cascaded Diffusion Models for Neural Motion Planningcited by 4
- 2024Global Tensor Motion Planningcited by 2
- 2025Generative Models From and For Sampling-Based MPC: A Bootstrapped Approach For Adaptive Contact-Rich Manipulationcited by 2
- 2026Ada3Drift: Adaptive Training-Time Drifting for One-Step 3D Visuomotor Robotic Manipulationcited by 2
- 2024AdaDemo: Data-Efficient Demonstration Expansion for Generalist Robotic Agentcited by 1
- 2025DAA*: Deep Angular A Star for Image-based Path Planningcited by 1
- 2025Accelerated Multi-Modal Motion Planning Using Context-Conditioned Diffusion Modelscited by 1
- 2026Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunitiescited by 1
- 2024RoboArm-NMP: a Learning Environment for Neural Motion Planningcited by 0
- 2024RobotDiffuse: Diffusion-Based Motion Planning for Redundant Manipulators with the ROP Obstacle Avoidance Datasetcited by 0
- 2025Data-augmented Learning of Geodesic Distances in Irregular Domains through Soner Boundary Conditionscited by 0
- 2025MoRe-ERL: Learning Motion Residuals using Episodic Reinforcement Learningcited by 0
- 2025No More Marching: Learning Humanoid Locomotion for Short-Range SE(2) Targetscited by 0
- 2025Keypoint-based Diffusion for Robotic Motion Planning on the NICOL Robotcited by 0
- 2025ImaginationPolicy: Towards Generalizable, Precise and Reliable End-to-End Policy for Robotic Manipulationcited by 0
- 2025Obstacle Avoidance using Dynamic Movement Primitives and Reinforcement Learningcited by 0
- 2025Explainable Neural Inverse Kinematics for Obstacle-Aware Robotic Manipulation: A Comparative Analysis of IKNet Variantscited by 0
- 2026SIT-LMPC: Safe Information-Theoretic Learning Model Predictive Control for Iterative Taskscited by 0
- 2026Flow Motion Policy: Manipulator Motion Planning with Flow Matching Modelscited by 0
- 2026Can Explicit Physical Feasibility Benefit VLA Learning? An Empirical Studycited by 0
- 2026Sum of Costs Diffusion with Dynamic Guidance for Motion Planningcited by 0
50 most cited of 53 All 53 (JSON)
- 2026ObstaDiff: Generalizable Diffusion Policy Learning via Obstacle-aware Representations10 Sep 2026
- 2026NeurRAFT: Robot Motion Planning via Anchor-Level Flow Matching with Clearance-Aware Preference Tuning25 Aug 2026
- 2026SplatCtrl: Perception-Action Coupling via Gaussian Scene Representations and Reactive Robot Control9 Jul 2026
- 2026Sum of Costs Diffusion with Dynamic Guidance for Motion Planning23 May 2026
- 2026Can Explicit Physical Feasibility Benefit VLA Learning? An Empirical Study20 Apr 2026
- 2026Flow Motion Policy: Manipulator Motion Planning with Flow Matching Models8 Apr 2026
- 2026Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunities25 Mar 2026
- 2026Ada3Drift: Adaptive Training-Time Drifting for One-Step 3D Visuomotor Robotic Manipulation12 Mar 2026
- 2026SIT-LMPC: Safe Information-Theoretic Learning Model Predictive Control for Iterative Tasks18 Feb 2026
- 2026GeneralVLA: Generalizable Vision-Language-Action Models with Knowledge-Guided Trajectory Planning4 Feb 2026
- 2025Explainable Neural Inverse Kinematics for Obstacle-Aware Robotic Manipulation: A Comparative Analysis of IKNet Variants29 Dec 2025
- 2025Generative Models From and For Sampling-Based MPC: A Bootstrapped Approach For Adaptive Contact-Rich Manipulation16 Oct 2025
38 more
- 2025Accelerated Multi-Modal Motion Planning Using Context-Conditioned Diffusion Models16 Oct 2025
- 2025Obstacle Avoidance using Dynamic Movement Primitives and Reinforcement Learning10 Oct 2025
- 2025ImaginationPolicy: Towards Generalizable, Precise and Reliable End-to-End Policy for Robotic Manipulation25 Sep 2025
- 2025Deep Reactive Policy: Learning Reactive Manipulator Motion Planning for Dynamic Environments8 Sep 2025
- 2025Keypoint-based Diffusion for Robotic Motion Planning on the NICOL Robot4 Sep 2025
- 2025No More Marching: Learning Humanoid Locomotion for Short-Range SE(2) Targets16 Aug 2025
- 2025MoRe-ERL: Learning Motion Residuals using Episodic Reinforcement Learning2 Aug 2025
- 2025DAA*: Deep Angular A Star for Image-based Path Planning12 Jul 2025
- 2025Cascaded Diffusion Models for Neural Motion Planning21 May 2025
- 2025Physics-informed Temporal Difference Metric Learning for Robot Motion Planning9 May 2025
- 2025HUMOTO: A 4D Dataset of Mocap Human Object Interactions14 Apr 2025
- 2025Diffusion Models for Robotic Manipulation: A Survey11 Apr 2025
- 2025Bootstrapped Model Predictive Control24 Mar 2025
- 2025Data-augmented Learning of Geodesic Distances in Irregular Domains through Soner Boundary Conditions6 Mar 2025
- 2025ArticuBot: Learning Universal Articulated Object Manipulation Policy via Large Scale Simulation4 Mar 2025
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation8 Feb 2025
- 2024Motion Planning Diffusion: Learning and Adapting Robot Motion Planning with Diffusion Models27 Dec 2024
- 2024RobotDiffuse: Diffusion-Based Motion Planning for Redundant Manipulators with the ROP Obstacle Avoidance Dataset27 Dec 2024
- 2024Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation3 Dec 2024
- 2024ARMOR: Egocentric Perception for Humanoid Robot Collision Avoidance and Motion Planning30 Nov 2024
- 2024Global Tensor Motion Planning28 Nov 2024
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenes15 Oct 2024
- 2024M3Bench: Benchmarking Whole-body Motion Generation for Mobile Manipulation in 3D Scenes9 Oct 2024
- 2024Neural MP: A Generalist Neural Motion Planner9 Sep 2024
- 2024Potential Based Diffusion Motion Planning8 Jul 2024
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics15 Jun 2024
- 2024RoboArm-NMP: a Learning Environment for Neural Motion Planning25 May 2024
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction16 May 2024
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Tasks2 May 2024
- 2024AdaDemo: Data-Efficient Demonstration Expansion for Generalist Robotic Agent11 Apr 2024
- 2024Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulation11 Feb 2024
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis14 Dec 2023
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Place2 Nov 2023
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models27 Oct 2023
- 2023EDMP: Ensemble-of-costs-guided Diffusion for Motion Planning20 Sep 2023
- 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangement10 Jul 2023
- 2023Imitating Task and Motion Planning with Visuomotor Transformers25 May 2023
- 2023USA-Net: Unified Semantic and Affordance Representations for Robot Memory24 Apr 2023
50 newest of 53 All 53 (JSON)
- 2023EDMP: Ensemble-of-costs-guided Diffusion for Motion Planningcited by 49
- 2025Diffusion Models for Robotic Manipulation: A Surveycited by 39
- 2024Motion Planning Diffusion: Learning and Adapting Robot Motion Planning with Diffusion Modelscited by 32
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenescited by 26
- 2024Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulationcited by 8
- 2025Cascaded Diffusion Models for Neural Motion Planningcited by 4
- 2025Generative Models From and For Sampling-Based MPC: A Bootstrapped Approach For Adaptive Contact-Rich Manipulationcited by 2
- 2025Accelerated Multi-Modal Motion Planning Using Context-Conditioned Diffusion Modelscited by 1
- 2024RobotDiffuse: Diffusion-Based Motion Planning for Redundant Manipulators with the ROP Obstacle Avoidance Datasetcited by 0
- 2026Flow Motion Policy: Manipulator Motion Planning with Flow Matching Modelscited by 0
- 2026Sum of Costs Diffusion with Dynamic Guidance for Motion Planningcited by 0
- 2026NeurRAFT: Robot Motion Planning via Anchor-Level Flow Matching with Clearance-Aware Preference Tuningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026ObstaDiff: Generalizable Diffusion Policy Learning via Obstacle-aware Representations10 Sep 2026
- 2026NeurRAFT: Robot Motion Planning via Anchor-Level Flow Matching with Clearance-Aware Preference Tuning25 Aug 2026
- 2026Sum of Costs Diffusion with Dynamic Guidance for Motion Planning23 May 2026
- 2026Flow Motion Policy: Manipulator Motion Planning with Flow Matching Models8 Apr 2026
- 2025Generative Models From and For Sampling-Based MPC: A Bootstrapped Approach For Adaptive Contact-Rich Manipulation16 Oct 2025
- 2025Accelerated Multi-Modal Motion Planning Using Context-Conditioned Diffusion Models16 Oct 2025
- 2025Cascaded Diffusion Models for Neural Motion Planning21 May 2025
- 2025Diffusion Models for Robotic Manipulation: A Survey11 Apr 2025
- 2024Motion Planning Diffusion: Learning and Adapting Robot Motion Planning with Diffusion Models27 Dec 2024
- 2024RobotDiffuse: Diffusion-Based Motion Planning for Redundant Manipulators with the ROP Obstacle Avoidance Dataset27 Dec 2024
- 2024Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation3 Dec 2024
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenes15 Oct 2024
12 newest of 13 All 13 (JSON)
- 2023Imitating Task and Motion Planning with Visuomotor Transformerscited by 63
- 2024Global Tensor Motion Planningcited by 2
- 2025DAA*: Deep Angular A Star for Image-based Path Planningcited by 1
- 2025DAA*: Deep Angular A Star for Image-based Path Planning12 Jul 2025
- 2024Global Tensor Motion Planning28 Nov 2024
- 2023Imitating Task and Motion Planning with Visuomotor Transformers25 May 2023
- 2023Chain-of-Thought Predictive Controlcited by 18
- 2023Chain-of-Thought Predictive Control3 Apr 2023
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 62
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 51
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 50
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 40
- 2024Potential Based Diffusion Motion Planningcited by 40
- 2025HUMOTO: A 4D Dataset of Mocap Human Object Interactionscited by 30
- 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangementcited by 29
- 2024Neural MP: A Generalist Neural Motion Plannercited by 18
- 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generationcited by 17
- 2025Bootstrapped Model Predictive Controlcited by 13
- 2024Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulationcited by 10
12 most cited of 31 All 31 (JSON)
- 2026SplatCtrl: Perception-Action Coupling via Gaussian Scene Representations and Reactive Robot Control9 Jul 2026
- 2026Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunities25 Mar 2026
- 2026Ada3Drift: Adaptive Training-Time Drifting for One-Step 3D Visuomotor Robotic Manipulation12 Mar 2026
- 2026SIT-LMPC: Safe Information-Theoretic Learning Model Predictive Control for Iterative Tasks18 Feb 2026
- 2025Explainable Neural Inverse Kinematics for Obstacle-Aware Robotic Manipulation: A Comparative Analysis of IKNet Variants29 Dec 2025
- 2025Obstacle Avoidance using Dynamic Movement Primitives and Reinforcement Learning10 Oct 2025
- 2025ImaginationPolicy: Towards Generalizable, Precise and Reliable End-to-End Policy for Robotic Manipulation25 Sep 2025
- 2025Deep Reactive Policy: Learning Reactive Manipulator Motion Planning for Dynamic Environments8 Sep 2025
- 2025Keypoint-based Diffusion for Robotic Motion Planning on the NICOL Robot4 Sep 2025
- 2025No More Marching: Learning Humanoid Locomotion for Short-Range SE(2) Targets16 Aug 2025
- 2025MoRe-ERL: Learning Motion Residuals using Episodic Reinforcement Learning2 Aug 2025
- 2025Physics-informed Temporal Difference Metric Learning for Robot Motion Planning9 May 2025
12 newest of 31 All 31 (JSON)