iPlanner: Imperative Path Planning
Not on the map. Why?
Abstract (arXiv)
The problem of path planning has been studied for years. Classic planning pipelines, including perception, mapping, and path searching, can result in latency and compounding errors between modules. While recent studies have demonstrated the effectiveness of end-to-end learning methods in achieving high planning efficiency, these methods often struggle to match the generalization abilities of classic approaches in handling different environments. Moreover, end-to-end training of policies often requires a large number of labeled data or training iterations to reach convergence. In this paper, we present a novel Imperative Learning (IL) approach. This approach leverages a differentiable cost map to provide implicit supervision during policy training, eliminating the need for demonstrations or labeled trajectories. Furthermore, the policy training adopts a Bi-Level Optimization (BLO) process, which combines network update and metric-based trajectory optimization, to generate a smooth and collision-free path toward the goal based on a single depth measurement. The proposed method allows task-level costs of predicted trajectories to be backpropagated through all components to update the network through direct gradient descent. In our experiments, the method demonstrates around 4x faster planning than the classic approach and robustness against localization noise. Additionally, the IL approach enables the planner to generalize to various unseen environments, resulting in an overall 26-87% improvement in SPL performance compared to baseline learning methods.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Feb 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 10; 2026: 15.
32 papers.
Sort:
By area:
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 35
- 2024TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigationcited by 15
- 2023iSLAM: Imperative SLAMcited by 14
- 2023Revisiting Implicit Differentiation for Learning Problems in Optimal Controlcited by 8
- 2025Physics-informed Temporal Difference Metric Learning for Robot Motion Planningcited by 6
- 2025RAPID: Robust and Agile Planner Using Inverse Reinforcement Learning for Vision-Based Drone Navigationcited by 5
- 2024iMTSP: Solving Min-Max Multiple Traveling Salesman Problem with Imperative Learningcited by 4
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worldscited by 4
- 2024LiteVLoc: Map-Lite Visual Localization for Image Goal Navigationcited by 4
- 2025LoGoPlanner: Localization Grounded Navigation Policy with Metric-aware Visual Geometrycited by 4
- 2025MM-Nav: Multi-View VLA Model for Robust Visual Navigation via Multi-Expert Learningcited by 3
20 more
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontierscited by 3
- 2024IN-Sight: Interactive Navigation through Sightcited by 2
- 2025UrbanVLA: A Vision-Language-Action Model for Urban Micromobilitycited by 2
- 2025Neural Fidelity Calibration for Informative Sim-to-Real Adaptationcited by 1
- 2025Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspectioncited by 1
- 2025ImagineNav++: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 1
- 2026Self-Imitated Diffusion Policy for Efficient and Robust Visual Navigationcited by 1
- 2026FLUX: Accelerating Cross-Embodiment Generative Navigation Policies via Rectified Flow and Static-to-Dynamic Learningcited by 1
- 2026Beyond Imitation: Reinforcement Learning Fine-Tuning for Adaptive Diffusion Navigation Policiescited by 1
- 2026Hg-I2P: Bridging Modalities for Generalizable Image-to-Point-Cloud Registration via Heterogeneous Graphscited by 1
- 2026OpenNavMap: Multi-Session Appearance-Based Topometric Mapping for Scalable Visual Navigationcited by 0
- 2026AsyncMDE: Real-Time Monocular Depth Estimation via Asynchronous Spatial Memorycited by 0
- 2026LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratorycited by 0
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraintscited by 0
- 2026Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfacescited by 0
- 2026Learning Adaptive Safety Margins for Visual Navigationcited by 0
- 2026X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matchingcited by 0
- 2026MulDP: Multimodal Diffusion Policy for Autonomous Quadruped Parkour Navigation across Complex Terrainscited by 0
- 2026"Dear LLaVA, Please Drive": A Depth-Aware Vision-Language Agent for Closed-Loop Robotic Controlcited by 0
- 2026World SLAM Model: Joint World Modeling for SLAM and Navigationcited by 0
- 2026World SLAM Model: Joint World Modeling for SLAM and Navigation26 Sep 2026
- 2026"Dear LLaVA, Please Drive": A Depth-Aware Vision-Language Agent for Closed-Loop Robotic Control19 Sep 2026
- 2026MulDP: Multimodal Diffusion Policy for Autonomous Quadruped Parkour Navigation across Complex Terrains3 Sep 2026
- 2026X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matching30 Jul 2026
- 2026Learning Adaptive Safety Margins for Visual Navigation20 Jul 2026
- 2026Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfaces13 Jul 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratory4 May 2026
- 2026Hg-I2P: Bridging Modalities for Generalizable Image-to-Point-Cloud Registration via Heterogeneous Graphs30 Mar 2026
- 2026Beyond Imitation: Reinforcement Learning Fine-Tuning for Adaptive Diffusion Navigation Policies13 Mar 2026
- 2026FLUX: Accelerating Cross-Embodiment Generative Navigation Policies via Rectified Flow and Static-to-Dynamic Learning13 Mar 2026
- 2026AsyncMDE: Real-Time Monocular Depth Estimation via Asynchronous Spatial Memory11 Mar 2026
20 more
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers5 Mar 2026
- 2026Self-Imitated Diffusion Policy for Efficient and Robust Visual Navigation30 Jan 2026
- 2026OpenNavMap: Multi-Session Appearance-Based Topometric Mapping for Scalable Visual Navigation18 Jan 2026
- 2025LoGoPlanner: Localization Grounded Navigation Policy with Metric-aware Visual Geometry22 Dec 2025
- 2025ImagineNav++: Prompting Vision-Language Models as Embodied Navigator through Scene Imagination19 Dec 2025
- 2025UrbanVLA: A Vision-Language-Action Model for Urban Micromobility27 Oct 2025
- 2025MM-Nav: Multi-View VLA Model for Robust Visual Navigation via Multi-Expert Learning3 Oct 2025
- 2025Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspection22 Sep 2025
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigation15 May 2025
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidance13 May 2025
- 2025Physics-informed Temporal Difference Metric Learning for Robot Motion Planning9 May 2025
- 2025Neural Fidelity Calibration for Informative Sim-to-Real Adaptation11 Apr 2025
- 2025RAPID: Robust and Agile Planner Using Inverse Reinforcement Learning for Vision-Based Drone Navigation4 Feb 2025
- 2024TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigation25 Nov 2024
- 2024LiteVLoc: Map-Lite Visual Localization for Image Goal Navigation6 Oct 2024
- 2024IN-Sight: Interactive Navigation through Sight1 Aug 2024
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worlds24 Jun 2024
- 2024iMTSP: Solving Min-Max Multiple Traveling Salesman Problem with Imperative Learning1 May 2024
- 2023Revisiting Implicit Differentiation for Learning Problems in Optimal Control23 Oct 2023
- 2023iSLAM: Imperative SLAM13 Jun 2023
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
- 2025Neural Fidelity Calibration for Informative Sim-to-Real Adaptationcited by 1
- 2026Self-Imitated Diffusion Policy for Efficient and Robust Visual Navigationcited by 1
- 2026FLUX: Accelerating Cross-Embodiment Generative Navigation Policies via Rectified Flow and Static-to-Dynamic Learningcited by 1
- 2026Beyond Imitation: Reinforcement Learning Fine-Tuning for Adaptive Diffusion Navigation Policiescited by 1
- 2026X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matchingcited by 0
- 2026MulDP: Multimodal Diffusion Policy for Autonomous Quadruped Parkour Navigation across Complex Terrainscited by 0
- 2026MulDP: Multimodal Diffusion Policy for Autonomous Quadruped Parkour Navigation across Complex Terrains3 Sep 2026
- 2026X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matching30 Jul 2026
- 2026Beyond Imitation: Reinforcement Learning Fine-Tuning for Adaptive Diffusion Navigation Policies13 Mar 2026
- 2026FLUX: Accelerating Cross-Embodiment Generative Navigation Policies via Rectified Flow and Static-to-Dynamic Learning13 Mar 2026
- 2026Self-Imitated Diffusion Policy for Efficient and Robust Visual Navigation30 Jan 2026
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidance13 May 2025
- 2025Neural Fidelity Calibration for Informative Sim-to-Real Adaptation11 Apr 2025
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 35
- 2023iSLAM: Imperative SLAMcited by 14
- 2023Revisiting Implicit Differentiation for Learning Problems in Optimal Controlcited by 8
- 2025Physics-informed Temporal Difference Metric Learning for Robot Motion Planningcited by 6
- 2024iMTSP: Solving Min-Max Multiple Traveling Salesman Problem with Imperative Learningcited by 4
- 2024QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worldscited by 4
- 2024LiteVLoc: Map-Lite Visual Localization for Image Goal Navigationcited by 4
- 2025LoGoPlanner: Localization Grounded Navigation Policy with Metric-aware Visual Geometrycited by 4
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontierscited by 3
- 2024IN-Sight: Interactive Navigation through Sightcited by 2
- 2025Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspectioncited by 1
- 2026Hg-I2P: Bridging Modalities for Generalizable Image-to-Point-Cloud Registration via Heterogeneous Graphscited by 1
12 most cited of 18 All 18 (JSON)
- 2026Learning Adaptive Safety Margins for Visual Navigation20 Jul 2026
- 2026Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfaces13 Jul 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratory4 May 2026
- 2026Hg-I2P: Bridging Modalities for Generalizable Image-to-Point-Cloud Registration via Heterogeneous Graphs30 Mar 2026
- 2026AsyncMDE: Real-Time Monocular Depth Estimation via Asynchronous Spatial Memory11 Mar 2026
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers5 Mar 2026
- 2026OpenNavMap: Multi-Session Appearance-Based Topometric Mapping for Scalable Visual Navigation18 Jan 2026
- 2025LoGoPlanner: Localization Grounded Navigation Policy with Metric-aware Visual Geometry22 Dec 2025
- 2025Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspection22 Sep 2025
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigation15 May 2025
- 2025Physics-informed Temporal Difference Metric Learning for Robot Motion Planning9 May 2025
12 newest of 18 All 18 (JSON)