Toward Agile Maneuvers in Highly Constrained Spaces: Learning from Hallucination
Not on the map. Why?
Abstract (arXiv)
While classical approaches to autonomous robot navigation currently enable operation in certain environments, they break down in tightly constrained spaces, e.g., where the robot needs to engage in agile maneuvers to squeeze between obstacles. Recent machine learning techniques have the potential to address this shortcoming, but existing approaches require vast amounts of navigation experience for training, during which the robot must operate in close proximity to obstacles and risk collision. In this paper, we propose to side-step this requirement by introducing a new machine learning paradigm for autonomous navigation called learning from hallucination (LfH), which can use training data collected in completely safe environments to compute navigation controllers that result in fast, smooth, and safe navigation in highly constrained environments. Our experimental results show that the proposed LfH system outperforms three autonomous navigation baselines on a real robot and generalizes well to unseen environments, including those based on both classical and machine learning techniques.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 5; 2023: 1; 2024: 3; 2025: 1.
10 papers.
- 2022Retrospectives on the Embodied AI Workshopcited by 46
- 2022Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigationcited by 27
- 2022VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamicscited by 19
- 2022High-Speed Accurate Robot Control using Learned Forward Kinodynamics and Non-linear Least Squares Optimizationcited by 9
- 2024VANP: Learning Where to See for Navigation with Self-Supervised Vision-Action Pre-Trainingcited by 5
- 2024Grounded Curriculum Learningcited by 5
- 2023A Study on Learning Social Robot Navigation with Multimodal Perceptioncited by 4
- 2022Speeding up deep neural network-based planning of local car maneuvers via efficient B-spline path constructioncited by 2
- 2025Heaven-Sent or Hell-Bent? Benchmarking the Intelligence and Defectiveness of LLM Hallucinationscited by 2
- 2024Dyna-LfLH: Learning Agile Navigation in Dynamic Environments from Learned Hallucinationcited by 0
- 2025Heaven-Sent or Hell-Bent? Benchmarking the Intelligence and Defectiveness of LLM Hallucinations25 Dec 2025
- 2024Grounded Curriculum Learning29 Sep 2024
- 2024Dyna-LfLH: Learning Agile Navigation in Dynamic Environments from Learned Hallucination25 Mar 2024
- 2024VANP: Learning Where to See for Navigation with Self-Supervised Vision-Action Pre-Training12 Mar 2024
- 2023A Study on Learning Social Robot Navigation with Multimodal Perception22 Sep 2023
- 2022Retrospectives on the Embodied AI Workshop13 Oct 2022
- 2022Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigation22 Sep 2022
- 2022High-Speed Accurate Robot Control using Learned Forward Kinodynamics and Non-linear Least Squares Optimization16 Jun 2022
- 2022VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamics30 Mar 2022
- 2022Speeding up deep neural network-based planning of local car maneuvers via efficient B-spline path construction14 Mar 2022