Learning-based 3D Occupancy Prediction for Autonomous Navigation in Occluded Environments
Not on the map. Why?
Abstract (arXiv)
In autonomous navigation of mobile robots, sensors suffer from massive occlusion in cluttered environments, leaving significant amount of space unknown during planning. In practice, treating the unknown space in optimistic or pessimistic ways both set limitations on planning performance, thus aggressiveness and safety cannot be satisfied at the same time. However, humans can infer the exact shape of the obstacles from only partial observation and generate non-conservative trajectories that avoid possible collisions in occluded space. Mimicking human behavior, in this paper, we propose a method based on deep neural network to predict occupancy distribution of unknown space reliably. Specifically, the proposed method utilizes contextual information of environments and learns from prior knowledge to predict obstacle distributions in occluded space. We use unlabeled and no-ground-truth data to train our network and successfully apply it to real-time navigation in unseen environments without any refinement. Results show that our method leverages the performance of a kinodynamic planner by improving security with no reduction of speed in clustered environments.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 1; 2024: 8; 2025: 6; 2026: 1.
20 papers.
Sort:
By area:
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Predictioncited by 46
- 2024MonoOcc: Digging into Monocular Semantic Occupancy Predictioncited by 43
- 2024DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Predictioncited by 15
- 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splattingcited by 14
- 2022Occlusion-Aware Crowd Navigation Using People as Sensorscited by 8
- 2024SceneSense: Diffusion Models for 3D Occupancy Synthesis from Partial Observationcited by 8
- 2024Online Diffusion-Based 3D Occupancy Prediction at the Frontier with Probabilistic Map Reconciliationcited by 5
- 2024FSF-Net: Enhance 4D Occupancy Forecasting with Coarse BEV Scene Flow for Autonomous Drivingcited by 5
- 20244CNet: A Diffusion Approach to Map Prediction for Decentralized Multi-Robot Explorationcited by 3
- 2026Enhancing Indoor Occupancy Prediction via Sparse Query-Based Multi-Level Consistent Knowledge Distillationcited by 3
- 2025Global-Aware Monocular Semantic Scene Completion with State Space Modelscited by 2
- 2025Test-Time 3D Occupancy Predictioncited by 2
8 more
- 2021What we see and What we don't see: Imputing Occluded Crowd Structures from Robot Sensingcited by 1
- 2022FloorGenT: Generative Vector Graphic Model of Floor Plans for Roboticscited by 1
- 2023SePaint: Semantic Map Inpainting via Multinomial Diffusioncited by 1
- 2024VPOcc: Exploiting Vanishing Point for 3D Semantic Occupancy Predictioncited by 1
- 2025Complementary Information Guided Occupancy Prediction via Multi-Level Representation Fusioncited by 1
- 2022GoToNet: Fast Monocular Scene Exposure and Explorationcited by 0
- 2025Robust Robotic Exploration and Mapping Using Generative Occupancy Map Synthesiscited by 0
- 2025Unified Linear Parametric Map Modeling and Perception-aware Trajectory Planning for Mobile Roboticscited by 0
- 2026Enhancing Indoor Occupancy Prediction via Sparse Query-Based Multi-Level Consistent Knowledge Distillation2 Feb 2026
- 2025Complementary Information Guided Occupancy Prediction via Multi-Level Representation Fusion15 Oct 2025
- 2025Unified Linear Parametric Map Modeling and Perception-aware Trajectory Planning for Mobile Robotics12 Jul 2025
- 2025Robust Robotic Exploration and Mapping Using Generative Occupancy Map Synthesis24 Jun 2025
- 2025Test-Time 3D Occupancy Prediction11 Mar 2025
- 2025Global-Aware Monocular Semantic Scene Completion with State Space Models9 Mar 2025
- 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splatting7 Feb 2025
- 2024DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Prediction30 Sep 2024
- 2024FSF-Net: Enhance 4D Occupancy Forecasting with Coarse BEV Scene Flow for Autonomous Driving24 Sep 2024
- 2024Online Diffusion-Based 3D Occupancy Prediction at the Frontier with Probabilistic Map Reconciliation16 Sep 2024
- 2024VPOcc: Exploiting Vanishing Point for 3D Semantic Occupancy Prediction7 Aug 2024
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Prediction6 Apr 2024
8 more
- 2024SceneSense: Diffusion Models for 3D Occupancy Synthesis from Partial Observation18 Mar 2024
- 2024MonoOcc: Digging into Monocular Semantic Occupancy Prediction13 Mar 2024
- 20244CNet: A Diffusion Approach to Map Prediction for Decentralized Multi-Robot Exploration27 Feb 2024
- 2023SePaint: Semantic Map Inpainting via Multinomial Diffusion5 Mar 2023
- 2022Occlusion-Aware Crowd Navigation Using People as Sensors2 Oct 2022
- 2022GoToNet: Fast Monocular Scene Exposure and Exploration13 Jun 2022
- 2022FloorGenT: Generative Vector Graphic Model of Floor Plans for Robotics7 Mar 2022
- 2021What we see and What we don't see: Imputing Occluded Crowd Structures from Robot Sensing17 Sep 2021
- 2024SceneSense: Diffusion Models for 3D Occupancy Synthesis from Partial Observationcited by 8
- 2024Online Diffusion-Based 3D Occupancy Prediction at the Frontier with Probabilistic Map Reconciliationcited by 5
- 20244CNet: A Diffusion Approach to Map Prediction for Decentralized Multi-Robot Explorationcited by 3
- 2024Online Diffusion-Based 3D Occupancy Prediction at the Frontier with Probabilistic Map Reconciliation16 Sep 2024
- 2024SceneSense: Diffusion Models for 3D Occupancy Synthesis from Partial Observation18 Mar 2024
- 20244CNet: A Diffusion Approach to Map Prediction for Decentralized Multi-Robot Exploration27 Feb 2024
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Predictioncited by 46
- 2024MonoOcc: Digging into Monocular Semantic Occupancy Predictioncited by 43
- 2024DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Predictioncited by 15
- 2022Occlusion-Aware Crowd Navigation Using People as Sensorscited by 8
- 2026Enhancing Indoor Occupancy Prediction via Sparse Query-Based Multi-Level Consistent Knowledge Distillationcited by 3
- 2025Test-Time 3D Occupancy Predictioncited by 2
- 2021What we see and What we don't see: Imputing Occluded Crowd Structures from Robot Sensingcited by 1
- 2022FloorGenT: Generative Vector Graphic Model of Floor Plans for Roboticscited by 1
- 2023SePaint: Semantic Map Inpainting via Multinomial Diffusioncited by 1
- 2024VPOcc: Exploiting Vanishing Point for 3D Semantic Occupancy Predictioncited by 1
- 2025Complementary Information Guided Occupancy Prediction via Multi-Level Representation Fusioncited by 1
- 2022GoToNet: Fast Monocular Scene Exposure and Explorationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Enhancing Indoor Occupancy Prediction via Sparse Query-Based Multi-Level Consistent Knowledge Distillation2 Feb 2026
- 2025Complementary Information Guided Occupancy Prediction via Multi-Level Representation Fusion15 Oct 2025
- 2025Unified Linear Parametric Map Modeling and Perception-aware Trajectory Planning for Mobile Robotics12 Jul 2025
- 2025Robust Robotic Exploration and Mapping Using Generative Occupancy Map Synthesis24 Jun 2025
- 2025Test-Time 3D Occupancy Prediction11 Mar 2025
- 2024DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Prediction30 Sep 2024
- 2024VPOcc: Exploiting Vanishing Point for 3D Semantic Occupancy Prediction7 Aug 2024
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Prediction6 Apr 2024
- 2024MonoOcc: Digging into Monocular Semantic Occupancy Prediction13 Mar 2024
- 2023SePaint: Semantic Map Inpainting via Multinomial Diffusion5 Mar 2023
- 2022Occlusion-Aware Crowd Navigation Using People as Sensors2 Oct 2022
- 2022GoToNet: Fast Monocular Scene Exposure and Exploration13 Jun 2022
12 newest of 14 All 14 (JSON)