Multi-Step Prediction of Occupancy Grid Maps with Recurrent Neural Networks
Not on the map. Why?
Abstract (arXiv)
We investigate the multi-step prediction of the drivable space, represented by Occupancy Grid Maps (OGMs), for autonomous vehicles. Our motivation is that accurate multi-step prediction of the drivable space can efficiently improve path planning and navigation resulting in safe, comfortable and optimum paths in autonomous driving. We train a variety of Recurrent Neural Network (RNN) based architectures on the OGM sequences from the KITTI dataset. The results demonstrate significant improvement of the prediction accuracy using our proposed difference learning method, incorporating motion related features, over the state of the art. We remove the egomotion from the OGM sequences by transforming them into a common frame. Although in the transformed sequences the KITTI dataset is heavily biased toward static objects, by learning the difference between subsequent OGMs, our proposed method provides accurate prediction over both the static and moving objects.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 6; 2024: 2; 2025: 0; 2026: 2.
23 papers.
Sort:
By area:
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Mapscited by 22
- 2021ShuttleNet: Position-aware Fusion of Rally Progress and Player Styles for Stroke Forecasting in Badmintoncited by 21
- 2021Unlimited Neighborhood Interaction for Heterogeneous Trajectory Predictioncited by 17
- 2022Dynamics-Aware Spatiotemporal Occupancy Prediction in Urban Environmentscited by 17
- 2022Predicting Future Occupancy Grids in Dynamic Environment with Spatio-Temporal Learningcited by 7
- 2024Self-supervised Multi-future Occupancy Forecasting for Autonomous Drivingcited by 7
- 2021Self-Supervised Simultaneous Multi-Step Prediction of Road Dynamics and Cost Mapcited by 4
- 2022Spatiotemporal Transformer Attention Network for 3D Voxel Level Joint Segmentation and Motion Prediction in Point Cloudcited by 4
- 2022LOPR: Latent Occupancy PRediction using Generative Modelscited by 4
- 2021Spatial Imagination With Semantic Cognition for Mobile Robotscited by 3
- 2021Reinforcement Learning based Negotiation-aware Motion Planning of Autonomous Vehiclescited by 3
- 2023Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networkscited by 3
11 more
- 2023Vehicle Motion Forecasting using Prior Information and Semantic-assisted Occupancy Grid Mapscited by 3
- 2021Vehicle trajectory prediction in top-view image sequences based on deep learning methodcited by 2
- 2024Flow-guided Motion Prediction with Semantics and Dynamic Occupancy Grid Mapscited by 2
- 2022Circular Accessible Depth: A Robust Traversability Representation for UGV Navigationcited by 1
- 2023Deep Occupancy-Predictive Representations for Autonomous Drivingcited by 1
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehiclescited by 0
- 2023Point2Point : A Framework for Efficient Deep Learning on Hilbert sorted Point Clouds with applications in Spatio-Temporal Occupancy Predictioncited by 0
- 2023Does Unpredictability Influence Driving Behavior?cited by 0
- 2023Invariant-based Mapping of Space During General Motion of an Observercited by 0
- 2026Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Mapscited by 0
- 2026ROSA-RL: Uncertainty-Aware Roundabout Optimized Speed Advisory with Reinforcement Learningcited by 0
- 2026ROSA-RL: Uncertainty-Aware Roundabout Optimized Speed Advisory with Reinforcement Learning15 Jun 2026
- 2026Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Maps8 Feb 2026
- 2024Self-supervised Multi-future Occupancy Forecasting for Autonomous Driving30 Jul 2024
- 2024Flow-guided Motion Prediction with Semantics and Dynamic Occupancy Grid Maps22 Jul 2024
- 2023Invariant-based Mapping of Space During General Motion of an Observer18 Nov 2023
- 2023Vehicle Motion Forecasting using Prior Information and Semantic-assisted Occupancy Grid Maps8 Aug 2023
- 2023Does Unpredictability Influence Driving Behavior?28 Jul 2023
- 2023Point2Point : A Framework for Efficient Deep Learning on Hilbert sorted Point Clouds with applications in Spatio-Temporal Occupancy Prediction28 Jun 2023
- 2023Deep Occupancy-Predictive Representations for Autonomous Driving7 Mar 2023
- 2023Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networks11 Jan 2023
- 2022Circular Accessible Depth: A Robust Traversability Representation for UGV Navigation28 Dec 2022
- 2022LOPR: Latent Occupancy PRediction using Generative Models3 Oct 2022
11 more
- 2022Dynamics-Aware Spatiotemporal Occupancy Prediction in Urban Environments27 Sep 2022
- 2022Predicting Future Occupancy Grids in Dynamic Environment with Spatio-Temporal Learning6 May 2022
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps31 Mar 2022
- 2022Spatiotemporal Transformer Attention Network for 3D Voxel Level Joint Segmentation and Motion Prediction in Point Cloud28 Feb 2022
- 2021ShuttleNet: Position-aware Fusion of Rally Progress and Player Styles for Stroke Forecasting in Badminton2 Dec 2021
- 2021Unlimited Neighborhood Interaction for Heterogeneous Trajectory Prediction31 Jul 2021
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles19 Jul 2021
- 2021Reinforcement Learning based Negotiation-aware Motion Planning of Autonomous Vehicles8 Jul 2021
- 2021Spatial Imagination With Semantic Cognition for Mobile Robots8 Apr 2021
- 2021Self-Supervised Simultaneous Multi-Step Prediction of Road Dynamics and Cost Map1 Mar 2021
- 2021Vehicle trajectory prediction in top-view image sequences based on deep learning method2 Feb 2021
- 2021Reinforcement Learning based Negotiation-aware Motion Planning of Autonomous Vehiclescited by 3
- 2023Deep Occupancy-Predictive Representations for Autonomous Drivingcited by 1
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehiclescited by 0
- 2023Does Unpredictability Influence Driving Behavior?cited by 0
- 2023Does Unpredictability Influence Driving Behavior?28 Jul 2023
- 2023Deep Occupancy-Predictive Representations for Autonomous Driving7 Mar 2023
- 2021ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles19 Jul 2021
- 2021Reinforcement Learning based Negotiation-aware Motion Planning of Autonomous Vehicles8 Jul 2021
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Mapscited by 22
- 2021ShuttleNet: Position-aware Fusion of Rally Progress and Player Styles for Stroke Forecasting in Badmintoncited by 21
- 2021Unlimited Neighborhood Interaction for Heterogeneous Trajectory Predictioncited by 17
- 2022Dynamics-Aware Spatiotemporal Occupancy Prediction in Urban Environmentscited by 17
- 2022Predicting Future Occupancy Grids in Dynamic Environment with Spatio-Temporal Learningcited by 7
- 2021Self-Supervised Simultaneous Multi-Step Prediction of Road Dynamics and Cost Mapcited by 4
- 2022Spatiotemporal Transformer Attention Network for 3D Voxel Level Joint Segmentation and Motion Prediction in Point Cloudcited by 4
- 2022LOPR: Latent Occupancy PRediction using Generative Modelscited by 4
- 2021Spatial Imagination With Semantic Cognition for Mobile Robotscited by 3
- 2023Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networkscited by 3
- 2023Vehicle Motion Forecasting using Prior Information and Semantic-assisted Occupancy Grid Mapscited by 3
- 2021Vehicle trajectory prediction in top-view image sequences based on deep learning methodcited by 2
12 most cited of 18 All 18 (JSON)
- 2026ROSA-RL: Uncertainty-Aware Roundabout Optimized Speed Advisory with Reinforcement Learning15 Jun 2026
- 2026Integrating Specialized and Generic Agent Motion Prediction with Dynamic Occupancy Grid Maps8 Feb 2026
- 2024Flow-guided Motion Prediction with Semantics and Dynamic Occupancy Grid Maps22 Jul 2024
- 2023Invariant-based Mapping of Space During General Motion of an Observer18 Nov 2023
- 2023Vehicle Motion Forecasting using Prior Information and Semantic-assisted Occupancy Grid Maps8 Aug 2023
- 2023Point2Point : A Framework for Efficient Deep Learning on Hilbert sorted Point Clouds with applications in Spatio-Temporal Occupancy Prediction28 Jun 2023
- 2023Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networks11 Jan 2023
- 2022Circular Accessible Depth: A Robust Traversability Representation for UGV Navigation28 Dec 2022
- 2022LOPR: Latent Occupancy PRediction using Generative Models3 Oct 2022
- 2022Dynamics-Aware Spatiotemporal Occupancy Prediction in Urban Environments27 Sep 2022
- 2022Predicting Future Occupancy Grids in Dynamic Environment with Spatio-Temporal Learning6 May 2022
- 2022End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps31 Mar 2022
12 newest of 18 All 18 (JSON)