RST-MODNet: Real-time Spatio-temporal Moving Object Detection for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Moving Object Detection (MOD) is a critical task for autonomous vehicles as moving objects represent higher collision risk than static ones. The trajectory of the ego-vehicle is planned based on the future states of detected moving objects. It is quite challenging as the ego-motion has to be modelled and compensated to be able to understand the motion of the surrounding objects. In this work, we propose a real-time end-to-end CNN architecture for MOD utilizing spatio-temporal context to improve robustness. We construct a novel time-aware architecture exploiting temporal motion information embedded within sequential images in addition to explicit motion maps using optical flow images.We demonstrate the impact of our algorithm on KITTI dataset where we obtain an improvement of 8% relative to the baselines. We compare our algorithm with state-of-the-art methods and achieve competitive results on KITTI-Motion dataset in terms of accuracy at three times better run-time. The proposed algorithm runs at 23 fps on a standard desktop GPU targeting deployment on embedded platforms.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 0; 2023: 3; 2024: 3; 2025: 1.
11 papers.
- 2025Segment Any Motion in Videoscited by 34
- 2021Spatio-Temporal Multi-Task Learning Transformer for Joint Moving Object Detection and Segmentationcited by 9
- 2023Motion Segmentation from a Moving Monocular Cameracited by 6
- 2021BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Drivingcited by 5
- 2024Zero-Shot Monocular Motion Segmentation in the Wild by Combining Deep Learning with Geometric Motion Model Fusioncited by 4
- 2021MODETR: Moving Object Detection with Transformerscited by 3
- 2023DOAD: Decoupled One Stage Action Detection Networkcited by 1
- 2023DeepSTEP -- Deep Learning-Based Spatio-Temporal End-To-End Perception for Autonomous Vehiclescited by 1
- 2021VM-MODNet: Vehicle Motion aware Moving Object Detection for Autonomous Drivingcited by 0
- 2024Neural Rendering based Urban Scene Reconstruction for Autonomous Drivingcited by 0
- 2024Dense Monocular Motion Segmentation Using Optical Flow and Pseudo Depth Map: A Zero-Shot Approachcited by 0
- 2025Segment Any Motion in Videos28 Mar 2025
- 2024Dense Monocular Motion Segmentation Using Optical Flow and Pseudo Depth Map: A Zero-Shot Approach27 Jun 2024
- 2024Zero-Shot Monocular Motion Segmentation in the Wild by Combining Deep Learning with Geometric Motion Model Fusion2 May 2024
- 2024Neural Rendering based Urban Scene Reconstruction for Autonomous Driving9 Feb 2024
- 2023Motion Segmentation from a Moving Monocular Camera24 Sep 2023
- 2023DeepSTEP -- Deep Learning-Based Spatio-Temporal End-To-End Perception for Autonomous Vehicles11 May 2023
- 2023DOAD: Decoupled One Stage Action Detection Network1 Apr 2023
- 2021BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Driving11 Jul 2021
- 2021MODETR: Moving Object Detection with Transformers21 Jun 2021
- 2021Spatio-Temporal Multi-Task Learning Transformer for Joint Moving Object Detection and Segmentation21 Jun 2021
- 2021VM-MODNet: Vehicle Motion aware Moving Object Detection for Autonomous Driving22 Apr 2021