Mobile Video Object Detection with Temporally-Aware Feature Maps
Not on the map. Why?
Abstract (arXiv)
This paper introduces an online model for object detection in videos designed to run in real-time on low-powered mobile and embedded devices. Our approach combines fast single-image object detection with convolutional long short term memory (LSTM) layers to create an interweaved recurrent-convolutional architecture. Additionally, we propose an efficient Bottleneck-LSTM layer that significantly reduces computational cost compared to regular LSTMs. Our network achieves temporal awareness by using Bottleneck-LSTMs to refine and propagate feature maps across frames. This approach is substantially faster than existing detection methods in video, outperforming the fastest single-frame models in model size and computational cost while attaining accuracy comparable to much more expensive single-frame models on the Imagenet VID 2015 dataset. Our model reaches a real-time inference speed of up to 15 FPS on a mobile CPU.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 14; 2023: 4; 2024: 4; 2025: 2; 2026: 3.
39 papers.
Sort:
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognitioncited by 189
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 2021Temporal RoI Align for Video Object Recognitioncited by 44
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
- 2022Monocular 3D Object Detection with Depth from Motioncited by 38
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Surveycited by 33
- 2021Dogfight: Detecting Drones from Drones Videoscited by 18
- 2022Graph Neural Network and Spatiotemporal Transformer Attention for 3D Video Object Detection from Point Cloudscited by 17
- 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillancecited by 14
- 2022SALISA: Saliency-based Input Sampling for Efficient Video Object Detectioncited by 12
- 2021Efficient Global-Local Memory for Real-time Instrument Segmentation of Robotic Surgical Videocited by 10
27 more
- 2022Delta Distillation for Efficient Video Processingcited by 10
- 2022A recurrent CNN for online object detection on raw radar framescited by 9
- 2022Recent Advances in Embedding Methods for Multi-Object Tracking: A Surveycited by 8
- 2023Oriented object detection in optical remote sensing images using deep learning: a surveycited by 7
- 2021ACDnet: An action detection network for real-time edge computing based on flow-guided feature approximation and memory aggregationcited by 6
- 2022Survey: Exploiting Data Redundancy for Optimization of Deep Learningcited by 6
- 2021PatchNet -- Short-range Template Matching for Efficient Video Processingcited by 5
- 2021Real-Time and Accurate Object Detection in Compressed Video by Long Short-term Feature Aggregationcited by 5
- 2023Flying Bird Object Detection Algorithm in Surveillance Video Based on Motion Informationcited by 5
- 2021Temp-Frustum Net: 3D Object Detection with Temporal Fusioncited by 3
- 2021FFAVOD: Feature Fusion Architecture for Video Object Detectioncited by 2
- 2023ResQ: Residual Quantization for Video Perceptioncited by 2
- 2024Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perceptioncited by 2
- 2025MVP: Motion Vector Propagation for Zero-Shot Video Object Detectioncited by 2
- 2021TYolov5: A Temporal Yolov5 Detector Based on Quasi-Recurrent Neural Networks for Real-Time Handgun Detection in Videocited by 1
- 2024SSGA-Net: Stepwise Spatial Global-local Aggregation Networks for for Autonomous Drivingcited by 1
- 2024Spatiotemporal Object Detection for Improved Aerial Vehicle Detection in Traffic Monitoringcited by 1
- 2021MULTICAST: MULTI Confirmation-level Alarm SysTem based on CNN and LSTM to mitigate false alarms for handgun detection in video-surveillancecited by 0
- 2021SGE net: Video object detection with squeezed GRU and information entropy mapcited by 0
- 2022Representation Recycling for Streaming Video Analysiscited by 0
- 2022AdaEnlight: Energy-aware Low-light Video Stream Enhancement on Mobile Devicescited by 0
- 2022Person Detection Using an Ultra Low-resolution Thermal Imager on a Low-cost MCUcited by 0
- 2024STF: Spatio-Temporal Fusion Module for Improving Video Object Detectioncited by 0
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networkscited by 0
- 2026CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detectioncited by 0
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edgecited by 0
- 2026Analytical and Convolutional Neural Network-Based Motion-Vector Propagation for Efficient Video Object Detectioncited by 0
- 2026Analytical and Convolutional Neural Network-Based Motion-Vector Propagation for Efficient Video Object Detection28 Sep 2026
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge29 Aug 2026
- 2026CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detection28 Jun 2026
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025MVP: Motion Vector Propagation for Zero-Shot Video Object Detection22 Sep 2025
- 2024Spatiotemporal Object Detection for Improved Aerial Vehicle Detection in Traffic Monitoring17 Oct 2024
- 2024Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perception10 Sep 2024
- 2024SSGA-Net: Stepwise Spatial Global-local Aggregation Networks for for Autonomous Driving29 May 2024
- 2024STF: Spatio-Temporal Fusion Module for Improving Video Object Detection16 Feb 2024
- 2023ResQ: Residual Quantization for Video Perception18 Aug 2023
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Frames8 Aug 2023
- 2023Oriented object detection in optical remote sensing images using deep learning: a survey21 Feb 2023
27 more
- 2023Flying Bird Object Detection Algorithm in Surveillance Video Based on Motion Information5 Jan 2023
- 2022A recurrent CNN for online object detection on raw radar frames21 Dec 2022
- 2022Person Detection Using an Ultra Low-resolution Thermal Imager on a Low-cost MCU16 Dec 2022
- 2022AdaEnlight: Energy-aware Low-light Video Stream Enhancement on Mobile Devices29 Nov 2022
- 2022Survey: Exploiting Data Redundancy for Optimization of Deep Learning29 Aug 2022
- 2022Monocular 3D Object Detection with Depth from Motion26 Jul 2022
- 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillance26 Jul 2022
- 2022Graph Neural Network and Spatiotemporal Transformer Attention for 3D Video Object Detection from Point Clouds26 Jul 2022
- 2022Recent Advances in Embedding Methods for Multi-Object Tracking: A Survey22 May 2022
- 2022Representation Recycling for Streaming Video Analysis28 Apr 2022
- 2022SALISA: Saliency-based Input Sampling for Efficient Video Object Detection5 Apr 2022
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detection31 Mar 2022
- 2022Delta Distillation for Efficient Video Processing17 Mar 2022
- 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition20 Jan 2022
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformers13 Jan 2022
- 2021TYolov5: A Temporal Yolov5 Detector Based on Quasi-Recurrent Neural Networks for Real-Time Handgun Detection in Video17 Nov 2021
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Survey25 Oct 2021
- 2021Efficient Global-Local Memory for Real-time Instrument Segmentation of Robotic Surgical Video28 Sep 2021
- 2021FFAVOD: Feature Fusion Architecture for Video Object Detection15 Sep 2021
- 2021Temporal RoI Align for Video Object Recognition8 Sep 2021
- 2021SGE net: Video object detection with squeezed GRU and information entropy map14 Jun 2021
- 2021Temp-Frustum Net: 3D Object Detection with Temporal Fusion25 Apr 2021
- 2021MULTICAST: MULTI Confirmation-level Alarm SysTem based on CNN and LSTM to mitigate false alarms for handgun detection in video-surveillance23 Apr 2021
- 2021Dogfight: Detecting Drones from Drones Videos31 Mar 2021
- 2021Real-Time and Accurate Object Detection in Compressed Video by Long Short-term Feature Aggregation25 Mar 2021
- 2021PatchNet -- Short-range Template Matching for Efficient Video Processing10 Mar 2021
- 2021ACDnet: An action detection network for real-time edge computing based on flow-guided feature approximation and memory aggregation26 Feb 2021
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognitioncited by 189
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 2021Temporal RoI Align for Video Object Recognitioncited by 44
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
- 2022Monocular 3D Object Detection with Depth from Motioncited by 38
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Surveycited by 33
- 2021Dogfight: Detecting Drones from Drones Videoscited by 18
- 2022Graph Neural Network and Spatiotemporal Transformer Attention for 3D Video Object Detection from Point Cloudscited by 17
- 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillancecited by 14
- 2022SALISA: Saliency-based Input Sampling for Efficient Video Object Detectioncited by 12
- 2021Efficient Global-Local Memory for Real-time Instrument Segmentation of Robotic Surgical Videocited by 10
12 most cited of 39 All 39 (JSON)
- 2026Analytical and Convolutional Neural Network-Based Motion-Vector Propagation for Efficient Video Object Detection28 Sep 2026
- 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edge29 Aug 2026
- 2026CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detection28 Jun 2026
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025MVP: Motion Vector Propagation for Zero-Shot Video Object Detection22 Sep 2025
- 2024Spatiotemporal Object Detection for Improved Aerial Vehicle Detection in Traffic Monitoring17 Oct 2024
- 2024Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perception10 Sep 2024
- 2024SSGA-Net: Stepwise Spatial Global-local Aggregation Networks for for Autonomous Driving29 May 2024
- 2024STF: Spatio-Temporal Fusion Module for Improving Video Object Detection16 Feb 2024
- 2023ResQ: Residual Quantization for Video Perception18 Aug 2023
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Frames8 Aug 2023
- 2023Oriented object detection in optical remote sensing images using deep learning: a survey21 Feb 2023
12 newest of 39 All 39 (JSON)