Object Detection in Video with Spatiotemporal Sampling Networks
Not on the map. Why?
Abstract (arXiv)
We propose a Spatiotemporal Sampling Network (STSN) that uses deformable convolutions across time for object detection in videos. Our STSN performs object detection in a video frame by learning to spatially sample features from the adjacent frames. This naturally renders the approach robust to occlusion or motion blur in individual frames. Our framework does not require additional supervision, as it optimizes sampling locations directly with respect to object detection performance. Our STSN outperforms the state-of-the-art on the ImageNet VID dataset and compared to prior video object detection methods it uses a simpler design, and does not require optical flow data for training.
Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 19; 2023: 6; 2024: 4; 2025: 4; 2026: 2.
57 papers.
Sort:
By area:
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 120
- 2021Crossover Learning for Fast Online Video Instance Segmentationcited by 83
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 2021Video Instance Segmentation with a Propose-Reduce Paradigmcited by 74
- 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
- 2022MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detectioncited by 65
- 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
- 2021Temporal RoI Align for Video Object Recognitioncited by 44
- 2021Spatial Feature Calibration and Temporal Fusion for Effective One-stage Video Instance Segmentationcited by 42
- 2021End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 40
38 more
- 2022Monocular 3D Object Detection with Depth from Motioncited by 38
- 2021TF-Blender: Temporal Feature Blender for Video Object Detectioncited by 37
- 2022TubeFormer-DeepLab: Video Mask Transformercited by 35
- 2021From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detectioncited by 24
- 2021D^2Conv3D: Dynamic Dilated Convolutions for Object Segmentation in Videoscited by 20
- 2021FDAN: Flow-guided Deformable Alignment Network for Video Super-Resolutioncited by 19
- 2021Detecting and Tracking Small and Dense Moving Objects in Satellite Videos: A Benchmarkcited by 17
- 2023Real-Time Idling Vehicles Detection using Combined Audio-Visual Deep Learningcited by 17
- 2021Multi-frame Collaboration for Effective Endoscopic Video Polyp Detection via Spatial-Temporal Feature Transformationcited by 15
- 2024Color Shift Estimation-and-Correction for Image Enhancementcited by 14
- 2021Improving Video Instance Segmentation via Temporal Pyramid Routingcited by 13
- 2022STC: Spatio-Temporal Contrastive Learning for Video Instance Segmentationcited by 13
- 2024MAMBA: Multi-level Aggregation via Memory Bank for Video Object Detectioncited by 13
- 2022QueryProp: Object Query Propagation for High-Performance Video Object Detectioncited by 12
- 2022LongShortNet: Exploring Temporal and Semantic Features Fusion in Streaming Perceptioncited by 11
- 2021Boggart: Towards General-Purpose Acceleration of Retrospective Video Analyticscited by 10
- 2022A recurrent CNN for online object detection on raw radar framescited by 9
- 2022Recent Advances in Embedding Methods for Multi-Object Tracking: A Surveycited by 8
- 2022Instance As Identity: A Generic Online Paradigm for Video Instance Segmentationcited by 8
- 2021Few-Shot Video Object Detectioncited by 7
- 2023Objects do not disappear: Video object detection by single-frame object location anticipationcited by 7
- 2022BoxMask: Revisiting Bounding Box Supervision for Video Object Detectioncited by 6
- 2021Real-Time and Accurate Object Detection in Compressed Video by Long Short-term Feature Aggregationcited by 5
- 2021Application of Ghost-DeblurGAN to Fiducial Marker Detectioncited by 4
- 2022Flow Guidance Deformable Compensation Network for Video Frame Interpolationcited by 4
- 2023Identity-Consistent Aggregation for Video Object Detectioncited by 3
- 2021Learning to Track Object Position through Occlusioncited by 2
- 2021FFAVOD: Feature Fusion Architecture for Video Object Detectioncited by 2
- 2022Explore Spatio-temporal Aggregation for Insubstantial Object Detection: Benchmark Dataset and Baselinecited by 2
- 2022DGFont++: Robust Deformable Generative Networks for Unsupervised Font Generationcited by 2
- 2021When Few-Shot Learning Meets Video Object Detectioncited by 1
- 2023High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensationcited by 1
- 2023Object Detection Difficulty: Suppressing Over-aggregation for Faster and Better Video Object Detectioncited by 1
- 2024Spb3DTracker: A Robust LiDAR-Based Person Tracker for Noisy Environmentcited by 1
- 2025Gaseous Object Detectioncited by 1
- 2025TGBFormer: Transformer-GraphFormer Blender Network for Video Object Detectioncited by 1
- 2022Human Instance Segmentation and Tracking via Data Association and Single-stage Detectorcited by 0
- 2022Representation Recycling for Streaming Video Analysiscited by 0
50 most cited of 57 All 57 (JSON)
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026A comprehensive overview of deep learning models for object detection from videos/images21 Jan 2026
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025Contrastive Learning through Auxiliary Branch for Video Object Detection28 Aug 2025
- 2025TGBFormer: Transformer-GraphFormer Blender Network for Video Object Detection18 Mar 2025
- 2025Gaseous Object Detection18 Feb 2025
- 2024Spb3DTracker: A Robust LiDAR-Based Person Tracker for Noisy Environment12 Aug 2024
- 2024Color Shift Estimation-and-Correction for Image Enhancement28 May 2024
- 2024STF: Spatio-Temporal Fusion Module for Improving Video Object Detection16 Feb 2024
- 2024MAMBA: Multi-level Aggregation via Memory Bank for Video Object Detection18 Jan 2024
- 2023Object Detection Difficulty: Suppressing Over-aggregation for Faster and Better Video Object Detection22 Aug 2023
- 2023High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation22 Aug 2023
38 more
- 2023Identity-Consistent Aggregation for Video Object Detection15 Aug 2023
- 2023Objects do not disappear: Video object detection by single-frame object location anticipation9 Aug 2023
- 2023Real-Time Idling Vehicles Detection using Combined Audio-Visual Deep Learning23 May 2023
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformation7 Apr 2023
- 2022DGFont++: Robust Deformable Generative Networks for Unsupervised Font Generation30 Dec 2022
- 2022A recurrent CNN for online object detection on raw radar frames21 Dec 2022
- 2022Flow Guidance Deformable Compensation Network for Video Frame Interpolation22 Nov 2022
- 2022Unifying Tracking and Image-Video Object Detection20 Nov 2022
- 2022LongShortNet: Exploring Temporal and Semantic Features Fusion in Streaming Perception27 Oct 2022
- 2022BoxMask: Revisiting Bounding Box Supervision for Video Object Detection12 Oct 2022
- 2022Instance As Identity: A Generic Online Paradigm for Video Instance Segmentation5 Aug 2022
- 2022Monocular 3D Object Detection with Depth from Motion26 Jul 2022
- 2022QueryProp: Object Query Propagation for High-Performance Video Object Detection22 Jul 2022
- 2022Explore Spatio-temporal Aggregation for Insubstantial Object Detection: Benchmark Dataset and Baseline23 Jun 2022
- 2022TubeFormer-DeepLab: Video Mask Transformer30 May 2022
- 2022Recent Advances in Embedding Methods for Multi-Object Tracking: A Survey22 May 2022
- 2022MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detection12 May 2022
- 2022RADNet: A Deep Neural Network Model for Robust Perception in Moving Autonomous Systems30 Apr 2022
- 2022Representation Recycling for Streaming Video Analysis28 Apr 2022
- 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Network22 Apr 2022
- 2022Human Instance Segmentation and Tracking via Data Association and Single-stage Detector31 Mar 2022
- 2022STC: Spatio-Temporal Contrastive Learning for Video Instance Segmentation8 Feb 2022
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformers13 Jan 2022
- 2021Detecting and Tracking Small and Dense Moving Objects in Satellite Videos: A Benchmark25 Nov 2021
- 2021D^2Conv3D: Dynamic Dilated Convolutions for Object Segmentation in Videos15 Nov 2021
- 2021FFAVOD: Feature Fusion Architecture for Video Object Detection15 Sep 2021
- 2021Temporal RoI Align for Video Object Recognition8 Sep 2021
- 2021Application of Ghost-DeblurGAN to Fiducial Marker Detection8 Sep 2021
- 2021TF-Blender: Temporal Feature Blender for Video Object Detection12 Aug 2021
- 2021From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detection30 Jul 2021
- 2021Improving Video Instance Segmentation via Temporal Pyramid Routing28 Jul 2021
- 2021Multi-frame Collaboration for Effective Endoscopic Video Polyp Detection via Spatial-Temporal Feature Transformation8 Jul 2021
- 2021Boggart: Towards General-Purpose Acceleration of Retrospective Video Analytics21 Jun 2021
- 2021Learning to Track Object Position through Occlusion20 Jun 2021
- 2021End-to-End Video Object Detection with Spatial-Temporal Transformers23 May 2021
- 2021FDAN: Flow-guided Deformable Alignment Network for Video Super-Resolution12 May 2021
- 2021Few-Shot Video Object Detection30 Apr 2021
- 2021Crossover Learning for Fast Online Video Instance Segmentation13 Apr 2021
50 newest of 57 All 57 (JSON)
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 120
- 2021Crossover Learning for Fast Online Video Instance Segmentationcited by 83
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 2021Video Instance Segmentation with a Propose-Reduce Paradigmcited by 74
- 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
- 2022MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detectioncited by 65
- 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
- 2021Temporal RoI Align for Video Object Recognitioncited by 44
- 2021Spatial Feature Calibration and Temporal Fusion for Effective One-stage Video Instance Segmentationcited by 42
- 2021End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 40
12 most cited of 56 All 56 (JSON)
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026A comprehensive overview of deep learning models for object detection from videos/images21 Jan 2026
- 2025Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks2 Dec 2025
- 2025Contrastive Learning through Auxiliary Branch for Video Object Detection28 Aug 2025
- 2025TGBFormer: Transformer-GraphFormer Blender Network for Video Object Detection18 Mar 2025
- 2025Gaseous Object Detection18 Feb 2025
- 2024Spb3DTracker: A Robust LiDAR-Based Person Tracker for Noisy Environment12 Aug 2024
- 2024Color Shift Estimation-and-Correction for Image Enhancement28 May 2024
- 2024STF: Spatio-Temporal Fusion Module for Improving Video Object Detection16 Feb 2024
- 2023Object Detection Difficulty: Suppressing Over-aggregation for Faster and Better Video Object Detection22 Aug 2023
- 2023High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation22 Aug 2023
- 2023Identity-Consistent Aggregation for Video Object Detection15 Aug 2023
12 newest of 56 All 56 (JSON)