Learning to Track Object Position through Occlusion
Not on the map. Why?
Abstract (arXiv)
Occlusion is one of the most significant challenges encountered by object detectors and trackers. While both object detection and tracking has received a lot of attention in the past, most existing methods in this domain do not target detecting or tracking objects when they are occluded. However, being able to detect or track an object of interest through occlusion has been a long standing challenge for different autonomous tasks. Traditional methods that employ visual object trackers with explicit occlusion modeling experience drift and make several fundamental assumptions about the data. We propose to address this with a `tracking-by-detection` approach that builds upon the success of region based video object detectors. Our video level object detector uses a novel recurrent computational unit at its core that enables long term propagation of object features even under occlusion. Finally, we compare our approach with existing state-of-the-art video object detectors and show that our approach achieves superior results on a dataset of furniture assembly videos collected from the internet, where small objects like screws, nuts, and bolts often get occluded from the camera viewpoint.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 34 references that are in the map. First posted on arXiv 20 Jun 2021.
Builds on
27 of 34 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2015Fast R-CNNcited by 2,933
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2016YOLO9000: Better, Faster, Strongercited by 1,431
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2016Simple Online and Realtime Trackingcited by 868
15 more
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 579
- 2016R-FCN: Object Detection via Region-based Fully Convolutional Networkscited by 414
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
- 2017Flow-Guided Feature Aggregation for Video Object Detectioncited by 177
- 2017Detect to Track and Track to Detectcited by 131
- 2016Seq-NMS for Video Object Detectioncited by 68
- 2016T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videoscited by 67
- 2017Towards High Performance Video Object Detectioncited by 60
- 2018Object Detection in Video with Spatiotemporal Sampling Networkscited by 57
- 2017Video Object Detection with an Aligned Spatial-Temporal Memorycited by 42
- 2016Object Detection from Video Tubelets with Convolutional Neural Networkscited by 40
- 2016Convolutional Gated Recurrent Networks for Video Segmentationcited by 27
- 2017Object Detection in Videos with Tubelet Proposal Networkscited by 24
- 2018Towards High Performance Video Object Detection for Mobilescited by 9
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 0; 2024: 0; 2025: 1.
2 papers.