mlsanityData to 14 Oct 2026

Objects do not disappear: Video object detection by single-frame object location anticipation

arXiv 2308.04770 ↗First posted 9 Aug 2023cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Objects in videos are typically characterized by continuous smooth motion. We exploit continuous smooth motion in three ways. 1) Improved accuracy by using object motion as an additional source of supervision, which we obtain by anticipating object locations from a static keyframe. 2) Improved efficiency by only doing the expensive feature computations on a small subset of all frames. Because neighboring video frames are often redundant, we only compute features for a single static keyframe and predict object locations in subsequent frames. 3) Reduced annotation cost, where we only annotate the keyframe and use smooth pseudo-motion between keyframes. We demonstrate computational efficiency, annotation efficiency, and improved mean average precision compared to the state-of-the-art on four datasets: ImageNet VID, EPIC KITCHENS-55, YouTube-BoundingBoxes, and Waymo Open dataset. Our source code is available at https://github.com/L-KID/Videoobject-detection-by-location-anticipation.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 63 of its 82 references that are in the map. First posted on arXiv 9 Aug 2023.

Builds on

63 of 82 references.

References · 63

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2017Mask R-CNNcited by 7,277
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  7. 2015Fast R-CNNcited by 2,933
  8. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
  9. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  10. 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
  11. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 537
  12. 2015Unsupervised Learning of Video Representations using LSTMscited by 435
38 more
  1. 2019Tracking without bells and whistlescited by 382
  2. 2020TransTrack: Multiple Object Tracking with Transformercited by 371
  3. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
  4. 2021A Large-Scale Study on Unsupervised Spatiotemporal Representation Learningcited by 214
  5. 2021Anticipative Video Transformercited by 200
  6. 2017Flow-Guided Feature Aggregation for Video Object Detectioncited by 177
  7. 2019Video Representation Learning by Dense Predictive Codingcited by 175
  8. 2020Memory-augmented Dense Predictive Coding for Video Representation Learningcited by 137
  9. 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
  10. 2017Detect to Track and Track to Detectcited by 131
  11. 2020Memory Enhanced Global-Local Aggregation for Video Object Detectioncited by 128
  12. 2019Classifying, Segmenting, and Tracking Object Instances in Video with Mask Propagationcited by 125
  13. 2018Learning to Decompose and Disentangle Representations for Video Predictioncited by 121
  14. 2018ECO: Efficient Convolutional Network for Online Video Understandingcited by 115
  15. 2017YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Videocited by 109
  16. 2018When will you do what? - Anticipating Temporal Occurrences of Activitiescited by 107
  17. 2019Deep Learning in Video Multi-Object Tracking: A Surveycited by 107
  18. 2016Learning to Track at 100 FPS with Deep Regression Networkscited by 89
  19. 2016An Uncertain Future: Forecasting from Static Images using Variational Autoencoderscited by 87
  20. 2019Sequence Level Semantics Aggregation for Video Object Detectioncited by 87
  21. 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
  22. 2019Relation Distillation Networks for Video Object Detectioncited by 77
  23. 2016Seq-NMS for Video Object Detectioncited by 68
  24. 2017Towards High Performance Video Object Detectioncited by 60
  25. 2016Online Real-time Multiple Spatiotemporal Action Localisation and Predictioncited by 57
  26. 2018Object Detection in Video with Spatiotemporal Sampling Networkscited by 57
  27. 2021Temporal RoI Align for Video Object Recognitioncited by 44
  28. 2017Video Object Detection with an Aligned Spatial-Temporal Memorycited by 42
  29. 2016Object Detection from Video Tubelets with Convolutional Neural Networkscited by 40
  30. 2021TF-Blender: Temporal Feature Blender for Video Object Detectioncited by 37
  31. 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 29
  32. 2018Optimizing Video Object Detection via a Scale-Time Latticecited by 25
  33. 2017Im2Flow: Motion Hallucination from Static Images for Action Recognitioncited by 24
  34. 2021No frame left behind: Full Video Action Recognitioncited by 24
  35. 2022Motion-Focused Contrastive Learning of Video Representationscited by 23
  36. 2020STINet: Spatio-Temporal-Interactive Network for Pedestrian Detection and Trajectory Predictioncited by 22
  37. 2016Spot On: Action Localization from Pointly-Supervised Proposalscited by 17
  38. 2022PTSEFormer: Progressive Temporal-Spatial Enhanced TransFormer Towards Video Object Detectioncited by 17

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 2.

7 papers.

  1. 2025DIFFVSGG: Diffusion-Driven Online Video Scene Graph Generationcited by 11
  2. 2024Anatomizing Deep Learning Inference in Web Browserscited by 6
  3. 2024Practical Video Object Detection via Feature Selection and Aggregationcited by 5
  4. 2024Beyond Boxes: Mask-Guided Spatio-Temporal Feature Aggregation for Video Object Detectioncited by 1
  5. 2025Contrastive Learning through Auxiliary Branch for Video Object Detectioncited by 0
  6. 2026MR2-ByteTrack: CNN and Transformer-based Video Object Detection for AI-augmented Embedded Vision Sensor Nodescited by 0
  7. 2026Albireo: Adaptive, Energy-Efficient Inference Framework for Video Object Detection on the Edgecited by 0