mlsanityData to 7 Oct 2026

Accelerating Video Object Segmentation with Compressed Video

arXiv 2107.12192 ↗First posted 26 Jul 2021cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

We propose an efficient plug-and-play acceleration framework for semi-supervised video object segmentation by exploiting the temporal redundancies in videos presented by the compressed bitstream. Specifically, we propose a motion vector-based warping method for propagating segmentation masks from keyframes to other frames in a bi-directional and multi-hop manner. Additionally, we introduce a residual-based correction module that can fix wrongly propagated segmentation masks from noisy or erroneous motion vectors. Our approach is flexible and can be added on top of several existing video object segmentation algorithms. We achieved highly competitive results on DAVIS17 and YouTube-VOS on various base models with substantial speed-ups of up to 3.5X with minor drops in accuracy.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 26 of its 41 references that are in the map. First posted on arXiv 26 Jul 2021.

Builds on

26 of 41 references.

References · 26

  1. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  2. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  3. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
  4. 2019Video Object Segmentation using Space-Time Memory Networkscited by 436
  5. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  6. 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
  7. 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
  8. 2016Deep Feature Flow for Video Recognitioncited by 186
  9. 2016Learning Video Object Segmentation from Static Imagescited by 151
  10. 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
  11. 2020Kernelized Memory Network for Video Object Segmentationcited by 111
  12. 2017Online Adaptation of Convolutional Neural Networks for Video Object Segmentationcited by 109
14 more
  1. 2017Compressed Video Action Recognitioncited by 102
  2. 2017Video Object Segmentation Without Temporal Informationcited by 93
  3. 2017SegFlow: Joint Learning for Video Object Segmentation and Optical Flowcited by 92
  4. 2018PReMVOS: Proposal-generation, Refinement and Merging for Video Object Segmentationcited by 81
  5. 2020Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integrationcited by 81
  6. 2018Accel: A Corrective Fusion Network for Efficient Semantic Segmentation on Videocited by 78
  7. 2020Learning Fast and Robust Target Models for Video Object Segmentationcited by 76
  8. 2021SwiftNet: Real-time Video Object Segmentationcited by 67
  9. 2018Low-Latency Video Semantic Segmentationcited by 61
  10. 2020A Transductive Approach for Video Object Segmentationcited by 55
  11. 2019Video Generation from Single Semantic Label Mapcited by 54
  12. 2020State-Aware Tracker for Real-Time Video Object Segmentationcited by 54
  13. 2018Fast Object Detection in Compressed Videocited by 33
  14. 2019Efficient Video Semantic Segmentation with Labels Propagation and Refinementcited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 5; 2024: 1; 2025: 0; 2026: 2.

10 papers.

  1. 2023Putting the Object Back into Video Object Segmentationcited by 182
  2. 2023You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videoscited by 41
  3. 2022Look Before You Match: Instance Understanding Matters in Video Object Segmentationcited by 33
  4. 2023Mask Propagation for Efficient Video Semantic Segmentationcited by 26
  5. 2022Region Aware Video Object Segmentation with Deep Motion Modelingcited by 18
  6. 2023MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillationcited by 16
  7. 2023MVFlow: Deep Optical Flow Estimation of Compressed Videos with Motion Vector Priorcited by 7
  8. 2026AdaCodec: A Predictive Visual Code for Video MLLMscited by 6
  9. 2024Deep video representation learning: a surveycited by 4
  10. 2026MVTrack: Ultrafast Appearance-Free Moving Object Tracking from Compressed Bitstreamscited by 0