mlsanityData to 7 Oct 2026

2nd Place Solution for MOSE Track in CVPR 2024 PVUW workshop: Complex Video Object Segmentation

arXiv 2406.08192 ↗First posted 12 Jun 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Complex video object segmentation serves as a fundamental task for a wide range of downstream applications such as video editing and automatic data annotation. Here we present the 2nd place solution in the MOSE track of PVUW 2024. To mitigate problems caused by tiny objects, similar objects and fast movements in MOSE. We use instance segmentation to generate extra pretraining data from the valid and test set of MOSE. The segmented instances are combined with objects extracted from COCO to augment the training data and enhance semantic representation of the baseline model. Besides, motion blur is added during training to increase robustness against image blur induced by motion. Finally, we apply test time augmentation (TTA) and memory strategy to the inference stage. Our method ranked 2nd in the MOSE track of PVUW 2024, with a J of 0.8007, a F of 0.8683 and a J&F of 0.8345.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 12 Jun 2024.

Builds on

19 of 26 references.

References · 19

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  3. 2019Video Object Segmentation using Space-Time Memory Networkscited by 436
  4. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
  5. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  6. 2016One-Shot Video Object Segmentationcited by 233
  7. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
  8. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  9. 2023Tracking Anything with Decoupled Video Segmentationcited by 197
  10. 2023Putting the Object Back into Video Object Segmentationcited by 182
  11. 2019FSS-1000: A 1000-Class Dataset for Few-Shot Segmentationcited by 160
  12. 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
7 more
  1. 2016Learning Video Object Segmentation from Static Imagescited by 151
  2. 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
  3. 2020CascadePSP: Toward Class-Agnostic and Very High-Resolution Segmentation via Global and Local Refinementcited by 113
  4. 2019Towards High-Resolution Salient Object Detectioncited by 92
  5. 2017FusionSeg: Learning to combine motion and appearance for fully automatic segmention of generic objects in videoscited by 77
  6. 2022BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Videocited by 66
  7. 2015Instance-Level Segmentation for Autonomous Driving with Deep Densely Connected MRFscited by 32

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.