mlsanityData to 7 Oct 2026

Find First, Track Next: Decoupling Identification and Propagation in Referring Video Object Segmentation

arXiv 2503.03492 ↗First posted 5 Mar 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Referring video object segmentation aims to segment and track a target object in a video using a natural language prompt. Existing methods typically fuse visual and textual features in a highly entangled manner, processing multi-modal information together to generate per-frame masks. However, this approach often struggles with ambiguous target identification, particularly in scenes with multiple similar objects, and fails to ensure consistent mask propagation across frames. To address these limitations, we introduce FindTrack, an efficient decoupled framework that separates target identification from mask propagation. FindTrack first adaptively selects a key frame by balancing segmentation confidence and vision-text alignment, establishing a robust reference for the target object. This reference is then utilized by a dedicated propagation module to track and segment the object across the entire video. By decoupling these processes, FindTrack effectively reduces ambiguities in target association and enhances segmentation consistency. FindTrack significantly outperforms all existing methods on public benchmarks, demonstrating its superiority.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 49 of its 61 references that are in the map. First posted on arXiv 5 Mar 2025.

Builds on

49 of 61 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Segment Anythingcited by 8,158
  3. 2020End-to-End Object Detection with Transformerscited by 7,384
  4. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  5. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  6. 2022Video Diffusion Modelscited by 2,280
  7. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  8. 2016Modeling Context in Referring Expressionscited by 1,054
  9. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
  10. 2023ModelScope Text-to-Video Technical Reportcited by 651
  11. 2019Video Object Segmentation using Space-Time Memory Networkscited by 436
  12. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
37 more
  1. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  2. 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
  3. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
  4. 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
  5. 2023GRES: Generalized Referring Expression Segmentationcited by 252
  6. 2016Modeling Context Between Objects for Referring Expression Understandingcited by 250
  7. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 239
  8. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
  9. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  10. 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
  11. 2023Putting the Object Back into Video Object Segmentationcited by 182
  12. 2022Language as Queries for Referring Video Object Segmentationcited by 180
  13. 2018Video Object Segmentation with Language Referring Expressionscited by 161
  14. 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
  15. 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 153
  16. 2023Alpha-CLIP: A CLIP Model Focusing on Wherever You Wantcited by 150
  17. 2021End-to-End Referring Video Object Segmentation with Multimodal Transformerscited by 135
  18. 2020Kernelized Memory Network for Video Object Segmentationcited by 111
  19. 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 110
  20. 2021Cross-Modal Progressive Comprehension for Referring Segmentationcited by 102
  21. 2020Learning What to Learn for Video Object Segmentationcited by 89
  22. 2021Full-Duplex Strategy for Video Object Segmentationcited by 78
  23. 2022BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Videocited by 66
  24. 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 63
  25. 2023SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentationcited by 57
  26. 2024Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentationcited by 55
  27. 2023Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentationcited by 54
  28. 2022Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentationcited by 50
  29. 2023Spectrum-guided Multi-granularity Referring Video Object Segmentationcited by 48
  30. 2024SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video Segmentationcited by 43
  31. 2022Treating Motion as Option to Reduce Motion Dependency in Unsupervised Video Object Segmentationcited by 35
  32. 2022Unsupervised Video Object Segmentation via Prototype Memory Networkcited by 30
  33. 2024Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object Segmentationcited by 27
  34. 2023LoSh: Long-Short Text Joint Prediction Network for Referring Video Object Segmentationcited by 23
  35. 2023Guided Slot Attention for Unsupervised Video Object Segmentationcited by 19
  36. 2022Dual Prototype Attention for Unsupervised Video Object Segmentationcited by 14
  37. 2021Pixel-Level Bijective Matching for Video Object Segmentationcited by 11

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.