Find First, Track Next: Decoupling Identification and Propagation in Referring Video Object Segmentation
Not on the map. Why?
Abstract (arXiv)
Referring video object segmentation aims to segment and track a target object in a video using a natural language prompt. Existing methods typically fuse visual and textual features in a highly entangled manner, processing multi-modal information together to generate per-frame masks. However, this approach often struggles with ambiguous target identification, particularly in scenes with multiple similar objects, and fails to ensure consistent mask propagation across frames. To address these limitations, we introduce FindTrack, an efficient decoupled framework that separates target identification from mask propagation. FindTrack first adaptively selects a key frame by balancing segmentation confidence and vision-text alignment, establishing a robust reference for the target object. This reference is then utilized by a dedicated propagation module to track and segment the object across the entire video. By decoupling these processes, FindTrack effectively reduces ambiguities in target association and enhances segmentation consistency. FindTrack significantly outperforms all existing methods on public benchmarks, demonstrating its superiority.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 49 of its 61 references that are in the map. First posted on arXiv 5 Mar 2025.
Builds on
49 of 61 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2022Video Diffusion Modelscited by 2,280
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2019Video Object Segmentation using Space-Time Memory Networkscited by 436
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
37 more
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
- 2021CRIS: CLIP-Driven Referring Image Segmentationcited by 353
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
- 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
- 2023GRES: Generalized Referring Expression Segmentationcited by 252
- 2016Modeling Context Between Objects for Referring Expression Understandingcited by 250
- 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 239
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
- 2023Putting the Object Back into Video Object Segmentationcited by 182
- 2022Language as Queries for Referring Video Object Segmentationcited by 180
- 2018Video Object Segmentation with Language Referring Expressionscited by 161
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 153
- 2023Alpha-CLIP: A CLIP Model Focusing on Wherever You Wantcited by 150
- 2021End-to-End Referring Video Object Segmentation with Multimodal Transformerscited by 135
- 2020Kernelized Memory Network for Video Object Segmentationcited by 111
- 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 110
- 2021Cross-Modal Progressive Comprehension for Referring Segmentationcited by 102
- 2020Learning What to Learn for Video Object Segmentationcited by 89
- 2021Full-Duplex Strategy for Video Object Segmentationcited by 78
- 2022BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Videocited by 66
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 63
- 2023SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentationcited by 57
- 2024Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentationcited by 55
- 2023Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentationcited by 54
- 2022Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentationcited by 50
- 2023Spectrum-guided Multi-granularity Referring Video Object Segmentationcited by 48
- 2024SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video Segmentationcited by 43
- 2022Treating Motion as Option to Reduce Motion Dependency in Unsupervised Video Object Segmentationcited by 35
- 2022Unsupervised Video Object Segmentation via Prototype Memory Networkcited by 30
- 2024Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object Segmentationcited by 27
- 2023LoSh: Long-Short Text Joint Prediction Network for Referring Video Object Segmentationcited by 23
- 2023Guided Slot Attention for Unsupervised Video Object Segmentationcited by 19
- 2022Dual Prototype Attention for Unsupervised Video Object Segmentationcited by 14
- 2021Pixel-Level Bijective Matching for Video Object Segmentationcited by 11
Built on by
Citing papers per year: 2025: 3.
3 papers.