mlsanityData to 7 Oct 2026

RefVOS: A Closer Look at Referring Expressions for Video Object Segmentation

arXiv 2010.00263 ↗First posted 1 Oct 2020cs.CVcited by 23

Not on the map. Why?

Abstract (arXiv)

The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers. Our work argues that existing benchmarks used for this task are mainly composed of trivial cases, in which referents can be identified with simple phrases. Our analysis relies on a new categorization of the phrases in the DAVIS-2017 and Actor-Action datasets into trivial and non-trivial REs, with the non-trivial REs annotated with seven RE semantic categories. We leverage this data to analyze the results of RefVOS, a novel neural network that obtains competitive results for the task of language-guided image segmentation and state of the art results for language-guided VOS. Our study indicates that the major challenges for the task are related to understanding motion and static actions.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 6; 2023: 6; 2024: 2; 2025: 4; 2026: 2.

23 papers.

Sort:

By area:

  1. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
  2. 2022Language as Queries for Referring Video Object Segmentationcited by 180
  3. 2021End-to-End Referring Video Object Segmentation with Multimodal Transformerscited by 135
  4. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 132
  5. 2023Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentationcited by 54
  6. 2022Towards Robust Referring Image Segmentationcited by 49
  7. 2023RefSAM: Efficiently Adapting Segmenting Anything Model for Referring Video Object Segmentationcited by 24
  8. 2022Modeling Motion with Multi-Modal Features for Text-Based Video Segmentationcited by 18
  9. 2022Video Question Answering with Iterative Video-Text Co-Tokenizationcited by 16
  10. 2022Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overviewcited by 16
  11. 2023Dense Video Object Captioning from Disjoint Supervisioncited by 10
  12. 2024ReferEverything: Towards Segmenting Everything We Can Speak of in Videoscited by 10
11 more
  1. 2023Adversarial Attacks on Video Object Segmentation with Hard Region Discoverycited by 9
  2. 2025MPG-SAM 2: Adapting SAM 2 with Mask Priors and Global Context for Referring Video Object Segmentationcited by 7
  3. 20221st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object Segmentationcited by 5
  4. 2023Bidirectional Correlation-Driven Inter-Frame Interaction Transformer for Referring Video Object Segmentationcited by 5
  5. 2023Fully Transformer-Equipped Architecture for End-to-End Referring Video Object Segmentationcited by 4
  6. 20241st Place Solution for 5th LSVOS Challenge: Referring Video Object Segmentationcited by 2
  7. 2025Image Segmentation with Large Language Models: A Survey with Perspectives for Intelligent Transportation Systemscited by 2
  8. 2021SynthRef: Generation of Synthetic Referring Expressions for Object Segmentationcited by 1
  9. 2025ReferDINO-Plus: 2nd Solution for 4th PVUW MeViS Challenge at CVPR 2025cited by 1
  10. 2025Referring Video Object Segmentation with Cross-Modality Proxy Queriescited by 0
  11. 2026Event-Driven Refresh and Recurrence Memory to Reduce Stale Grounding in Referring Video Object Segmentationcited by 0