mlsanityData to 14 Oct 2026

The Second Place Solution for The 4th Large-scale Video Object Segmentation Challenge--Track 3: Referring Video Object Segmentation

arXiv 2206.12035 ↗First posted 24 Jun 2022cs.CV cs.MMcited by 3

Not on the map. Why?

Abstract (arXiv)

The referring video object segmentation task (RVOS) aims to segment object instances in a given video referred by a language expression in all video frames. Due to the requirement of understanding cross-modal semantics within individual instances, this task is more challenging than the traditional semi-supervised video object segmentation where the ground truth object masks in the first frame are given. With the great achievement of Transformer in object detection and object segmentation, RVOS has been made remarkable progress where ReferFormer achieved the state-of-the-art performance. In this work, based on the strong baseline framework--ReferFormer, we propose several tricks to boost further, including cyclical learning rates, semi-supervised approach, and test-time augmentation inference. The improved ReferFormer ranks 2nd place on CVPR2022 Referring Youtube-VOS Challenge.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 21 of its 22 references that are in the map. First posted on arXiv 24 Jun 2022.

Builds on

21 of 22 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  7. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  8. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  9. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
  10. 2021Video Swin Transformercited by 1,091
  11. 2016Modeling Context in Referring Expressionscited by 1,063
  12. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 904
9 more
  1. 2015Cyclical Learning Rates for Training Neural Networkscited by 629
  2. 2020End-to-End Video Instance Segmentation with Transformerscited by 443
  3. 2020MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformerscited by 355
  4. 2021Associating Objects with Transformers for Video Object Segmentationcited by 226
  5. 2022Language as Queries for Referring Video Object Segmentationcited by 182
  6. 2021End-to-End Referring Video Object Segmentation with Multimodal Transformerscited by 135
  7. 2021Video Instance Segmentation using Inter-Frame Communication Transformerscited by 105
  8. 2022Local-Global Context Aware Transformer for Language-Guided Video Segmentationcited by 41
  9. 2020AinnoSeg: Panoramic Segmentation with High Perfomancecited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.