2nd Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentation
Not on the map. Why?
Abstract (arXiv)
Motion Expression guided Video Segmentation is a challenging task that aims at segmenting objects in the video based on natural language expressions with motion descriptions. Unlike the previous referring video object segmentation (RVOS), this task focuses more on the motion in video content for language-guided video object segmentation, requiring an enhanced ability to model longer temporal, motion-oriented vision-language data. In this report, based on the RVOS methods, we successfully introduce mask information obtained from the video instance segmentation model as preliminary information for temporal enhancement and employ SAM for spatial refinement. Finally, our method achieved a score of 49.92 J &F in the validation phase and 54.20 J &F in the test phase, securing the final ranking of 2nd in the MeViS Track at the CVPR 2024 PVUW Challenge.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 19 references that are in the map. First posted on arXiv 20 Jun 2024.
Builds on
17 of 19 references.
References · 17
- 2023Segment Anythingcited by 8,158
- 2019Video Instance Segmentationcited by 391
- 2023Segment Anything in High Qualitycited by 373
- 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 239
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
- 2020Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentationcited by 204
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2022Language as Queries for Referring Video Object Segmentationcited by 180
- 2018Video Object Segmentation with Language Referring Expressionscited by 161
- 2021End-to-End Referring Video Object Segmentation with Multimodal Transformerscited by 135
- 2020Referring Image Segmentation via Cross-Modal Progressive Comprehensioncited by 131
- 2023DVIS: Decoupled Video Instance Segmentation Frameworkcited by 77
5 more
- 2023General Object Foundation Model for Images and Videos at Scalecited by 71
- 2023OnlineRefer: A Simple Online Baseline for Referring Video Object Segmentationcited by 62
- 2023SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentationcited by 57
- 2023Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentationcited by 54
- 2023Spectrum-guided Multi-granularity Referring Video Object Segmentationcited by 48
Built on by
Citing papers per year: 2024: 2.
2 papers.