The 1st Winner for 5th PVUW MeViS-Text Challenge: Strong MLLMs Meet SAM3 for Referring Video Object Segmentation
Not on the map. Why?
Abstract (arXiv)
This report presents our winning solution to the 5th PVUW MeViS-Text Challenge. The track studies referring video object segmentation under motion-centric language expressions, where the model must jointly understand appearance, temporal behavior, and object interactions. To address this problem, we build a fully training-free pipeline that combines strong multimodal large language models with SAM3. Our method contains three stages. First, Gemini-3.1 Pro decomposes each target event into instance-level grounding targets, selects the frame where the target is most clearly visible, and generates a discriminative description. Second, SAM3-agent produces a precise seed mask on the selected frame, and the official SAM3 tracker propagates the mask through the whole video. Third, a refinement stage uses Qwen3.5-Plus and behavior-level verification to correct ambiguous or semantically inconsistent predictions. Without task-specific fine-tuning, our method ranks first on the PVUW 2026 MeViS-Text test set, achieving a Final score of 0.909064 and a J&F score of 0.7897. The code is available at https://github.com/Moujuruo/MeViSv2_Track_Solution_2026.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 26 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
23 of 26 references.
References · 23
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
- 2019Expectation-Maximization Attention Networks for Semantic Segmentationcited by 147
- 2025Ovis2.5 Technical Reportcited by 103
- 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 76
11 more
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 34
- 2025A Survey on Video Temporal Grounding with Multimodal Large Language Modelcited by 19
- 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentationcited by 16
- 2024PVUW 2024 Challenge on Complex Video Understanding: Methods and Resultscited by 12
- 2026Refer-Agent: A Collaborative Multi-Agent System with Reasoning and Reflection for Referring Video Object Segmentationcited by 7
- 2024R2-Bench: Benchmarking the Robustness of Referring Perception Models under Perturbationscited by 6
- 2025Long-RVOS: A Comprehensive Benchmark for Long-term Referring Video Object Segmentationcited by 6
- 2025PVUW 2025 Challenge Report: Advances in Pixel-level Understanding of Complex Videos in the Wildcited by 5
- 2025ReVSeg: Incentivizing the Reasoning Chain for Video Segmentation with Reinforcement Learningcited by 3
- 2026Training-Free Spatio-temporal Decoupled Reasoning Video Segmentation with Adaptive Object Memorycited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 20254th PVUW MeViS 3rd Place Report: Sa2VA
- 2025The 1st Solution for 4th PVUW MeViS Challenge: Unleashing the Potential of Large Multimodal Models for Referring Video Segmentation
- 20243rd Place Solution for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentation
- 2026Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation
- 2025Enhancing Sa2VA for Referent Video Object Segmentation: 2nd Solution for 7th LSVOS RVOS Track
- 2026Advancing Complex Video Object Segmentation via Tracking-Enhanced Prompt: The 1st Winner for 5th PVUW MOSE Challenge
- 2026AgentRVOS: Reasoning over Object Tracks for Zero-Shot Referring Video Object Segmentation
- 2025The 1st Solution for 7th LSVOS RVOS Track: SaSaSa2VA