mlsanityData to 7 Oct 2026

The 1st Winner for 5th PVUW MeViS-Text Challenge: Strong MLLMs Meet SAM3 for Referring Video Object Segmentation

arXiv 2604.00404 ↗First posted 1 Apr 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

This report presents our winning solution to the 5th PVUW MeViS-Text Challenge. The track studies referring video object segmentation under motion-centric language expressions, where the model must jointly understand appearance, temporal behavior, and object interactions. To address this problem, we build a fully training-free pipeline that combines strong multimodal large language models with SAM3. Our method contains three stages. First, Gemini-3.1 Pro decomposes each target event into instance-level grounding targets, selects the frame where the target is most clearly visible, and generates a discriminative description. Second, SAM3-agent produces a precise seed mask on the selected frame, and the official SAM3 tracker propagates the mask through the whole video. Third, a refinement stage uses Qwen3.5-Plus and behavior-level verification to correct ambiguous or semantically inconsistent predictions. Without task-specific fine-tuning, our method ranks first on the PVUW 2026 MeViS-Text test set, achieving a Final score of 0.909064 and a J&F score of 0.7897. The code is available at https://github.com/Moujuruo/MeViSv2_Track_Solution_2026.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 26 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

23 of 26 references.

References · 23

  1. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  4. 2025SAM 3: Segment Anything with Conceptscited by 835
  5. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  6. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
  7. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  8. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
  9. 2019Expectation-Maximization Attention Networks for Semantic Segmentationcited by 147
  10. 2025Ovis2.5 Technical Reportcited by 103
  11. 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
  12. 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 76
11 more
  1. 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
  2. 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 34
  3. 2025A Survey on Video Temporal Grounding with Multimodal Large Language Modelcited by 19
  4. 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentationcited by 16
  5. 2024PVUW 2024 Challenge on Complex Video Understanding: Methods and Resultscited by 12
  6. 2026Refer-Agent: A Collaborative Multi-Agent System with Reasoning and Reflection for Referring Video Object Segmentationcited by 7
  7. 2024R2-Bench: Benchmarking the Robustness of Referring Perception Models under Perturbationscited by 6
  8. 2025Long-RVOS: A Comprehensive Benchmark for Long-term Referring Video Object Segmentationcited by 6
  9. 2025PVUW 2025 Challenge Report: Advances in Pixel-level Understanding of Complex Videos in the Wildcited by 5
  10. 2025ReVSeg: Incentivizing the Reasoning Chain for Video Segmentation with Reinforcement Learningcited by 3
  11. 2026Training-Free Spatio-temporal Decoupled Reasoning Video Segmentation with Adaptive Object Memorycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 20254th PVUW MeViS 3rd Place Report: Sa2VA
  2. 2025The 1st Solution for 4th PVUW MeViS Challenge: Unleashing the Potential of Large Multimodal Models for Referring Video Segmentation
  3. 20243rd Place Solution for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentation
  4. 2026Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation
  5. 2025Enhancing Sa2VA for Referent Video Object Segmentation: 2nd Solution for 7th LSVOS RVOS Track
  6. 2026Advancing Complex Video Object Segmentation via Tracking-Enhanced Prompt: The 1st Winner for 5th PVUW MOSE Challenge
  7. 2026AgentRVOS: Reasoning over Object Tracks for Zero-Shot Referring Video Object Segmentation
  8. 2025The 1st Solution for 7th LSVOS RVOS Track: SaSaSa2VA