VOS-Agent: The 1st Place Solution for the 8th LSVOS Challenge (MOSEv2 Track)
Not on the map. Why?
Abstract (arXiv)
Complex video object segmentation requires robust target propagation under severe occlusion, disappearance and reappearance. Although SAM3 provides strong promptable mask propagation, a uniform inference path remains unreliable for tiny targets with insufficient visual evidence and semantic-dominated targets whose identities depend on explicit attributes. To this end, we present VOS-Agent, a collaborative framework that retains SAM3 as the shared dense segmentation module and conditionally activates specialized agents according to target characteristics. A Target Perception and Routing Agent assigns each sequence to a regular, tiny, or semantic-dominated route. Tiny targets are supported by a Visual Tracking Agent through confidence-aware box prompts, while semantic-dominated targets are handled by an MLLM-based Semantic Agent through description-guided localization and candidate verification. On the MOSEv2 test set, VOS-Agent achieves 69.82% on the official J&dotF metric and ranks first in the MOSEv2 Track of the 8th LSVOS Challenge at ECCV 2026.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 14 references that are in the map. First posted on arXiv 13 Aug 2026.
Builds on
11 of 14 references.
References · 11
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2023Putting the Object Back into Video Object Segmentationcited by 182
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 77
- 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 63
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2024SUTrack: Towards Simple and Unified Single Object Trackingcited by 51
- 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 34
- 2025Advancing Complex Video Object Segmentation via Progressive Concept Constructioncited by 24
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Multi-Agent Target-Existence Verification and Learned Mask Geometry Refinement: Winning Report of the MeViS-Text Track at the 8th LSVOS Challenge 2026
- 2026Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation
- 20252nd Place Report of MOSEv2 Challenge 2025: Concept Guided Video Object Segmentation via SeC
- 2026AgentRVOS: Reasoning over Object Tracks for Zero-Shot Referring Video Object Segmentation
- 2025OVSegDT: Segmenting Transformer for Open-Vocabulary Object Goal Navigation
- 2024RMem: Restricted Memory Banks Improve Video Object Segmentation
- 2026Vision Harnessing Agent for Open Ad-hoc Segmentation
- 2026Advancing Complex Video Object Segmentation via Tracking-Enhanced Prompt: The 1st Winner for 5th PVUW MOSE Challenge