mlsanityData to 14 Oct 2026

Re-Prompting SAM 3 via Object Retrieval: 3rd of the 5th PVUW MOSE Track

arXiv 2603.23788 ↗First posted 24 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This technical report explores the MOSEv2 track of the PVUW 2026 Challenge, which targets complex semi-supervised video object segmentation. Built on SAM~3, we develop an automatic re-prompting framework to improve robustness under target disappearance and reappearance, severe transformation, and strong same-category distractors. Our method first applies the SAM~3 detector to later frames to identify same-category object candidates, and then performs DINOv3-based object-level matching with a transformation-aware target feature pool to retrieve reliable target anchors. These anchors are injected back into the SAM~3 tracker together with the first-frame mask, enabling multi-anchor propagation rather than relying solely on the initial prompt. This simple directly benefits several core challenges of MOSEv2. Our solution achieves a J&F of 51.17% on the test set, ranking 3rd in the MOSEv2 track.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 19 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

14 of 19 references.

References · 14

  1. 2023Segment Anythingcited by 8,234
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  3. 2025SAM 3: Segment Anything with Conceptscited by 906
  4. 2019Video Object Segmentation using Space-Time Memory Networkscited by 438
  5. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
  6. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 234
  7. 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 80
  8. 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 66
  9. 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 62
  10. 2023XMem++: Production-level Video Segmentation From Few Annotated Framescited by 53
  11. 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
  12. 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 35
2 more
  1. 2025Advancing Complex Video Object Segmentation via Progressive Concept Constructioncited by 26
  2. 2019BubbleNets: Learning to Select the Guidance Frame in Video Object Segmentation by Deep Sorting Framescited by 14

Built on by

Not cited yet.