Key-Frame Reasoning with SAM3: Third Place Solution for the MeViS-Text Track of the 8th LSVOS Challenge
Not on the map. Why?
Abstract (arXiv)
This report presents a two-stage, training-free solution for the MeViS-Text track of the 8th LSVOS Challenge. The task requires a model to localize and segment the object specified by a natural-language expression throughout a video. Such expressions often depend on temporal cues, including actions, interactions, directions, and relative positions. Our first stage uses Gemini-3.1 Pro via API to decompose a video-level event into instance-level targets, select a key frame for each target, and generate a discriminative description aligned with that frame. In the second stage, SAM3-agent produces a pixel-level seed mask on the selected frame, and the SAM3 video tracker propagates the mask bidirectionally through the video. Valid instances are grounded and propagated independently before their frame-wise masks are merged. All local SAM3 processing runs on a single NVIDIA GeForce RTX 4090 without task-specific training or model ensembling. Our method ranked third on the challenge test set, obtaining J&F, J, F, N-acc., T-acc., and Final scores of 0.761, 0.7367, 0.7852, 0.8333, 0.9755, and 0.856593, respectively.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 9 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
8 of 9 references.
References · 8
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 228
- 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 100
- 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 35
- 2026Refer-Agent: A Collaborative Multi-Agent System with Reasoning and Reflection for Referring Video Object Segmentationcited by 9
Built on by
Not cited yet.