Agreement-Based Audio-Visual Segmentation:Champion Report for the MeViS-Audio Track in the 8th LSVOS Challenge
Not on the map. Why?
Abstract (arXiv)
The MeViS-Audio track asks a system to segment the objects described by a spoken motion expression throughout a video and to return empty masks when the described target is absent. We present a simple staged solution. Qwen3-ASR first converts speech into text. Several video mask tracks are then produced with complementary grounding and segmentation models. Instead of trusting a single prediction, we select the track that has the highest average mask agreement with the other candidates. A small set of explicit direction, count, and plural rules corrects queries that require more than ordinary single-object tracking. Finally, a video-level classifier combines visual, audio-visual, and within-video query scores to decide whether any target is present. The submitted system obtains 0.5952 J &F, 0.7931 no-target accuracy, 0.9205 target accuracy, and a final score of 0.769589. The challenge organizers notified our team that this result ranked first in the track.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 14 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
14 of 14 references.
References · 14
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2025Qwen2.5-Omni Technical Reportcited by 704
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
- 2026Qwen3-ASR Technical Reportcited by 105
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 34
- 2026MolmoPoint: Better Pointing for VLMs with Grounding Tokenscited by 11
- 2025The 1st Solution for 7th LSVOS RVOS Track: SaSaSa2VAcited by 7
- 20263rd Place of MeViS-Audio Track of the 5th PVUW: VIRST-Audiocited by 1
2 more
- 2026APRVOS: 1st Place Winner of 5th PVUW MeViS-Audio Trackcited by 1
- 20262nd of the 5th PVUW MeViS-Audio Track: ASR-SaSaSa2VAcited by 1
Built on by
Not cited yet.