mlsanityData to 14 Oct 2026

MLLM-Assisted Audio VOS: A 3rd Place Report for the MeViS-Audio Track, 8th LSVOS Challenge

arXiv 2608.23234 ↗First posted 24 Aug 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

In this technical report, we present a training-free framework for audio-guided video object segmentation, which integrates Multimodal Large Language Models (MLLMs) with SAM-based segmentation models. We decompose the task into several stages and identify suitable foundation models for each stage. Without introducing additional model training or task-specific fine-tuning, our approach leverages the strong multimodal reasoning capabilities of MLLMs to model text-visual correspondence and employs SAM-based models for accurate object mask generation. The proposed framework demonstrates the effectiveness of leveraging foundation models for audio-guided video segmentation and achieves competitive performance in the MeViS-Audio Track of the 8th LSVOS Challenge.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 9 of its 9 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

9 of 9 references.

References · 9

  1. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 234
  2. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 228
  3. 2026Qwen3-ASR Technical Reportcited by 118
  4. 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 66
  5. 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 62
  6. 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 35
  7. 2025MomentSeg: Moment-Centric Sampling for Enhanced Video Pixel Understandingcited by 4
  8. 2025LSVOS 2025 Challenge Report: Recent Advances in Complex Video Object Segmentationcited by 4
  9. 2026Report of the 5th PVUW Challenge: Towards More Diverse Modalities in Pixel-Level Understandingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 20262nd of the 5th PVUW MeViS-Audio Track: ASR-SaSaSa2VA
  2. 2026Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation
  3. 2025SimToken: A Simple Baseline for Referring Audio-Visual Segmentation
  4. 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation
  5. 2025Think Before You Segment: An Object-aware Reasoning Agent for Referring Audio-Visual Segmentation
  6. 2025Segmentation as A Plug-and-Play Capability for Frozen Multimodal LLMs
  7. 2025From Waveforms to Pixels: A Survey on Audio-Visual Segmentation
  8. 2025Towards Omnimodal Expressions and Reasoning in Referring Audio-Visual Segmentation