Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation
Not on the map. Why?
Abstract (arXiv)
Language-referred audio-visual segmentation (Ref-AVS) aims to segment target objects described by natural language by jointly reasoning over video, audio, and text. Beyond generating segmentation masks, providing rich and interpretable diagnoses of mask quality remains largely underexplored. In this work, we introduce Mask Quality Assessment in the Ref-AVS context (MQA-RefAVS), a new task that evaluates the quality of candidate segmentation masks without relying on ground-truth annotations as references at inference time. Given audio-visual-language inputs and each provided segmentation mask, the task requires estimating its IoU with the unobserved ground truth, identifying the corresponding error type, and recommending an actionable quality-control decision. To support this task, we construct MQ-RAVSBench, a benchmark featuring diverse and representative mask error modes that span both geometric and semantic issues. We further propose MQ-Auditor, a multimodal large language model (MLLM)-based auditor that explicitly reasons over multimodal cues and mask information to produce quantitative and qualitative mask quality assessments. Extensive experiments demonstrate that MQ-Auditor outperforms strong open-source and commercial MLLMs and can be integrated with existing Ref-AVS systems to detect segmentation failures and support downstream segmentation improvement. Data and codes will be released at https://github.com/jasongief/MQA-RefAVS.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 69 of its 84 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
69 of 84 references.
References · 69
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Segment Anythingcited by 8,234
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2020Image Segmentation Using Deep Learning: A Surveycited by 660
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
38 more
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
- 2021Mask2Former for Video Instance Segmentationcited by 171
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2022Audio-Visual Segmentationcited by 151
- 2020Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsingcited by 146
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
- 2023Audio-Visual Segmentation with Semanticscited by 75
- 2025Detect Anything via Next Point Predictioncited by 73
- 2019Dual-modality seq2seq network for audio-visual event localizationcited by 72
- 2021Positive Sample Propagation along the Audio-Visual Event Linecited by 69
- 2023AVSegFormer: Audio-Visual Segmentation with Transformercited by 68
- 2023CATR: Combinatorial-Dependence Audio-Queried Transformer for Audio-Visual Video Segmentationcited by 53
- 2022Contrastive Positive Sample Propagation along the Audio-Visual Event Linecited by 50
- 2023Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baselinecited by 46
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2023Multimodal Variational Auto-encoder based Audio-Visual Segmentationcited by 38
- 2024TAVGBench: Benchmarking Text to Audible-Video Generationcited by 34
- 2024Ref-AVS: Refer and Segment Objects in Audio-Visual Scenescited by 33
- 2022Joint-Modal Label Denoising for Weakly-Supervised Audio-Visual Video Parsingcited by 29
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
- 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessmentcited by 28
- 2024Towards Open-Vocabulary Audio-Visual Event Localizationcited by 26
- 2024Label-anticipated Event Disentanglement for Audio-Visual Video Parsingcited by 25
- 2024Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentationcited by 23
- 2025Multimodal Referring Segmentation: A Surveycited by 22
- 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 22
- 2023Audio-Visual Instance Segmentationcited by 21
- 2024Advancing Weakly-Supervised Audio-Visual Video Parsing via Segment-wise Pseudo Labelingcited by 20
- 2023Object-aware Adaptive-Positivity Learning for Audio-Visual Question Answeringcited by 19
- 2023Fine-grained Audible Video Descriptioncited by 18
- 2023Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parsercited by 18
- 2025Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperationcited by 18
- 2025SAM2-LOVE: Segment Anything Model 2 in Language-aided Audio-Visual Scenescited by 17
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026MLLM-Assisted Audio VOS: A 3rd Place Report for the MeViS-Audio Track, 8th LSVOS Challenge
- 2024Can Textual Semantics Mitigate Sounding Object Segmentation Preference?
- 2026ReflexTrack: A Feedback-Driven Agent for Training-Free Referring Video Object Segmentation
- 2025Segmentation as A Plug-and-Play Capability for Frozen Multimodal LLMs
- 2025Refer to Any Segmentation Mask Group With Vision-Language Prompts
- 2026X2SAM: Any Segmentation in Images and Videos
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation
- 2025R2SM: Referring and Reasoning for Selective Masks