mlsanityData to 14 Oct 2026

Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation

arXiv 2602.03892 ↗First posted 3 Feb 2026cs.CV cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Language-referred audio-visual segmentation (Ref-AVS) aims to segment target objects described by natural language by jointly reasoning over video, audio, and text. Beyond generating segmentation masks, providing rich and interpretable diagnoses of mask quality remains largely underexplored. In this work, we introduce Mask Quality Assessment in the Ref-AVS context (MQA-RefAVS), a new task that evaluates the quality of candidate segmentation masks without relying on ground-truth annotations as references at inference time. Given audio-visual-language inputs and each provided segmentation mask, the task requires estimating its IoU with the unobserved ground truth, identifying the corresponding error type, and recommending an actionable quality-control decision. To support this task, we construct MQ-RAVSBench, a benchmark featuring diverse and representative mask error modes that span both geometric and semantic issues. We further propose MQ-Auditor, a multimodal large language model (MLLM)-based auditor that explicitly reasons over multimodal cues and mask information to produce quantitative and qualitative mask quality assessments. Extensive experiments demonstrate that MQ-Auditor outperforms strong open-source and commercial MLLMs and can be integrated with existing Ref-AVS systems to detect segmentation failures and support downstream segmentation improvement. Data and codes will be released at https://github.com/jasongief/MQA-RefAVS.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 69 of its 84 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

69 of 84 references.

References · 69

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2023Segment Anythingcited by 8,234
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  8. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  9. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  10. 2025Qwen2.5-Omni Technical Reportcited by 736
  11. 2020Image Segmentation Using Deep Learning: A Surveycited by 660
  12. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
38 more
  1. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  2. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  3. 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
  4. 2021Mask2Former for Video Instance Segmentationcited by 171
  5. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  6. 2022Audio-Visual Segmentationcited by 151
  7. 2020Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsingcited by 146
  8. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
  9. 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
  10. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
  11. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
  12. 2023Audio-Visual Segmentation with Semanticscited by 75
  13. 2025Detect Anything via Next Point Predictioncited by 73
  14. 2019Dual-modality seq2seq network for audio-visual event localizationcited by 72
  15. 2021Positive Sample Propagation along the Audio-Visual Event Linecited by 69
  16. 2023AVSegFormer: Audio-Visual Segmentation with Transformercited by 68
  17. 2023CATR: Combinatorial-Dependence Audio-Queried Transformer for Audio-Visual Video Segmentationcited by 53
  18. 2022Contrastive Positive Sample Propagation along the Audio-Visual Event Linecited by 50
  19. 2023Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baselinecited by 46
  20. 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
  21. 2023Multimodal Variational Auto-encoder based Audio-Visual Segmentationcited by 38
  22. 2024TAVGBench: Benchmarking Text to Audible-Video Generationcited by 34
  23. 2024Ref-AVS: Refer and Segment Objects in Audio-Visual Scenescited by 33
  24. 2022Joint-Modal Label Denoising for Weakly-Supervised Audio-Visual Video Parsingcited by 29
  25. 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Modelscited by 28
  26. 2024FineVQ: Fine-Grained User Generated Content Video Quality Assessmentcited by 28
  27. 2024Towards Open-Vocabulary Audio-Visual Event Localizationcited by 26
  28. 2024Label-anticipated Event Disentanglement for Audio-Visual Video Parsingcited by 25
  29. 2024Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentationcited by 23
  30. 2025Multimodal Referring Segmentation: A Surveycited by 22
  31. 2025Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generationcited by 22
  32. 2023Audio-Visual Instance Segmentationcited by 21
  33. 2024Advancing Weakly-Supervised Audio-Visual Video Parsing via Segment-wise Pseudo Labelingcited by 20
  34. 2023Object-aware Adaptive-Positivity Learning for Audio-Visual Question Answeringcited by 19
  35. 2023Fine-grained Audible Video Descriptioncited by 18
  36. 2023Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parsercited by 18
  37. 2025Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperationcited by 18
  38. 2025SAM2-LOVE: Segment Anything Model 2 in Language-aided Audio-Visual Scenescited by 17

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MLLM-Assisted Audio VOS: A 3rd Place Report for the MeViS-Audio Track, 8th LSVOS Challenge
  2. 2024Can Textual Semantics Mitigate Sounding Object Segmentation Preference?
  3. 2026ReflexTrack: A Feedback-Driven Agent for Training-Free Referring Video Object Segmentation
  4. 2025Segmentation as A Plug-and-Play Capability for Frozen Multimodal LLMs
  5. 2025Refer to Any Segmentation Mask Group With Vision-Language Prompts
  6. 2026X2SAM: Any Segmentation in Images and Videos
  7. 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation
  8. 2025R2SM: Referring and Reasoning for Selective Masks