Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
Abstract (arXiv)
The zero-shot capabilities of multimodal large language models (MLLMs) are pushing salient object detection (SOD) beyond task-specific supervision. To disentangle MLLMs beyond conventional mask-based evaluation, we decompose SOD into localization and segmentation, and re-engineer datasets with phrases, boxes, and attributes, establishing a diagnostic benchmark for MLLM saliency perception (SaliLLM). SaliLLM uncovers a striking capability mismatch: MLLMs outperform state-of-the-art (SOTA) methods in localization, yet remain substantially weaker in segmentation. Further analyses attribute this gap primarily to mismatches between MLLMs and annotations over foreground cardinality, granularity, and extent. Motivated by this diagnosis, we recast zero-shot SOD as protocol-aligned Foreground Organization and introduce the first training-free framework that leverages Gestalt-inspired Collaborative attention for Unified SOD (FOCUS). FOCUS couples top-down Bayesian-surprise calibration of protocol-conditioned foreground granularity with bottom-up propagation of MLLMs evidence over entity-centric perceptual manifolds induced by self-supervised features, yielding coherent object extents as prompts for a general segmenter. Across 13 RGB, RGB-D, and RGB-T SOD benchmarks, FOCUS generally surpasses SOTA methods without training, reducing mean absolute error by 11%, 34%, and 48% compared with fully, weakly, and self-supervised methods, respectively. Our findings signal the renaissance of SOD: from task-specific supervision to zero-shot foreground organization. Code is available in the supplementary material.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 47 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
25 of 47 references.
References · 25
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025DINOv3cited by 1,414
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2014The Secrets of Salient Object Segmentationcited by 200
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 187
- 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
- 2019Salient Object Detection in the Deep Learning Era: An In-Depth Surveycited by 164
13 more
- 2019Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarkscited by 133
- 2020RGB-D Salient Object Detection: A Surveycited by 73
- 2019RGB-T Image Saliency Detection via Collaborative Graph Learningcited by 58
- 2023VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learningcited by 58
- 2017A Unified RGB-T Saliency Detection Benchmark: Dataset, Baselines, Analysis and A Novel Approachcited by 51
- 2023VST++: Efficient and Stronger Visual Saliency Transformercited by 28
- 2025UFO: A Unified Approach to Fine-grained Visual Perception via Open-ended Language Interfacecited by 27
- 2024Leveraging Hallucinations to Reduce Manual Prompt Dependency in Promptable Segmentationcited by 20
- 2024SSFam: Scribble Supervised Salient Object Detection Familycited by 6
- 20223SD: Self-Supervised Saliency Detection With No Labelscited by 5
- 2024Unified Unsupervised Salient Object Detection via Knowledge Transfercited by 5
- 2025Stepwise Decomposition and Dual-stream Focus: A Novel Approach for Training-free Camouflaged Object Segmentationcited by 3
- 2026Discover, Segment, and Select: A Progressive Mechanism for Zero-shot Camouflaged Object Segmentationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Pay More Attention To Text In High-Resolution MLLMscited by 0
- 2026Pay More Attention To Text In High-Resolution MLLMs20 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Revisiting Salient Object Detection from an Observer-Centric Perspective
- 2026FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMs
- 2025Saliency-R1: Incentivizing Unified Saliency Reasoning Capability in MLLM with Confidence-Guided Reinforcement Learning
- 2025Vision-Language Models Can't See the Obvious
- 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLM
- 2025Object Detection with Multimodal Large Vision-Language Models: An In-depth Review
- 2026Propose and Attend: Training-free MLLM Grounding Confidence via Multi-Token Localized Attention
- 2025The Power of One: A Single Example is All it Takes for Segmentation in VLMs