Structure-measure: A New Way to Evaluate Foreground Maps
Not on the map. Why?
Abstract (arXiv)
Foreground map evaluation is crucial for gauging the progress of object segmentation algorithms, in particular in the filed of salient object detection where the purpose is to accurately detect and segment the most salient object in a scene. Several widely-used measures such as Area Under the Curve (AUC), Average Precision (AP) and the recently proposed Fbw have been utilized to evaluate the similarity between a non-binary saliency map (SM) and a ground-truth (GT) map. These measures are based on pixel-wise errors and often ignore the structural similarities. Behavioral vision studies, however, have shown that the human visual system is highly sensitive to structures in scenes. Here, we propose a novel, efficient, and easy to calculate measure known an structural similarity measure (Structure-measure) to evaluate non-binary foreground maps. Our new measure simultaneously evaluates region-aware and object-aware structural similarity between a SM and a GT map. We demonstrate superiority of our measure over existing ones using 5 meta-measures on 5 benchmark datasets.
Key facts. Cited by 480 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 77; 2022: 80; 2023: 88; 2024: 90; 2025: 83; 2026: 62.
480 papers.
Sort:
By area:
- 2022Kubric: A scalable dataset generatorcited by 373
- 2021Concealed Object Detectioncited by 212
- 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
- 2021Visual Saliency Transformercited by 175
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2021Camouflaged Object Segmentation with Distraction Miningcited by 151
- 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2021Mutual Graph Learning for Camouflaged Object Detectioncited by 103
38 more
- 2023Can SAM Segment Anything? When SAM Meets Camouflaged Object Detectioncited by 99
- 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
- 2023Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformerscited by 87
- 2021Context-aware Cross-level Fusion Network for Camouflaged Object Detectioncited by 86
- 2022Video Polyp Segmentation: A Deep Learning Perspectivecited by 81
- 2021Full-Duplex Strategy for Video Object Segmentationcited by 78
- 2022High-resolution Iterative Feedback Network for Camouflaged Object Detectioncited by 78
- 2021Automatic Polyp Segmentation via Multi-scale Subtraction Networkcited by 77
- 2021Progressively Normalized Self-Attention Network for Video Polyp Segmentationcited by 75
- 2023SAM Struggles in Concealed Scenes -- Empirical Study on Segment Anythingcited by 75
- 2021Specificity-preserving RGB-D Saliency Detectioncited by 70
- 2023AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encodercited by 70
- 2022Boundary-Guided Camouflaged Object Detectioncited by 68
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
- 2022Deep Gradient Learning for Efficient Camouflaged Object Detectioncited by 65
- 2022Pyramid Grafting Network for One-Stage High Resolution Saliency Detectioncited by 63
- 2024SAM2-UNet: Segment Anything 2 Makes Strong Encoder for Natural and Medical Image Segmentationcited by 63
- 2022Implicit Motion Handling for Video Camouflaged Object Detectioncited by 60
- 2022SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detectioncited by 59
- 2023Can SAM Segment Polyps?cited by 59
- 2022CamoFormer: Masked Separable Attention for Camouflaged Object Detectioncited by 58
- 2023DFormer: Rethinking RGBD Representation Learning for Semantic Segmentationcited by 58
- 2021Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Predictioncited by 57
- 2021Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusioncited by 56
- 2023Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objectscited by 56
- 2022A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detectioncited by 51
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentationcited by 51
- 2021RGB-D Saliency Detection via Cascaded Mutual Information Minimizationcited by 50
- 2023ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detectioncited by 48
- 2021CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detectioncited by 47
- 2023Advances in Deep Concealed Scene Understandingcited by 47
- 2021TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Networkcited by 45
- 2022Weakly-Supervised Camouflaged Object Detection with Scribble Annotationscited by 43
- 2023CaraNet: Context Axial Reverse Attention Network for Segmentation of Small Medical Objectscited by 43
- 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learningcited by 43
- 2021Fast Camouflaged Object Detection via Edge-based Reversible Re-calibration Networkcited by 42
- 2021Boundary-Aware Segmentation Network for Mobile and Web Applicationscited by 41
- 2022Feature Aggregation and Propagation Network for Camouflaged Object Detectioncited by 40
50 most cited of 480 All 480 (JSON)
- 2026Consensus-Aware Multi-Source Fusion for Reference-Guided Camouflaged Object Detection30 Sep 2026
- 2026UnfoldCRF: Structured Mask Refinement with Image-Conditioned Latent Regions27 Sep 2026
- 2026Can Frozen Hyperspherical Features Guide the Selection of Pseudo Masks?24 Sep 2026
- 2026S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection23 Sep 2026
- 2026Beyond the Foreground: FOV-Aware Polyp Image Synthesis via Lesion-Guided Adaptive Mucosal Context Propagation17 Sep 2026
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detection12 Sep 2026
- 2026LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection11 Sep 2026
- 2026RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradation11 Sep 2026
- 2026SphereSOD: Geometry-Structure Coupled Learning for 360 Salient Object Detection7 Sep 2026
- 2026When Depth Hurts: Reliability-Aware Geometry Distillation for Depth-Free RGB-D Salient Object Detection3 Sep 2026
- 2026Seeing the Unseen: Camouflaged Object Detection Beyond the Visible Spectrum31 Aug 2026
- 2026SPLG-Mamba: Structure-Preserving Local-Global Mamba Network for Salient Object Detection in Optical Remote Sensing Images30 Aug 2026
38 more
- 2026TDFNet: Tri-projection Deformable Fusion Network for Panoramic Salient Object Detection26 Aug 2026
- 2026MIMONet: Multi-scale Input and Multi-scale Output Network for Salient Object Detection26 Aug 2026
- 2026Is There Really a Camouflaged Object? Towards Realistic Camouflaged Object Detection11 Aug 2026
- 2026LAD-COD: Language-Aligned Dense Perception for Camouflaged Object Detection8 Aug 2026
- 2026Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?31 Jul 2026
- 2026RDVSv2: A Large-scale Benchmark for RGB-D Video Salient Object Detection28 Jul 2026
- 2026PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing23 Jul 2026
- 2026To Blend In, First Decouple: Rethinking Camouflage Image Generation via Context-Decoupled Representations20 Jul 2026
- 2026Weakly-Supervised RGB-D Salient Object Detection via SAM-driven Pseudo Annotation and State Space Interaction-based Diffusion16 Jul 2026
- 2026IPDiff: Diffusion-driven ORSI Salient Object Detection with Information Reconstruction and Multi-Prior Guidance4 Jul 2026
- 2026When Does Resolution Help a Frozen Backbone? Global Attention at Resolution Predicts Scalable Adaptation for Camouflaged and Marine Animal Segmentation2 Jul 2026
- 2026Rethinking Conditional Generation for Underwater Salient Object Detection2 Jul 2026
- 2026Beyond Pixel Overlap: A Framework for Decomposing Segmentation Evaluation Metrics1 Jul 2026
- 2026HVPNet: A Bio-Inspired Network for General Salient and Camouflaged Object Detection30 Jun 2026
- 2026ARTEMIS: Agent-guided Reliability-aware Temporal Mask Evolution for Imperfectly Supervised Video Polyp Segmentation18 Jun 2026
- 2026MMDiff: Extending Diffusion Transformers for Multi-Modal Generation15 Jun 2026
- 2026Polyp-D2ATL: Deep Domain-Adaptive Transfer Learning for Colorectal Polyp Classification under Label Distribution Shift12 Jun 2026
- 2026DifferSeg: Towards Diverse Multimodal Binary Segmentation via Differential Perception and Frequency Guidance8 Jun 2026
- 2026CFCamo: A Counterfactual Detect-or-Abstain Framework for Camouflaged Object Detection28 May 2026
- 2026BED-SAM2: Boundary-Enhanced-Depth SAM2 via Monocular Geometric Priors24 May 2026
- 2026Learning Spatially Adaptive Structural Coordination for Underwater Salient Object Detection15 May 2026
- 2026M4-SAM: Multi-Modal Mixture-of-Experts with Memory-Augmented SAM for RGB-D Video Salient Object Detection12 May 2026
- 2026UniV2D: Bridging Visual Restoration and Semantic Perception for Underwater Salient Object Detection8 May 2026
- 2026FlowDIS: Language-Guided Dichotomous Image Segmentation with Flow Matching6 May 2026
- 2026Exploring Boundary-Aware Spatial-Frequency Fusion for Camouflaged Object Detection20 Apr 2026
- 2026Certainty Is Redundant: Token Sparsification for Efficient Camouflaged Object Detection with Vision Foundation Models18 Apr 2026
- 2026Camo-M3FD: A New Benchmark Dataset for Cross-Spectral Camouflaged Pedestrian Detection17 Apr 2026
- 2026ASGNet: Adaptive Spectrum Guidance Network for Automatic Polyp Segmentation16 Apr 2026
- 2026EviRCOD: Evidence-Guided Probabilistic Decoding for Referring Camouflaged Object Detection13 Apr 2026
- 2026YUV20K: A Complexity-Driven Benchmark and Trajectory-Aware Alignment Model for Video Camouflaged Object Detection11 Apr 2026
- 2026CAMotion: A High-Quality Benchmark for Camouflaged Moving Object Detection in the Wild9 Apr 2026
- 2026Modality-Specific Hierarchical Enhancement for RGB-D Camouflaged Object Detection3 Apr 2026
- 2026Camouflage-aware Image-Text Retrieval via Expert Collaboration1 Apr 2026
- 2026ORSIFlow: Saliency-Guided Rectified Flow for Optical Remote Sensing Salient Object Detection30 Mar 2026
- 2026Language-Guided Structure-Aware Network for Camouflaged Object Detection25 Mar 2026
- 2026STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detection23 Mar 2026
- 2026Part-Aware Open-Vocabulary 3D Affordance Grounding via Prototypical Semantic and Geometric Alignment18 Mar 2026
- 2026RealVLG-R1: A Large-Scale Real-World Visual-Language Grounding Benchmark for Robotic Perception and Manipulation16 Mar 2026
50 newest of 480 All 480 (JSON)
- 2023CamoDiffusion: Camouflaged Object Detection via Conditional Diffusion Modelscited by 21
- 2025Reversible Unfolding Network for Concealed Visual Perception with Generative Refinementcited by 11
- 2024High-Precision Dichotomous Image Segmentation via Probing Diffusion Capacitycited by 7
- 2024DiffX: Guide Your Layout to Cross-Modal Generative Modelingcited by 3
- 2025Marine Saliency Segmenter: Object-Focused Conditional Diffusion with Region-Level Semantic Knowledge Distillationcited by 2
- 2025WaterFlow: Explicit Physics-Prior Rectified Flow for Underwater Saliency Mask Generationcited by 2
- 2025TransFlow: Motion Knowledge Transfer from Video Diffusion Models to Video Salient Object Detectioncited by 1
- 2024Structure-Aware Stylized Image Synthesis for Robust Medical Image Segmentationcited by 0
- 2026FlowDIS: Language-Guided Dichotomous Image Segmentation with Flow Matchingcited by 0
- 2026MMDiff: Extending Diffusion Transformers for Multi-Modal Generationcited by 0
- 2026Weakly-Supervised RGB-D Salient Object Detection via SAM-driven Pseudo Annotation and State Space Interaction-based Diffusioncited by 0
- 2026Weakly-Supervised RGB-D Salient Object Detection via SAM-driven Pseudo Annotation and State Space Interaction-based Diffusion16 Jul 2026
- 2026MMDiff: Extending Diffusion Transformers for Multi-Modal Generation15 Jun 2026
- 2026FlowDIS: Language-Guided Dichotomous Image Segmentation with Flow Matching6 May 2026
- 2025WaterFlow: Explicit Physics-Prior Rectified Flow for Underwater Saliency Mask Generation14 Oct 2025
- 2025Reversible Unfolding Network for Concealed Visual Perception with Generative Refinement20 Aug 2025
- 2025TransFlow: Motion Knowledge Transfer from Video Diffusion Models to Video Salient Object Detection26 Jul 2025
- 2025Marine Saliency Segmenter: Object-Focused Conditional Diffusion with Region-Level Semantic Knowledge Distillation3 Apr 2025
- 2024Structure-Aware Stylized Image Synthesis for Robust Medical Image Segmentation5 Dec 2024
- 2024High-Precision Dichotomous Image Segmentation via Probing Diffusion Capacity14 Oct 2024
- 2024DiffX: Guide Your Layout to Cross-Modal Generative Modeling22 Jul 2024
- 2023CamoDiffusion: Camouflaged Object Detection via Conditional Diffusion Models29 May 2023
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentationcited by 51
- 2024SAM-Mamba: Mamba Guided SAM Architecture for Generalized Zero-Shot Polyp Segmentationcited by 7
- 2024MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detectioncited by 6
- 2024Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detectioncited by 3
- 2025LEAF-Mamba: Local Emphatic and Adaptive Fusion State Space Model for RGB-D Salient Object Detectioncited by 2
- 2025Mamba Guided Boundary Prior Matters: A New Perspective for Generalized Polyp Segmentationcited by 1
- 2025Mamba-based Spatio-Frequency Motion Perception for Video Camouflaged Object Detectioncited by 0
- 2025HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detectioncited by 0
- 2026SPLG-Mamba: Structure-Preserving Local-Global Mamba Network for Salient Object Detection in Optical Remote Sensing Imagescited by 0
- 2026SPLG-Mamba: Structure-Preserving Local-Global Mamba Network for Salient Object Detection in Optical Remote Sensing Images30 Aug 2026
- 2025LEAF-Mamba: Local Emphatic and Adaptive Fusion State Space Model for RGB-D Salient Object Detection23 Sep 2025
- 2025HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection28 Aug 2025
- 2025Mamba-based Spatio-Frequency Motion Perception for Video Camouflaged Object Detection31 Jul 2025
- 2025Mamba Guided Boundary Prior Matters: A New Perspective for Generalized Polyp Segmentation2 Jul 2025
- 2024SAM-Mamba: Mamba Guided SAM Architecture for Generalized Zero-Shot Polyp Segmentation11 Dec 2024
- 2024MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detection19 Oct 2024
- 2024Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detection5 Oct 2024
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentation25 Jan 2024
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2023Chain of Visual Perception: Harnessing Multimodal Large Language Models for Zero-shot Camouflaged Object Detectioncited by 22
- 2026Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?cited by 1
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
- 2026Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?31 Jul 2026
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2023Chain of Visual Perception: Harnessing Multimodal Large Language Models for Zero-shot Camouflaged Object Detection19 Nov 2023
- 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domain30 Mar 2021
- 2024Reframe Anything: LLM Agent for Open World Video Reframing10 Mar 2024
- 2022Kubric: A scalable dataset generatorcited by 373
- 2021Concealed Object Detectioncited by 212
- 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
- 2021Visual Saliency Transformercited by 175
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2021Camouflaged Object Segmentation with Distraction Miningcited by 151
- 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2021Uncertainty-aware Joint Salient Object and Camouflaged Object Detectioncited by 114
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2021Mutual Graph Learning for Camouflaged Object Detectioncited by 103
12 most cited of 452 All 452 (JSON)
- 2026Consensus-Aware Multi-Source Fusion for Reference-Guided Camouflaged Object Detection30 Sep 2026
- 2026UnfoldCRF: Structured Mask Refinement with Image-Conditioned Latent Regions27 Sep 2026
- 2026Can Frozen Hyperspherical Features Guide the Selection of Pseudo Masks?24 Sep 2026
- 2026S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection23 Sep 2026
- 2026Beyond the Foreground: FOV-Aware Polyp Image Synthesis via Lesion-Guided Adaptive Mucosal Context Propagation17 Sep 2026
- 2026Rank-Consistent Set Reasoning for Co-Salient Object Detection12 Sep 2026
- 2026LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection11 Sep 2026
- 2026RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradation11 Sep 2026
- 2026SphereSOD: Geometry-Structure Coupled Learning for 360 Salient Object Detection7 Sep 2026
- 2026When Depth Hurts: Reliability-Aware Geometry Distillation for Depth-Free RGB-D Salient Object Detection3 Sep 2026
- 2026Seeing the Unseen: Camouflaged Object Detection Beyond the Visible Spectrum31 Aug 2026
- 2026TDFNet: Tri-projection Deformable Fusion Network for Panoramic Salient Object Detection26 Aug 2026
12 newest of 452 All 452 (JSON)