Image Composition Assessment with Saliency-augmented Multi-pattern Pooling
Not on the map. Why?
Abstract (arXiv)
Image composition assessment is crucial in aesthetic assessment, which aims to assess the overall composition quality of a given image. However, to the best of our knowledge, there is neither dataset nor method specifically proposed for this task. In this paper, we contribute the first composition assessment dataset CADB with composition scores for each image provided by multiple professional raters. Besides, we propose a composition assessment network SAMP-Net with a novel Saliency-Augmented Multi-pattern Pooling (SAMP) module, which analyses visual layout from the perspectives of multiple composition patterns. We also leverage composition-relevant attributes to further boost the performance, and extend Earth Mover's Distance (EMD) loss to weighted EMD loss to eliminate the content bias. The experimental results show that our SAMP-Net can perform more favorably than previous aesthetic assessment approaches.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 22 of its 68 references that are in the map. First posted on arXiv 7 Apr 2021.
Builds on
22 of 68 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
- 2017NIMA: Neural Image Assessmentcited by 387
- 2016Deeply supervised salient object detection with short connectionscited by 196
- 2019Pyramid Feature Attention Network for Saliency detectioncited by 128
- 2016Photo Aesthetics Ranking Network with Attributes and Content Adaptationcited by 122
- 2016Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Modelcited by 91
- 2016Image Aesthetic Assessment: An Experimental Surveycited by 50
10 more
- 2016Squared Earth Mover's Distance-based Loss for Training Deep Neural Networkscited by 45
- 2017A-Lamp: Adaptive Layout-Aware Multi-Patch Deep Convolutional Neural Network for Photo Aesthetic Assessmentcited by 28
- 2020Adaptive Fractional Dilated Convolution Network for Image Aesthetics Assessmentcited by 28
- 2017Learning to Compose with Professional Photographs on the Webcited by 24
- 2019Image Cropping with Composition and Saliency Aware Aesthetic Score Mapcited by 20
- 2019Aesthetic Attributes Assessment of Imagescited by 18
- 2019Composition-Aware Image Aesthetics Assessmentcited by 15
- 2016Will People Like Your Image? Learning the Aesthetic Spacecited by 13
- 2018Neural Aesthetic Image Reviewercited by 11
- 2016Learning to Detect Multiple Photographic Defectscited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 3; 2024: 4; 2025: 4; 2026: 7.
21 papers.
Sort:
By area:
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2023DreamEdit: Subject-driven Image Editingcited by 37
- 2022Best Prompts for Text-to-Image Models and How to Find Themcited by 35
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
- 2023X-IQE: eXplainable Image Quality Evaluation for Text-to-Image Generation with Visual Large Language Modelscited by 28
- 2024Finding Waldo: Towards Efficient Exploration of NeRF Scene Spacescited by 8
- 2025PhotoFramer: Multi-modal Image Composition Instructioncited by 8
- 2025Semantic to Structure: Learning Structural Representations for Infringement Detectioncited by 4
- 2024Self-supervised Photographic Image Layout Representation Learningcited by 3
- 20243D View Optimization for Improving Image Aestheticscited by 1
9 more
- 2024AID-AppEAL: Automatic Image Dataset and Algorithm for Content Appeal Enhancement and Assessment Labelingcited by 1
- 2026Aesthetic Camera Viewpoint Suggestion with 3D Aesthetic Fieldcited by 1
- 2025Explaining Automatic Image Assessmentcited by 0
- 2026Semantically Stable Image Composition Analysis via Saliency and Gradient Vector Flow Fusioncited by 0
- 2026Progressive Photorealistic Simplificationcited by 0
- 2026CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preferencecited by 0
- 2026COMPASS: Grounding Composition-Intent Guidance in Unified Multimodal Modelscited by 0
- 2026Learning visual representations for compositional analysis of artworks and photographscited by 0
- 2026Discrete Annotation, Continuous Preference: Rethinking Supervision for Accurate and Generalizable Aesthetic Image Croppingcited by 0
- 2026Discrete Annotation, Continuous Preference: Rethinking Supervision for Accurate and Generalizable Aesthetic Image Cropping30 Sep 2026
- 2026Learning visual representations for compositional analysis of artworks and photographs6 Aug 2026
- 2026COMPASS: Grounding Composition-Intent Guidance in Unified Multimodal Models27 Jun 2026
- 2026Progressive Photorealistic Simplification11 May 2026
- 2026CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference9 May 2026
- 2026Semantically Stable Image Composition Analysis via Saliency and Gradient Vector Flow Fusion14 Apr 2026
- 2026Aesthetic Camera Viewpoint Suggestion with 3D Aesthetic Field23 Feb 2026
- 2025PhotoFramer: Multi-modal Image Composition Instruction30 Nov 2025
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimization28 Nov 2025
- 2025Semantic to Structure: Learning Structural Representations for Infringement Detection11 Feb 2025
- 2025Explaining Automatic Image Assessment3 Feb 2025
- 2024AID-AppEAL: Automatic Image Dataset and Algorithm for Content Appeal Enhancement and Assessment Labeling8 Jul 2024
9 more
- 20243D View Optimization for Improving Image Aesthetics26 May 2024
- 2024Finding Waldo: Towards Efficient Exploration of NeRF Scene Spaces7 Mar 2024
- 2024Self-supervised Photographic Image Layout Representation Learning6 Mar 2024
- 2023DreamEdit: Subject-driven Image Editing22 Jun 2023
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approach22 May 2023
- 2023X-IQE: eXplainable Image Quality Evaluation for Text-to-Image Generation with Visual Large Language Models18 May 2023
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives9 Nov 2022
- 2022Best Prompts for Text-to-Image Models and How to Find Them23 Sep 2022
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Composition28 Jun 2021
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2023DreamEdit: Subject-driven Image Editingcited by 37
- 2024Finding Waldo: Towards Efficient Exploration of NeRF Scene Spacescited by 8
- 2025PhotoFramer: Multi-modal Image Composition Instructioncited by 8
- 2024Self-supervised Photographic Image Layout Representation Learningcited by 3
- 20243D View Optimization for Improving Image Aestheticscited by 1
- 2024AID-AppEAL: Automatic Image Dataset and Algorithm for Content Appeal Enhancement and Assessment Labelingcited by 1
- 2026Aesthetic Camera Viewpoint Suggestion with 3D Aesthetic Fieldcited by 1
- 2025Explaining Automatic Image Assessmentcited by 0
- 2026Semantically Stable Image Composition Analysis via Saliency and Gradient Vector Flow Fusioncited by 0
12 most cited of 16 All 16 (JSON)
- 2026Learning visual representations for compositional analysis of artworks and photographs6 Aug 2026
- 2026COMPASS: Grounding Composition-Intent Guidance in Unified Multimodal Models27 Jun 2026
- 2026Progressive Photorealistic Simplification11 May 2026
- 2026CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference9 May 2026
- 2026Semantically Stable Image Composition Analysis via Saliency and Gradient Vector Flow Fusion14 Apr 2026
- 2026Aesthetic Camera Viewpoint Suggestion with 3D Aesthetic Field23 Feb 2026
- 2025PhotoFramer: Multi-modal Image Composition Instruction30 Nov 2025
- 2025Explaining Automatic Image Assessment3 Feb 2025
- 2024AID-AppEAL: Automatic Image Dataset and Algorithm for Content Appeal Enhancement and Assessment Labeling8 Jul 2024
- 20243D View Optimization for Improving Image Aesthetics26 May 2024
- 2024Finding Waldo: Towards Efficient Exploration of NeRF Scene Spaces7 Mar 2024
- 2024Self-supervised Photographic Image Layout Representation Learning6 Mar 2024
12 newest of 16 All 16 (JSON)