Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Feature
Not on the map. Why?
Cited by 53 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In the past few years, the number of fine-art collections that are digitized and publicly available has been growing rapidly. With the availability of such large collections of digitized artworks comes the need to develop multimedia systems to archive and retrieve this pool of data. Measuring the visual similarity between artistic items is an essential step for such multimedia systems, which can benefit more high-level multimedia tasks. In order to model this similarity between paintings, we should extract the appropriate visual features for paintings and find out the best approach to learn the similarity metric based on these features. We investigate a comprehensive list of visual features and metric learning approaches to learn an optimized similarity measure between paintings. We develop a machine that is able to make aesthetic-related semantic-level judgments, such as predicting a painting's style, genre, and artist, as well as providing similarity measures optimized based on the knowledge available in the domain of art historical interpretation. Our experiments show the value of using this similarity measure for the aforementioned prediction tasks.
Key facts. Cited by 181 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 May 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 16; 2023: 34; 2024: 49; 2025: 46; 2026: 26.
181 papers.
Sort:
By area:
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Nowcited by 204
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2023MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learningcited by 171
- 2023Manifold Preserving Guided Diffusioncited by 153
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2021ArtEmis: Affective Language for Visual Artcited by 103
- 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 103
- 2024Efficient Multimodal Large Language Models: A Surveycited by 95
38 more
- 2023ChatGPT Asks, BLIP-2 Answers: Automatic Questioning Towards Enriched Visual Descriptionscited by 86
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 76
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 72
- 2024Guidance with Spherical Gaussian Constraint for Conditional Diffusioncited by 69
- 2022Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Modelscited by 63
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
- 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Modelscited by 61
- 2024R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Modelcited by 56
- 2024Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usagecited by 49
- 2023Towards Artistic Image Aesthetics Assessment: a Large-scale Dataset and a New Methodcited by 48
- 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Biascited by 43
- 2022Task Adaptive Parameter Sharing for Multi-Task Learningcited by 42
- 2022Semi-Parametric Neural Image Synthesiscited by 36
- 2021Sound-Guided Semantic Image Manipulationcited by 35
- 2024MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Modelscited by 34
- 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AIcited by 32
- 2024Jailbreak Attacks and Defenses against Multimodal Generative Models: A Surveycited by 31
- 2024Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Modelscited by 30
- 2025OmniStyle: Filtering High Quality Style Transfer Data at Scalecited by 30
- 2022Meta-attention for ViT-backed Continual Learningcited by 29
- 2023Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Modelscited by 22
- 2025Variational Control for Guidance in Diffusion Modelscited by 22
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesiscited by 21
- 2025Multi-Layer Visual Feature Fusion in Multimodal LLMs: Methods, Analysis, and Best Practicescited by 21
- 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learningcited by 21
- 2025Generative Latent Coding for Ultra-Low Bitrate Image Compressioncited by 21
- 2023Context-Aware Meta-Learningcited by 20
- 2024Towards Reliable Verification of Unauthorized Data Usage in Personalized Text-to-Image Diffusion Modelscited by 19
- 2023Not Only Generative Art: Stable Diffusion for Content-Style Disentanglement in Art Analysiscited by 18
- 2023Targeted Attack Improves Protection against Unauthorized Diffusion Customizationcited by 18
- 2024An Economic Solution to Copyright Challenges of Generative AIcited by 18
- 2024IPAdapter-Instruct: Resolving Ambiguity in Image-based Conditioning using Instruct Promptscited by 18
- 2024An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in Heterogeneous Federated Learningcited by 17
- 2024Gaussian Splatting in Stylecited by 16
- 2024Conditional LoRA Parameter Generationcited by 16
- 2025LAPIS: A novel dataset for personalized image aesthetic assessmentcited by 16
- 2022GLaMa: Joint Spatial and Frequency Loss for General Image Inpaintingcited by 15
50 most cited of 181 All 181 (JSON)
- 2026Concept Score Relearning: A Unified Cross-Architecture Attack on Concept Erasure27 Sep 2026
- 2026MoGround: Measuring and Mitigating Modality Distraction in Vision-Language Models27 Sep 2026
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models25 Sep 2026
- 2026TINA+: Probing Residual Visual Knowledge in Unlearned Diffusion Models via Diffusion-Consistent Text-Free Inversion18 Aug 2026
- 2026IDraw: Artist Verification from Digital Drawing Images3 Aug 2026
- 2026MDTD-ArtIR: Benchmarking Image Editing and Restoration Models for Art Image Restoration under Texture-Overlay Degradations1 Aug 2026
- 2026Art Beyond Semantics: Sheaf-Informed Contrastive Learning for Multi-Relational Representations15 Jul 2026
- 2026Contrastive-Augmented Flow Matching for Style-Content Disentanglement14 Jul 2026
- 2026ArtMine: Discovering and Formalizing Artistic Processes9 Jul 2026
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks8 Jul 2026
- 2026SpiralFovea: Input-Adaptive Foveated Tokenization as a Third Lever of Resource-Adaptive Inference1 Jul 2026
- 2026DiffRGD: An Inference-Time Diffusion Guidance Through Riemannian Gradient Descent25 Jun 2026
38 more
- 2026Co-occurring Associated REtained concepts in Diffusion Unlearning23 Jun 2026
- 2026VOID: Defeating Unauthorized Mimicry in Latent Diffusion Models10 Jun 2026
- 2026Safeguarding Text-to-Image Generative Models Against Unauthorized Knowledge Distillation21 May 2026
- 2026Modular Multimodal Classification Without Fine-Tuning: A Simple Compositional Approach20 May 2026
- 2026Evaluation without Generation: Non-Generative Assessment of Harmful Model Specialization with Applications to CSAM28 Apr 2026
- 2026TINA: Text-Free Inversion Attack for Unlearned Text-to-Image Diffusion Models18 Mar 2026
- 2026Omni IIE Bench: Benchmarking the Practical Capabilities of Image Editing Models16 Mar 2026
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation11 Mar 2026
- 2026How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practices5 Mar 2026
- 2026Synthetic Craquelure Generation for Unsupervised Painting Restoration13 Feb 2026
- 2026The Algorithmic Gaze of Image Quality Assessment: An Audit and Trace Ethnography of the LAION-Aesthetics Predictor14 Jan 2026
- 2026Handcrafted Feature-Assisted One-Class Learning for Artist Authentication in Historical Drawings13 Jan 2026
- 2026VULCA-Bench: A Multicultural Vision-Language Benchmark for Evaluating Cultural Understanding12 Jan 2026
- 2026Cross-Cultural Expert-Level Art Critique Evaluation with Vision-Language Models12 Jan 2026
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Models26 Dec 2025
- 2025Generative Latent Coding for Ultra-Low Bitrate Image Compression23 Dec 2025
- 2025EmoStyle: Emotion-Driven Image Stylization5 Dec 2025
- 2025Insert In Style: A Zero-Shot Generative Framework for Harmonious Cross-Domain Object Composition19 Nov 2025
- 2025Cultural Alien Sampler: Open-ended art generation balancing originality and coherence21 Oct 2025
- 2025MATRIX: Multimodal Agent Tuning for Robust Tool-Use Reasoning9 Oct 2025
- 2025Learning What Matters: Steering Diffusion via Spectrally Anisotropic Forward Noise7 Oct 2025
- 2025Dirichlet-Prior Shaping: Guiding Expert Specialization in Upcycled MoEs1 Oct 2025
- 2025Erased, But Not Forgotten: Erased Rectified Flow Transformers Still Remain Unsafe Under Concept Attack1 Oct 2025
- 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Models30 Sep 2025
- 2025Decoupled Proxy Alignment: Mitigating Language Prior Conflict for Multimodal Alignment in MLLM18 Sep 2025
- 2025SuMa: A Subspace Mapping Approach for Robust and Effective Concept Erasure in Text-to-Image Diffusion Models6 Sep 2025
- 2025Few-Shot Pattern Detection via Template Matching and Regression25 Aug 2025
- 2025Leveraging Diffusion Models for Stylization using Multiple Style Images18 Aug 2025
- 2025MultiRef: Controllable Image Generation with Multiple Visual References9 Aug 2025
- 2025SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Models5 Aug 2025
- 2025Adaptive Sparse Softmax: An Effective and Efficient Softmax Variant5 Aug 2025
- 2025The Cow of Rembrandt - Analyzing Artistic Prompt Interpretation in Text-to-Image Models31 Jul 2025
- 2025ZIUM: Zero-Shot Intent-Aware Adversarial Attack on Unlearned Models29 Jul 2025
- 2025ArtSeek: Deep artwork understanding via multimodal in-context reasoning and late interaction retrieval29 Jul 2025
- 2025AIComposer: Any Style and Content Image Composition via Feature Integration28 Jul 2025
- 2025Identifying Prompted Artist Names from Generated Images24 Jul 2025
- 2025An h-space Based Adversarial Attack for Protection Against Few-shot Personalization23 Jul 2025
- 2025Stein Diffusion Guidance: Training-Free Posterior Correction for Sampling Beyond High-Density Regions7 Jul 2025
50 newest of 181 All 181 (JSON)
- 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Nowcited by 204
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2023Manifold Preserving Guided Diffusioncited by 153
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 103
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 76
- 2024Guidance with Spherical Gaussian Constraint for Conditional Diffusioncited by 69
- 2024R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Modelcited by 56
- 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AIcited by 32
- 2025Variational Control for Guidance in Diffusion Modelscited by 22
- 2024Towards Reliable Verification of Unauthorized Data Usage in Personalized Text-to-Image Diffusion Modelscited by 19
12 most cited of 52 All 52 (JSON)
- 2026Concept Score Relearning: A Unified Cross-Architecture Attack on Concept Erasure27 Sep 2026
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models25 Sep 2026
- 2026TINA+: Probing Residual Visual Knowledge in Unlearned Diffusion Models via Diffusion-Consistent Text-Free Inversion18 Aug 2026
- 2026Contrastive-Augmented Flow Matching for Style-Content Disentanglement14 Jul 2026
- 2026DiffRGD: An Inference-Time Diffusion Guidance Through Riemannian Gradient Descent25 Jun 2026
- 2026Co-occurring Associated REtained concepts in Diffusion Unlearning23 Jun 2026
- 2026VOID: Defeating Unauthorized Mimicry in Latent Diffusion Models10 Jun 2026
- 2026TINA: Text-Free Inversion Attack for Unlearned Text-to-Image Diffusion Models18 Mar 2026
- 2025Learning What Matters: Steering Diffusion via Spectrally Anisotropic Forward Noise7 Oct 2025
- 2025Erased, But Not Forgotten: Erased Rectified Flow Transformers Still Remain Unsafe Under Concept Attack1 Oct 2025
- 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Models30 Sep 2025
- 2025SuMa: A Subspace Mapping Approach for Robust and Effective Concept Erasure in Text-to-Image Diffusion Models6 Sep 2025
12 newest of 52 All 52 (JSON)
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2023MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learningcited by 171
- 2024Efficient Multimodal Large Language Models: A Surveycited by 95
- 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 73
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 63
- 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Modelscited by 61
- 2024MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Modelscited by 34
- 2025Multi-Layer Visual Feature Fusion in Multimodal LLMs: Methods, Analysis, and Best Practicescited by 21
- 2024Have Large Vision-Language Models Mastered Art History?cited by 9
- 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understandingcited by 7
- 2024FIRE: A Dataset for Feedback Integration and Refinement Evaluation of Multimodal Modelscited by 6
12 most cited of 19 All 19 (JSON)
- 2026MoGround: Measuring and Mitigating Modality Distraction in Vision-Language Models27 Sep 2026
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation11 Mar 2026
- 2026VULCA-Bench: A Multicultural Vision-Language Benchmark for Evaluating Cultural Understanding12 Jan 2026
- 2026Cross-Cultural Expert-Level Art Critique Evaluation with Vision-Language Models12 Jan 2026
- 2025Training-free Conditional Image Embedding Framework Leveraging Large Vision Language Models26 Dec 2025
- 2025Decoupled Proxy Alignment: Mitigating Language Prior Conflict for Multimodal Alignment in MLLM18 Sep 2025
- 2025Incomplete In-context Learning12 May 2025
- 2025Multi-Layer Visual Feature Fusion in Multimodal LLMs: Methods, Analysis, and Best Practices8 Mar 2025
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb 2025
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding13 Dec 2024
- 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding9 Oct 2024
- 2024Have Large Vision-Language Models Mastered Art History?5 Sep 2024
12 newest of 19 All 19 (JSON)
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 72
- 2024Jailbreak Attacks and Defenses against Multimodal Generative Models: A Surveycited by 31
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesiscited by 21
- 2023DeepfakeArt Challenge: A Benchmark Dataset for Generative AI Art Forgery and Data Poisoning Detectioncited by 9
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarkscited by 6
- 2025ZIUM: Zero-Shot Intent-Aware Adversarial Attack on Unlearned Modelscited by 1
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks8 Jul 2026
- 2025ZIUM: Zero-Shot Intent-Aware Adversarial Attack on Unlearned Models29 Jul 2025
- 2024Jailbreak Attacks and Defenses against Multimodal Generative Models: A Survey14 Nov 2024
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models20 Oct 2023
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesis13 Jun 2023
- 2023DeepfakeArt Challenge: A Benchmark Dataset for Generative AI Art Forgery and Data Poisoning Detection2 Jun 2023
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2021ArtEmis: Affective Language for Visual Artcited by 103
- 2023ChatGPT Asks, BLIP-2 Answers: Automatic Questioning Towards Enriched Visual Descriptionscited by 86
- 2023Towards Artistic Image Aesthetics Assessment: a Large-scale Dataset and a New Methodcited by 48
- 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Biascited by 43
- 2022Task Adaptive Parameter Sharing for Multi-Task Learningcited by 42
- 2022Semi-Parametric Neural Image Synthesiscited by 36
- 2021Sound-Guided Semantic Image Manipulationcited by 35
- 2025OmniStyle: Filtering High Quality Style Transfer Data at Scalecited by 30
- 2022Meta-attention for ViT-backed Continual Learningcited by 29
- 2023Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Modelscited by 22
- 2025Generative Latent Coding for Ultra-Low Bitrate Image Compressioncited by 21
12 most cited of 96 All 96 (JSON)
- 2026IDraw: Artist Verification from Digital Drawing Images3 Aug 2026
- 2026MDTD-ArtIR: Benchmarking Image Editing and Restoration Models for Art Image Restoration under Texture-Overlay Degradations1 Aug 2026
- 2026Art Beyond Semantics: Sheaf-Informed Contrastive Learning for Multi-Relational Representations15 Jul 2026
- 2026ArtMine: Discovering and Formalizing Artistic Processes9 Jul 2026
- 2026Safeguarding Text-to-Image Generative Models Against Unauthorized Knowledge Distillation21 May 2026
- 2026Modular Multimodal Classification Without Fine-Tuning: A Simple Compositional Approach20 May 2026
- 2026Evaluation without Generation: Non-Generative Assessment of Harmful Model Specialization with Applications to CSAM28 Apr 2026
- 2026Omni IIE Bench: Benchmarking the Practical Capabilities of Image Editing Models16 Mar 2026
- 2026How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practices5 Mar 2026
- 2026Synthetic Craquelure Generation for Unsupervised Painting Restoration13 Feb 2026
- 2026The Algorithmic Gaze of Image Quality Assessment: An Audit and Trace Ethnography of the LAION-Aesthetics Predictor14 Jan 2026
- 2026Handcrafted Feature-Assisted One-Class Learning for Artist Authentication in Historical Drawings13 Jan 2026
12 newest of 96 All 96 (JSON)