mlsanityData to 7 Oct 2026

Style-based Clustering of Visual Artworks and the Play of Neural Style-Representations

arXiv 2409.08245 ↗First posted 12 Sep 2024cs.CV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Clustering artworks based on style can have many potential real-world applications like art recommendations, style-based search and retrieval, and the study of artistic style evolution of an artist or in an artwork corpus. We introduce and deliberate over the notion of 'Style-based clustering of visual artworks'. We argue that clustering artworks based on style is largely an unaddressed problem. We explore and devise different neural feature representations - from the style-classification, style-transfer to large language vision models - that can be then used for style-based clustering. Our objective is to assess the relative effectiveness of these devised style-based clustering approaches through qualitative and quantitative analysis by applying them to multiple artwork corpora and curated synthetically styled datasets. Besides providing a broad framework for style-based clustering and evaluation, our analysis provides some key novel insights on feature representations, architectures and implications for style-based clustering.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 31 of its 96 references that are in the map. First posted on arXiv 12 Sep 2024.

Builds on

31 of 96 references.

References · 31

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2016Densely Connected Convolutional Networkscited by 6,691
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  9. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
  12. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
19 more
  1. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 763
  2. 2013Network In Networkcited by 600
  3. 2020SCAN: Learning to Classify Images without Labelscited by 351
  4. 2017Neural Style Transfer: A Reviewcited by 199
  5. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
  6. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  7. 2017Demystifying Neural Style Transfercited by 152
  8. 2024Measuring Style Similarity in Diffusion Modelscited by 106
  9. 2017StyleBank: An Explicit Representation for Neural Image Style Transfercited by 89
  10. 2013Recognizing Image Stylecited by 64
  11. 2021ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similaritycited by 34
  12. 2023AesPA-Net: Aesthetic Pattern-Aware Style Transfer Networkscited by 34
  13. 2023Exploring the Limits of Deep Image Clustering using Pretrained Modelscited by 33
  14. 2019Discovering Visual Patterns in Art Collections with Spatially-consistent Feature Learningcited by 26
  15. 2023Stable Cluster Discrimination for Deep Clusteringcited by 24
  16. 2021GCNBoost: Artwork Classification by Label Propagation through a Knowledge Graphcited by 11
  17. 2020Visual link retrieval and knowledge discovery in painting datasetscited by 7
  18. 2020Deep convolutional embedding for digitized painting clusteringcited by 4
  19. 2021A deep learning approach to clustering visual artscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.