mlsanityData to 7 Oct 2026

FedStyle: Style-Based Federated Learning Crowdsourcing Framework for Art Commissions

arXiv 2404.16336 ↗First posted 25 Apr 2024cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The unique artistic style is crucial to artists' occupational competitiveness, yet prevailing Art Commission Platforms rarely support style-based retrieval. Meanwhile, the fast-growing generative AI techniques aggravate artists' concerns about releasing personal artworks to public platforms. To achieve artistic style-based retrieval without exposing personal artworks, we propose FedStyle, a style-based federated learning crowdsourcing framework. It allows artists to train local style models and share model parameters rather than artworks for collaboration. However, most artists possess a unique artistic style, resulting in severe model drift among them. FedStyle addresses such extreme data heterogeneity by having artists learn their abstract style representations and align with the server, rather than merely aggregating model parameters lacking semantics. Besides, we introduce contrastive learning to meticulously construct the style representation space, pulling artworks with similar styles closer and keeping different ones apart in the embedding space. Extensive experiments on the proposed datasets demonstrate the superiority of FedStyle.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 25 Apr 2024.

Builds on

15 of 28 references.

References · 15

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  3. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  4. 2020Supervised Contrastive Learningcited by 2,803
  5. 2021Model-Contrastive Federated Learningcited by 762
  6. 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 349
  7. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
  8. 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
  9. 2022FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correctioncited by 181
  10. 2023Mist: Towards Improved Adversarial Examples for Diffusion Modelscited by 91
  11. 2021FedProc: Prototypical Contrastive Federated Learning on Non-IID datacited by 80
  12. 2021ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similaritycited by 34
3 more
  1. 2023Learning Cautiously in Federated Learning with Noisy and Heterogeneous Clientscited by 12
  2. 2018Multitask Painting Categorization by Deep Multibranch Neural Networkcited by 8
  3. 2021FedNS: Improving Federated Learning for collaborative image classification on mobile clientscited by 3

Built on by

Not cited yet.