mlsanityData to 14 Oct 2026

CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art

arXiv 2503.12018 ↗First posted 15 Mar 2025cs.CV cs.AIcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-Image (T2I) diffusion models have made rapid progress on semantic alignment (generating what is described in the prompt), yet users still lack reliable control over aesthetic composition (how visual elements are put together). Prior work often treats aesthetics as a single, preference-driven notion (e.g., "high quality", "detailed", "breathtaking"), which does not map cleanly to compositional intent. We propose Aesthetic Alignment: aligning generated images to explicit, user-specified compositional constraints. We operationalize these constraints using the Principles of Art (PoA)-e.g., Balance, Rhythm, and Emphasis-commonly used in art education to describe composition. To support this task, we introduce CompArt, a dataset of 80,032 WikiArt images augmented with captions and PoA analyses produced by a multimodal LLM under structured prompting. We further propose ArtDapter, a lightweight and disentangled adapter that enables steering a pretrained T2I model along 10 PoA dimensions while retaining the base model's semantic capability. Experiments on CompArt show improved adherence to PoA controls over strong baselines under a dual evaluation protocol.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 80 references that are in the map. First posted on arXiv 15 Mar 2025.

Builds on

40 of 80 references.

Closest ancestors · 13

Same direction, newest first

  1. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
  2. 2023Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Following28 Nov
  3. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generation9 Aug
  4. 2023Divide & Bind Your Attention for Improved Generative Semantic Nursing20 Jul
  5. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models29 May
  6. 2023SUR-adapter: Enhancing Text-to-Image Pre-trained Diffusion Models with Large Language Models9 May
  7. 2023Not Only Generative Art: Stable Diffusion for Content-Style Disentanglement in Art Analysis20 Apr
  8. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  9. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  11. 2022Personalizing Text-to-Image Generation via Aesthetic Gradients25 Sep
  12. 2022Compositional Visual Generation with Composable Diffusion Models3 Jun
1 more
  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  10. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  11. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  12. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 904
15 more
  1. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
  2. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
  3. 2017A Neural Representation of Sketch Drawingscited by 313
  4. 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 182
  5. 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
  6. 2021ArtEmis: Affective Language for Visual Artcited by 104
  7. 2023DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedbackcited by 58
  8. 2020Stylized Neural Paintingcited by 50
  9. 2021Rethinking Style Transfer: From Pixels to Parameterized Brushstrokescited by 42
  10. 2022It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collectioncited by 36
  11. 2021Explain Me the Painting: Multi-Topic Knowledgeable Art Description Generationcited by 30
  12. 2024OmniControlNet: Dual-stage Integration for Conditional Image Generationcited by 24
  13. 2024APDDv2: Aesthetics of Paintings and Drawings Dataset with Artist Labeled Scores and Commentscited by 18
  14. 2023Learning Dynamic Style Kernels for Artistic Style Transfercited by 12
  15. 2024Paintings and Drawings Aesthetics Assessment with Rich Attributes for Various Artistic Categoriescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Enhancing Reward Models for High-quality Image Generation: Beyond Text-Image Alignment
  2. 2022Language Does More Than Describe: On The Lack Of Figurative Speech in Text-To-Image Models
  3. 2025AttriCtrl: Fine-Grained Control of Aesthetic Attribute Intensity in Diffusion Models
  4. 2026Advancing Aesthetic Image Generation via Composition Transfer
  5. 2024StyleForge: Enhancing Text-to-Image Synthesis for Any Artistic Styles with Dual Binding
  6. 2025The Cow of Rembrandt - Analyzing Artistic Prompt Interpretation in Text-to-Image Models
  7. 2026Pareto-Enhanced Portrait Generation: Vision-Aligned Text Supervision for Alignment, Realism, and Aesthetics
  8. 2025ArtCrafter: Text-Image Aligning Style Transfer via Embedding Reframing