Position: Universal Aesthetic Alignment Narrows Artistic Expression
Not on the map. Why?
Abstract (arXiv)
Over-aligning image generation models to a generalized aesthetic preference conflicts with user intent, particularly when "anti-aesthetic" outputs are requested for artistic or critical purposes. This adherence prioritizes developer-centered values, compromising user autonomy and aesthetic pluralism. We test this bias by constructing a wide-spectrum aesthetics dataset and evaluating state-of-the-art generation and reward models. This position paper finds that aesthetic-aligned generation models frequently default to conventionally beautiful outputs, failing to respect instructions for low-quality or negative imagery. Crucially, reward models penalize anti-aesthetic images even when they perfectly match the explicit user prompt. We confirm this systemic bias through image-to-image editing and evaluation against real abstract artworks. Our code, fine-tuned models, and datasets are available on our meta-expression intentionally anti-aesthetics webpage: https://weathon.github.io/icml2026_position/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 69 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
41 of 69 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
- 2015A Neural Algorithm of Artistic Stylecited by 483
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
29 more
- 2023Unified Concept Editing in Diffusion Modelscited by 388
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
- 2023Fair Diffusion: Instructing Text-to-Image Generation Models on Fairnesscited by 151
- 2024Learning Multi-dimensional Human Preference for Text-to-Image Generationcited by 106
- 2023Finetuning Text-to-Image Diffusion Models for Fairnesscited by 92
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 92
- 2023The Bias Amplification Paradox in Text-to-Image Generationcited by 70
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 69
- 2024Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigationcited by 66
- 2024Large Language Models Reflect the Ideology of their Creatorscited by 57
- 2024From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuningcited by 54
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generationcited by 38
- 2025LAPIS: A novel dataset for personalized image aesthetic assessmentcited by 16
- 2025LightFair: Towards an Efficient Alternative for Fair T2I Diffusion via Debiasing Pre-trained Text Encoderscited by 16
- 2025Only a Little to the Left: A Theory-grounded Measure of Political Bias in Large Language Modelscited by 15
- 2025AesBiasBench: Evaluating Bias and Alignment in Multimodal Language Models for Personalized Image Aesthetic Assessmentcited by 11
- 2025Measuring Political Preferences in AI Systems: An Integrative Approachcited by 9
- 2025R1dacted: Investigating Local Censorship in DeepSeek's R1 Language Modelcited by 7
- 2025"Check My Work?": Measuring Sycophancy in a Simulated Educational Contextcited by 7
- 2025DesignPref: Capturing Personal Preferences in Visual Design Generationcited by 7
- 2025AttriCtrl: Fine-Grained Control of Aesthetic Attribute Intensity in Diffusion Modelscited by 5
- 2025VSF: Simple, Efficient, and Effective Negative Guidance in Few-Step Image Generation Models By Value Sign Flipcited by 4
- 2025Position: The Pitfalls of Over-Alignment: Overly Caution Health-Related Responses From LLMs are Unethical and Dangerouscited by 3
- 2024Generating Fearful Images: Investigating Potential Emotional Biases in Image-Generation Modelscited by 1
- 2025Erasing 'Ugly' from the Internet: Propagation of the Beauty Myth in Text-Image Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing Reward Models for High-quality Image Generation: Beyond Text-Image Alignment
- 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art
- 2025Follow-Your-Preference: Towards Preference-Aligned Image Inpainting
- 2025Anti-Aesthetics: Protecting Facial Privacy against Customized Text-to-Image Synthesis
- 2026Follow-Your-Preference++: Rethinking Preference Alignment for Image Inpainting
- 2026Personalizing Text-to-Image Generation to Individual Taste
- 2026TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design
- 2026The Algorithmic Gaze of Image Quality Assessment: An Audit and Trace Ethnography of the LAION-Aesthetics Predictor