Learning User Preferences for Image Generation Model
Not on the map. Why?
Abstract (arXiv)
User preference prediction requires a comprehensive and accurate understanding of individual tastes. This includes both surface-level attributes, such as color and style, and deeper content-related aspects, such as themes and composition. However, existing methods typically rely on general human preferences or assume static user profiles, often neglecting individual variability and the dynamic, multifaceted nature of personal taste. To address these limitations, we propose an approach built upon Multimodal Large Language Models, introducing contrastive preference loss and preference tokens to learn personalized user preferences from historical interactions. The contrastive preference loss is designed to effectively distinguish between user ''likes'' and ''dislikes'', while the learnable preference tokens capture shared interest representations among existing users, enabling the model to activate group-specific preferences and enhance consistency across similar users. Extensive experiments demonstrate our model outperforms other methods in preference prediction accuracy, effectively identifying users with similar aesthetic inclinations and providing more precise guidance for generating images that align with individual tastes. The project page is texttthttps://learn-user-pref.github.io/.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
24 of 40 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
12 more
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 252
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 156
- 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimizationcited by 119
- 2024Measuring Style Similarity in Diffusion Modelscited by 109
- 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusioncited by 39
- 2023Enhancing Diffusion Models with Text-Encoder Reinforcement Learningcited by 30
- 2024ViPer: Visual Personalization of Generative Models via Individual Preference Learningcited by 17
- 2025V2Flow: Unifying Visual Tokenization and Large Language Model Vocabularies for Autoregressive Image Generationcited by 6
- 2024Uniform Attention Maps: Boosting Image Fidelity in Reconstruction and Editingcited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Personalized Reward Modeling for Text-to-Image Generationcited by 4
- 2025PrefGen: Multimodal Preference Learning for Preference-Conditioned Image Generationcited by 3
- 2026PIPBench: A Profile-Inclusive Framework for Personalized Image Generation Evaluationcited by 1
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessmentcited by 0
- 2026Pareto-Guided Optimal Transport for Multi-Reward Alignmentcited by 0
- 2026PIPBench: A Profile-Inclusive Framework for Personalized Image Generation Evaluation7 Jul 2026
- 2026Pareto-Guided Optimal Transport for Multi-Reward Alignment13 May 2026
- 2025PrefGen: Multimodal Preference Learning for Preference-Conditioned Image Generation4 Dec 2025
- 2025Personalized Reward Modeling for Text-to-Image Generation21 Nov 2025
- 2025PreferThinker: Reasoning-based Personalized Image Preference Assessment1 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Personalize at Test Time: Learning User Preferences for Image Generation
- 2026Personalizing Text-to-Image Generation to Individual Taste
- 2026Premier: Personalized Preference Modulation with Learnable User Embedding in Text-to-Image Generation
- 2025Personalized Image Generation for Recommendations Beyond Catalogs
- 2026TailorMind: Towards Preference-Aligned Multimodal Content Generation
- 2025ImageGem: In-the-wild Generative Image Interaction Dataset for Generative Model Personalization
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis
- 2025Personalized Preference Fine-tuning of Diffusion Models