mlsanityData to 14 Oct 2026

Learning User Preferences for Image Generation Model

arXiv 2508.08220 ↗First posted 11 Aug 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

User preference prediction requires a comprehensive and accurate understanding of individual tastes. This includes both surface-level attributes, such as color and style, and deeper content-related aspects, such as themes and composition. However, existing methods typically rely on general human preferences or assume static user profiles, often neglecting individual variability and the dynamic, multifaceted nature of personal taste. To address these limitations, we propose an approach built upon Multimodal Large Language Models, introducing contrastive preference loss and preference tokens to learn personalized user preferences from historical interactions. The contrastive preference loss is designed to effectively distinguish between user ''likes'' and ''dislikes'', while the learnable preference tokens capture shared interest representations among existing users, enabling the model to activate group-specific preferences and enhance consistency across similar users. Extensive experiments demonstrate our model outperforms other methods in preference prediction accuracy, effectively identifying users with similar aesthetic inclinations and providing more precise guidance for generating images that align with individual tastes. The project page is texttthttps://learn-user-pref.github.io/.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 11 Aug 2025.

Builds on

24 of 40 references.

References · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  7. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  10. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  11. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  12. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
12 more
  1. 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
  2. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  3. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  4. 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 252
  5. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 156
  6. 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimizationcited by 119
  7. 2024Measuring Style Similarity in Diffusion Modelscited by 109
  8. 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusioncited by 39
  9. 2023Enhancing Diffusion Models with Text-Encoder Reinforcement Learningcited by 30
  10. 2024ViPer: Visual Personalization of Generative Models via Individual Preference Learningcited by 17
  11. 2025V2Flow: Unifying Visual Tokenization and Large Language Model Vocabularies for Autoregressive Image Generationcited by 6
  12. 2024Uniform Attention Maps: Boosting Image Fidelity in Reconstruction and Editingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Personalize at Test Time: Learning User Preferences for Image Generation
  2. 2026Personalizing Text-to-Image Generation to Individual Taste
  3. 2026Premier: Personalized Preference Modulation with Learnable User Embedding in Text-to-Image Generation
  4. 2025Personalized Image Generation for Recommendations Beyond Catalogs
  5. 2026TailorMind: Towards Preference-Aligned Multimodal Content Generation
  6. 2025ImageGem: In-the-wild Generative Image Interaction Dataset for Generative Model Personalization
  7. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis
  8. 2025Personalized Preference Fine-tuning of Diffusion Models