Utility-Aware Multimodal Contrastive Learning for Product Image Generation
Not on the map. Why?
Abstract (arXiv)
Product images strongly influence consumer decision-making in online marketplaces. Empowered by multimodal contrastive learning, generative AI can output images that closely align with text prompts. Yet existing generative AI models do not directly optimize marketplace performance. This is a critical gap, since semantic alignment alone does not guarantee that an image will sell. To address this limitation, we propose a textitutility-aware multimodal contrastive learning framework that incorporates consumer demand into a novel Utility-Aware InfoNCE loss. Optimizing this utility-aware objective guides generation toward images that are both semantically coherent and demand-enhancing. This effect arises directly from a shift in the learned image-text representation space toward demand-driven visual cues, which we also validate through the theoretical bound of the proposed objective. In downstream applications on Amazon and Airbnb, product images generated and edited by our method outperform state-of-the-art models in increasing demand and preserving fidelity, while maintaining text-image consistency. Notably, our utility-aware framework preserves inverse U-shaped demand patterns for attributes such as aesthetics and uniqueness, improving demand-based performance while preserving fidelity and semantic consistency. Human-subject experiments further validate its commercial effectiveness. As generative AI technology continues to evolve, our utility-aware component can be flexibly embedded into emerging generative models to improve direct commercial use.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 27 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
11 of 27 references.
References · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2017NIMA: Neural Image Assessmentcited by 387
- 2023The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspectivecited by 57
- 2024LOLA: LLM-Assisted Online Learning Algorithm for Content Experimentscited by 18
- 2023Optimizing Scalable Targeted Marketing Policies with Constraintscited by 3
- 2024Asymptotic Behavior of Adversarial Training Estimator under ℓ_∞-Perturbationcited by 1
Built on by
Not cited yet.