Evolving Creatives with Clicks: CTR-Driven Advertising image Editing via Attribute Disentanglement and Preference Alignment
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
The optimization objective for e-commerce advertising creatives has shifted from aesthetic quality to online business metrics like click-through rate (CTR). Recent methods generate appealing ad images from product images by constructing CTR-based reward signals and refining prompt generation via Reinforcement Learning. Such paradigms equally penalize all attributes within an underperforming image, even though some are actually beneficial to clicks. In this work, we propose Evolving Creatives with Clicks (ECC), which reformulates creative optimization as fine-grained editing rather than generation from scratch. ECC selectively refines attributes that hurt CTR while preserving those that contribute positively. Specifically, faced with a rich attribute space across massive images, ECC first identifies 28 attributes significantly correlated with CTR via ANOVA and Random Forest regression. Based on attribute contrasts between images with disparate CTRs, we instruction-tune a prompt model to generate editing suggestions, then refine it with real click preferences since reference-derived suggestions are not uniformly beneficial. Furthermore, we introduce Consistent Preference Optimization (CPO) as ECC's preference optimization strategy, which enforces consistency across semantically equivalent shuffled suggestions to mitigate DPO overfitting and improve preference generalization. Extensive experiments demonstrate that ECC significantly improves the CTR of ad images, outperforming state-of-the-art models by a substantial margin. The complete data pipeline, including attribute extraction and analysis, the resulting dataset, and source code will be released upon acceptance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 27 of its 40 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
27 of 40 references.
References · 27
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
15 more
- 2024Provably Robust DPO: Aligning Language Models with Noisy Feedbackcited by 135
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 61
- 2023Relation-Aware Diffusion Model for Controllable Poster Layout Generationcited by 37
- 2024Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergencecited by 31
- 2020Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinementcited by 29
- 2024A New Creative Generation Pipeline for Click-Through Rate with Stable Diffusion Modelcited by 27
- 2024On the Limited Generalization Capability of the Implicit Reward Model Induced by Direct Preference Optimizationcited by 27
- 2022CREATER: CTR-driven Advertising Text Generation with Controlled Pre-Training and Contrastive Fine-Tuningcited by 17
- 2024Towards Reliable Advertising Image Generation Using Human Feedbackcited by 16
- 2021A Hybrid Bandit Model with Visual Priors for Creative Ranking in Display Advertisingcited by 15
- 2024VirtualModel: Generating Object-ID-retentive Human-object Interaction Image by Diffusion Model for E-commerce Marketingcited by 15
- 2021Automated Creative Optimization for E-Commerce Advertisingcited by 13
- 2017Image Matters: Visually modeling user behaviors using Advanced Model Servercited by 12
- 2024Instruction-based Image Manipulation by Watching How Things Movecited by 12
- 2023Staging E-Commerce Products for Online Advertising using Retrieval Assisted Image Generationcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CTR-Driven Advertising Image Generation with Multimodal Large Language Models
- 2025Generative Modeling with Multi-Instance Reward Learning for E-commerce Creative Optimization
- 2023AdBooster: Personalized Ad Creative Generation using Stable Diffusion Outpainting
- 2026One Size, Many Fits: Aligning Diverse Group-Wise Click Preferences in Large-Scale Advertising Image Generation
- 2025CTR-Driven Ad Text Generation via Online Feedback Preference Optimization
- 2026RewardHarness: Self-Evolving Agentic Post-Training
- 2026CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning
- 2026RELATE: A Reinforcement Learning-Enhanced LLM Framework for Advertising Text Generation