CAP: Evaluation of Persuasive and Creative Image Generation
Not on the map. Why?
Abstract (arXiv)
We address the task of advertisement image generation and introduce three evaluation metrics to assess Creativity, prompt Alignment, and Persuasiveness (CAP) in generated advertisement images. Despite recent advancements in Text-to-Image (T2I) generation and their performance in generating high-quality images for explicit descriptions, evaluating these models remains challenging. Existing evaluation methods focus largely on assessing alignment with explicit, detailed descriptions, but evaluating alignment with visually implicit prompts remains an open problem. Additionally, creativity and persuasiveness are essential qualities that enhance the effectiveness of advertisement images, yet are seldom measured. To address this, we propose three novel metrics for evaluating the creativity, alignment, and persuasiveness of generated images. Our findings reveal that current T2I models struggle with creativity, persuasiveness, and alignment when the input text is implicit messages. We further introduce a simple yet effective approach to enhance T2I models' capabilities in producing images that are better aligned, more creative, and more persuasive.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 32 of its 62 references that are in the map. First posted on arXiv 10 Dec 2024.
Builds on
32 of 62 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2023Qwen Technical Reportcited by 3,344
- 2016Improved Techniques for Training GANscited by 2,970
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
20 more
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
- 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
- 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 108
- 2017Automatic Understanding of Image and Video Advertisementscited by 68
- 2023IdealGPT: Iteratively Decomposing Vision and Language Reasoning via Large Language Modelscited by 47
- 2024Can Language Models Recognize Convincing Arguments?cited by 21
- 2024EVALALIGN: Supervised Fine-Tuning Multimodal LLMs with Human-Aligned Data for Evaluating Text-to-Image Modelscited by 20
- 2024Measuring and Improving Persuasiveness of Large Language Modelscited by 20
- 2023Text-to-Image Generation for Abstract Conceptscited by 18
- 2023A Video Is Worth 4096 Tokens: Verbalize Videos To Understand Them In Zero Shotcited by 11
- 2024Prompt Optimizer of Text-to-Image Diffusion Models for Abstract Concept Understandingcited by 9
- 2024Social Reward: Evaluating and Enhancing Generative AI through Million-User Feedback from an Online Creative Communitycited by 8
- 2024Persuasiveness of Generated Free-Text Rationales in Subjective Decisions: A Case Study on Pairwise Argument Rankingcited by 7
- 2024Benchmarking VLMs' Reasoning About Persuasive Atypical Imagescited by 5
- 2018Persuasive Faces: Generating Faces in Advertisementscited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Culture in Action: Evaluating Text-to-Image Models through Social Activitiescited by 10
- 2025Evaluation of Cultural Competence of Vision-Language Modelscited by 3
- 2025Towards Generalization of Tactile Image Generation: Reference-Free Evaluation in a Leakage-Free Settingcited by 1
- 2026Sense it with your eyes: Sensation Generation and Understanding for Advertisementscited by 0
- 2026CogenPVG: Cognitive-Enhanced Reflective Multi-Agent Framework for Persuasive Video Generationcited by 0
- 2026CogenPVG: Cognitive-Enhanced Reflective Multi-Agent Framework for Persuasive Video Generation22 Sep 2026
- 2026Sense it with your eyes: Sensation Generation and Understanding for Advertisements28 Jul 2026
- 2025Culture in Action: Evaluating Text-to-Image Models through Social Activities7 Nov 2025
- 2025Evaluation of Cultural Competence of Vision-Language Models28 May 2025
- 2025Towards Generalization of Tactile Image Generation: Reference-Free Evaluation in a Leakage-Free Setting10 Mar 2025