mlsanityData to 7 Oct 2026

Opal: Multimodal Image Generation for News Illustration

arXiv 2204.09007 ↗First posted 19 Apr 2022cs.HCcited by 36

Not on the map. Why?

Abstract (arXiv)

Advances in multimodal AI have presented people with powerful ways to create images from text. Recent work has shown that text-to-image generations are able to represent a broad range of subjects and artistic styles. However, finding the right visual language for text prompts is difficult. In this paper, we address this challenge with Opal, a system that produces text-to-image generations for news illustration. Given an article, Opal guides users through a structured search for visual concepts and provides a pipeline allowing users to generate illustrations based on an article's tone, keywords, and related artistic styles. Our evaluation shows that Opal efficiently generates diverse sets of news illustrations, visual assets, and concept ideas. Users with Opal generated two times more usable results than users without. We discuss how structured exploration can help users better understand the capabilities of human AI co-creative systems.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Apr 2022.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 17; 2024: 10; 2025: 6.

36 papers.

Sort:

By area:

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
  3. 2023Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creationcited by 63
  4. 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
  5. 2023PromptMagician: Interactive Prompt Engineering for Text-to-Image Creationcited by 58
  6. 2023Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directionscited by 55
  7. 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editingcited by 47
  8. 2022CLIP-Sculptor: Zero-Shot Generation of High-Fidelity and Diverse Shapes from Natural Languagecited by 46
  9. 2023RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressionscited by 43
  10. 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
  11. 2023PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactionscited by 34
  12. 2023ConstitutionMaker: Interactively Critiquing Large Language Models by Converting Feedback into Principlescited by 33
24 more
  1. 2023I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphorscited by 31
  2. 2023Generation Probabilities Are Not Enough: Uncertainty Highlighting in AI Code Completionscited by 20
  3. 2023Generative Disco: Text-to-Video Generation for Music Visualizationcited by 19
  4. 2023ReelFramer: Human-AI Co-Creation for News-to-Video Translationcited by 19
  5. 2023Designing LLM Chains by Adapting Techniques from Crowdsourcing Workflowscited by 17
  6. 2023VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representationcited by 14
  7. 2024Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI Workflowcited by 13
  8. 2023PromptInfuser: How Tightly Coupling AI and UI Design Impacts Designers' Workflowscited by 8
  9. 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
  10. 2024A User-Friendly Framework for Generating Model-Preferred Prompts in Text-to-Image Synthesiscited by 7
  11. 2022The Infinite Index: Information Retrieval on Generative Text-To-Image Modelscited by 6
  12. 2023PromptCrafter: Crafting Text-to-Image Prompt through Mixed-Initiative Dialogue with LLMcited by 6
  13. 2025DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Designcited by 6
  14. 2025Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflowscited by 6
  15. 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
  16. 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
  17. 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedbackcited by 4
  18. 2024Taming Text-to-Image Synthesis for Novices: User-centric Prompt Generation via Multi-turn Guidancecited by 4
  19. 2023ViPE: Visualise Pretty-much Everythingcited by 3
  20. 2024From Pampas to Pixels: Fine-Tuning Diffusion Models for Ga'ucho Heritagecited by 3
  21. 2024BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AIcited by 3
  22. 2025Exploring Language Patterns of Prompts in Text-to-Image Generation and Their Impact on Visual Diversitycited by 3
  23. 2024POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Modelscited by 1
  24. 2024Thing2Reality: Transforming 2D Content into Conditioned Multiviews and 3D Gaussian Objects for XR Communicationcited by 0