Large-scale Text-to-Image Generation Models for Visual Artists' Creative Works
Not on the map. Why?
Abstract (arXiv)
Large-scale Text-to-image Generation Models (LTGMs) (e.g., DALL-E), self-supervised deep learning models trained on a huge dataset, have demonstrated the capacity for generating high-quality open-domain images from multi-modal input. Although they can even produce anthropomorphized versions of objects and animals, combine irrelevant concepts in reasonable ways, and give variation to any user-provided images, we witnessed such rapid technological advancement left many visual artists disoriented in leveraging LTGMs more actively in their creative works. Our goal in this work is to understand how visual artists would adopt LTGMs to support their creative works. To this end, we conducted an interview study as well as a systematic literature review of 72 system/application papers for a thorough examination. A total of 28 visual artists covering 35 distinct visual art domains acknowledged LTGMs' versatile roles with high usability to support creative works in automating the creation process (i.e., automation), expanding their ideas (i.e., exploration), and facilitating or arbitrating in communication (i.e., mediation). We conclude by providing four design guidelines that future researchers can refer to in making intelligent user interfaces using LTGMs.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Oct 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 8; 2024: 20; 2025: 23; 2026: 8.
60 papers.
Sort:
By area:
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
- 2023Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writerscited by 32
- 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
- 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generationcited by 30
- 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscapecited by 18
- 2024Diffusion-Based Visual Art Creation: A Survey and New Perspectivescited by 17
- 2023Navigating Cultural Chasms: Exploring and Unlocking the Cultural POV of Text-To-Image Modelscited by 16
- 2025Deepfakes on Demand: the rise of accessible non-consensual deepfake image generatorscited by 15
- 2023"An Adapt-or-Die Type of Situation": Perception, Adoption, and Use of Text-To-Image-Generation AI by Game Industry Professionalscited by 11
38 more
- 2024PromptHive: Bringing Subject Matter Experts Back to the Forefront with Collaborative Prompt Engineering for Educational Content Creationcited by 9
- 2025PosterMate: Audience-driven Collaborative Persona Agents for Poster Designcited by 9
- 2024Imperceptible Protection against Style Imitation from Diffusion Modelscited by 8
- 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
- 2024A User-Friendly Framework for Generating Model-Preferred Prompts in Text-to-Image Synthesiscited by 7
- 2024Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generationcited by 7
- 2023Towards Mode Balancing of Generative Models via Diversity Weightscited by 6
- 2024From Paper to Card: Transforming Design Implications with Generative AIcited by 6
- 2024The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarkscited by 6
- 2025SketchFlex: Facilitating Spatial-Semantic Coherence in Text-to-Image Generation with Region-Based Sketchescited by 6
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
- 2024Controllable Human Image Generation with Personalized Multi-Garmentscited by 5
- 2025Do It For Me vs. Do It With Me: Investigating User Perceptions of Different Paradigms of Automation in Copilots for Feature-Rich Softwarecited by 5
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
- 2024AI-Assisted Causal Pathway Diagram for Human-Centered Designcited by 4
- 2024ECOR: Explainable CLIP for Object Recognitioncited by 4
- 2024Taming Text-to-Image Synthesis for Novices: User-centric Prompt Generation via Multi-turn Guidancecited by 4
- 2025SYNTHIA: Novel Concept Design with Affordance Compositioncited by 4
- 2025LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotationscited by 4
- 2024CAD-Prompted Generative Models: A Pathway to Feasible and Novel Engineering Designscited by 3
- 2024GreenStableYolo: Optimizing Inference Time and Image Quality of Text-to-Image Generationcited by 3
- 2025AI Rivalry as a Craft: How Resisting and Embracing Generative AI Reshape Writing Professionscited by 3
- 2025Exploring Language Patterns of Prompts in Text-to-Image Generation and Their Impact on Visual Diversitycited by 3
- 2025Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombinationcited by 3
- 2026Wan-Weaver: Interleaved Multi-modal Generation via Decoupled Trainingcited by 3
- 2024Composing Parts for Expressive Object Generationcited by 2
- 2025How Do Generative Models Draw a Software Engineer? A Case Study on Stable Diffusion Biascited by 2
- 2025LOCATEdit: Graph Laplacian Optimized Cross Attention for Localized Text-Guided Image Editingcited by 2
- 2025T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Modelscited by 2
- 2024Offline Evaluation of Set-Based Text-to-Image Generationcited by 1
- 2025DashChat: Interactive Authoring of Performance Dashboard Design Prototypes through Conversation with LLM-Powered Agentcited by 1
- 2025An Exploration of Default Images in Text-to-Image Generationcited by 1
- 2025LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfercited by 1
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluationcited by 1
- 2026Investigating Social Bias in Narrative Image Generationcited by 1
- 2023DeepArt: A Benchmark to Advance Fidelity Research in AI-Generated Contentcited by 0
- 2024Efficient Image Restoration through Low-Rank Adaptation and Stable Diffusion XLcited by 0
- 2024Empowering Clients -- Transformation of Design Processes Due to Generative AIcited by 0
50 most cited of 60 All 60 (JSON)
- 2026RAPID: A Real-Time Defense Against Unauthorized Model Distillation for Text-to-Image Services14 Sep 2026
- 2026From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Framework14 Aug 2026
- 2026Investigating Social Bias in Narrative Image Generation3 Aug 2026
- 2026Generative Bayesian Filtering for State Estimation9 Jul 2026
- 2026Hallucination Behavior in Multimodal LLMs Across Agricultural Image Interpretation and Generation Tasks26 May 2026
- 2026Wan-Weaver: Interleaved Multi-modal Generation via Decoupled Training26 Mar 2026
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation11 Mar 2026
- 2026BLK-Assist: A Methodological Framework for Artist-Led Co-Creation with Generative AI Models10 Mar 2026
- 2025LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfer22 Dec 2025
- 2025LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotations10 Dec 2025
- 2025PaintFlow: A Unified Framework for Interactive Oil Paintings Editing and Generation9 Dec 2025
- 2025T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Models13 Nov 2025
38 more
- 2025CIDER: A Causal Cure for Brand-Obsessed Text-to-Image Models19 Sep 2025
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design21 Aug 2025
- 2025Empowering Children to Create AI-Enabled Augmented Reality Experiences11 Aug 2025
- 2025PosterMate: Audience-driven Collaborative Persona Agents for Poster Design24 Jul 2025
- 2025SustainDiffusion: Optimising the Social and Environmental Sustainability of Stable Diffusion Models21 Jul 2025
- 2025Small Data Explainer -- The impact of small data methods in everyday life15 Jul 2025
- 2025An Exploration of Default Images in Text-to-Image Generation14 May 2025
- 2025Deepfakes on Demand: the rise of accessible non-consensual deepfake image generators6 May 2025
- 2025Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombination29 Apr 2025
- 2025Do It For Me vs. Do It With Me: Investigating User Perceptions of Different Paradigms of Automation in Copilots for Feature-Rich Software22 Apr 2025
- 2025Exploring Language Patterns of Prompts in Text-to-Image Generation and Their Impact on Visual Diversity19 Apr 2025
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generation18 Apr 2025
- 2025DashChat: Interactive Authoring of Performance Dashboard Design Prototypes through Conversation with LLM-Powered Agent17 Apr 2025
- 2025LOCATEdit: Graph Laplacian Optimized Cross Attention for Localized Text-Guided Image Editing27 Mar 2025
- 2025AI Rivalry as a Craft: How Resisting and Embracing Generative AI Reshape Writing Professions12 Mar 2025
- 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generation12 Mar 2025
- 2025SYNTHIA: Novel Concept Design with Affordance Composition25 Feb 2025
- 2025SketchFlex: Facilitating Spatial-Semantic Coherence in Text-to-Image Generation with Region-Based Sketches11 Feb 2025
- 2025How Do Generative Models Draw a Software Engineer? A Case Study on Stable Diffusion Bias15 Jan 2025
- 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation27 Nov 2024
- 2024Controllable Human Image Generation with Personalized Multi-Garments25 Nov 2024
- 2024Empowering Clients -- Transformation of Design Processes Due to Generative AI22 Nov 2024
- 2024MagicQuill: An Intelligent Interactive Image Editing System14 Nov 2024
- 2024Offline Evaluation of Set-Based Text-to-Image Generation22 Oct 2024
- 2024PromptHive: Bringing Subject Matter Experts Back to the Forefront with Collaborative Prompt Engineering for Educational Content Creation21 Oct 2024
- 2024The Cognitive Capabilities of Generative AI: A Comparative Analysis with Human Benchmarks9 Oct 2024
- 2024Efficient Image Restoration through Low-Rank Adaptation and Stable Diffusion XL30 Aug 2024
- 2024Taming Text-to-Image Synthesis for Novices: User-centric Prompt Generation via Multi-turn Guidance23 Aug 2024
- 2024Diffusion-Based Visual Art Creation: A Survey and New Perspectives22 Aug 2024
- 2024GreenStableYolo: Optimizing Inference Time and Image Quality of Text-to-Image Generation20 Jul 2024
- 2024CAD-Prompted Generative Models: A Pathway to Feasible and Novel Engineering Designs11 Jul 2024
- 2024Composing Parts for Expressive Object Generation14 Jun 2024
- 2024ECOR: Explainable CLIP for Object Recognition19 Apr 2024
- 2024Imperceptible Protection against Style Imitation from Diffusion Models28 Mar 2024
- 2024From Paper to Card: Transforming Design Implications with Generative AI12 Mar 2024
- 2024AI-Assisted Causal Pathway Diagram for Human-Centered Design12 Mar 2024
- 2024Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generation12 Mar 2024
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement6 Mar 2024
50 newest of 60 All 60 (JSON)
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
- 2024Imperceptible Protection against Style Imitation from Diffusion Modelscited by 8
- 2024Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generationcited by 7
- 2024Controllable Human Image Generation with Personalized Multi-Garmentscited by 5
- 2024CAD-Prompted Generative Models: A Pathway to Feasible and Novel Engineering Designscited by 3
- 2024Composing Parts for Expressive Object Generationcited by 2
- 2025How Do Generative Models Draw a Software Engineer? A Case Study on Stable Diffusion Biascited by 2
- 2024Efficient Image Restoration through Low-Rank Adaptation and Stable Diffusion XLcited by 0
- 2025SustainDiffusion: Optimising the Social and Environmental Sustainability of Stable Diffusion Modelscited by 0
- 2026BLK-Assist: A Methodological Framework for Artist-Led Co-Creation with Generative AI Modelscited by 0
- 2026RAPID: A Real-Time Defense Against Unauthorized Model Distillation for Text-to-Image Servicescited by 0
- 2026RAPID: A Real-Time Defense Against Unauthorized Model Distillation for Text-to-Image Services14 Sep 2026
- 2026BLK-Assist: A Methodological Framework for Artist-Led Co-Creation with Generative AI Models10 Mar 2026
- 2025SustainDiffusion: Optimising the Social and Environmental Sustainability of Stable Diffusion Models21 Jul 2025
- 2025How Do Generative Models Draw a Software Engineer? A Case Study on Stable Diffusion Bias15 Jan 2025
- 2024Controllable Human Image Generation with Personalized Multi-Garments25 Nov 2024
- 2024Efficient Image Restoration through Low-Rank Adaptation and Stable Diffusion XL30 Aug 2024
- 2024CAD-Prompted Generative Models: A Pathway to Feasible and Novel Engineering Designs11 Jul 2024
- 2024Composing Parts for Expressive Object Generation14 Jun 2024
- 2024Imperceptible Protection against Style Imitation from Diffusion Models28 Mar 2024
- 2024Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generation12 Mar 2024
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement6 Mar 2024
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Views29 Nov 2022
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generationcited by 30
- 2024ECOR: Explainable CLIP for Object Recognitioncited by 4
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluationcited by 1
- 2023DeepArt: A Benchmark to Advance Fidelity Research in AI-Generated Contentcited by 0
- 2026Hallucination Behavior in Multimodal LLMs Across Agricultural Image Interpretation and Generation Taskscited by 0
- 2026Hallucination Behavior in Multimodal LLMs Across Agricultural Image Interpretation and Generation Tasks26 May 2026
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation11 Mar 2026
- 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation27 Nov 2024
- 2024ECOR: Explainable CLIP for Object Recognition19 Apr 2024
- 2023DeepArt: A Benchmark to Advance Fidelity Research in AI-Generated Content16 Dec 2023
- 2023A Survey on Multimodal Large Language Models for Autonomous Driving21 Nov 2023
- 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
- 2023Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writerscited by 32
- 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
- 2024Diffusion-Based Visual Art Creation: A Survey and New Perspectivescited by 17
- 2023Navigating Cultural Chasms: Exploring and Unlocking the Cultural POV of Text-To-Image Modelscited by 16
- 2025Deepfakes on Demand: the rise of accessible non-consensual deepfake image generatorscited by 15
- 2023"An Adapt-or-Die Type of Situation": Perception, Adoption, and Use of Text-To-Image-Generation AI by Game Industry Professionalscited by 11
- 2024PromptHive: Bringing Subject Matter Experts Back to the Forefront with Collaborative Prompt Engineering for Educational Content Creationcited by 9
- 2025PosterMate: Audience-driven Collaborative Persona Agents for Poster Designcited by 9
- 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
- 2024A User-Friendly Framework for Generating Model-Preferred Prompts in Text-to-Image Synthesiscited by 7
- 2023Towards Mode Balancing of Generative Models via Diversity Weightscited by 6
12 most cited of 40 All 40 (JSON)
- 2026From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Framework14 Aug 2026
- 2026Investigating Social Bias in Narrative Image Generation3 Aug 2026
- 2026Generative Bayesian Filtering for State Estimation9 Jul 2026
- 2026Wan-Weaver: Interleaved Multi-modal Generation via Decoupled Training26 Mar 2026
- 2025LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfer22 Dec 2025
- 2025LongT2IBench: A Benchmark for Evaluating Long Text-to-Image Generation with Graph-structured Annotations10 Dec 2025
- 2025PaintFlow: A Unified Framework for Interactive Oil Paintings Editing and Generation9 Dec 2025
- 2025T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Models13 Nov 2025
- 2025CIDER: A Causal Cure for Brand-Obsessed Text-to-Image Models19 Sep 2025
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design21 Aug 2025
- 2025Empowering Children to Create AI-Enabled Augmented Reality Experiences11 Aug 2025
- 2025PosterMate: Audience-driven Collaborative Persona Agents for Poster Design24 Jul 2025
12 newest of 40 All 40 (JSON)