Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation
Not on the map. Why?
Abstract (arXiv)
Thanks to their generative capabilities, large language models (LLMs) have become an invaluable tool for creative processes. These models have the capacity to produce hundreds and thousands of visual and textual outputs, offering abundant inspiration for creative endeavors. But are we harnessing their full potential? We argue that current interaction paradigms fall short, guiding users towards rapid convergence on a limited set of ideas, rather than empowering them to explore the vast latent design space in generative models. To address this limitation, we propose a framework that facilitates the structured generation of design space in which users can seamlessly explore, evaluate, and synthesize a multitude of responses. We demonstrate the feasibility and usefulness of this framework through the design and development of an interactive system, Luminate, and a user study with 14 professional writers. Our work advances how we interact with LLMs for creative tasks, introducing a way to harness the creative potential of LLMs.
Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). Builds on 7 of its 42 references that are in the map. First posted on arXiv 19 Oct 2023.
Builds on
7 of 42 references.
References · 7
- 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
- 2023Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Modelscited by 48
- 2022Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summariescited by 47
- 2022Opal: Multimodal Image Generation for News Illustrationcited by 36
- 2023Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Toolscited by 17
- 2022CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytellingcited by 14
- 2023CrossCode: Multi-level Visualization of Program Executioncited by 2
Built on by
Citing papers per year: 2024: 6; 2025: 32; 2026: 26.
64 papers.
Sort:
By area:
- 2025Modifying Large Language Model Post-Training for Diverse Creative Writingcited by 40
- 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
- 2025Literature-Grounded Novelty Assessment of Scientific Ideascited by 19
- 2025Classroom Simulacra: Building Contextual Student Generative Agents in Online Education for Learning Behavioral Simulationcited by 15
- 2024Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI Workflowcited by 14
- 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
- 2025AI Chatbots for Mental Health: Values and Harms from Lived Experiences of Depressioncited by 13
- 2024Augmented Object Intelligence with XR-Objectscited by 12
- 2024Guiding and Diversifying LLM-Based Story Generation via Answer Set Programmingcited by 9
- 2025From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysiscited by 9
- 2025WhatELSE: Shaping Narrative Spaces at Configurable Level of Abstraction for AI-bridged Interactive Storytellingcited by 8
- 2025AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Toolscited by 8
38 more
- 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
- 2025Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systemscited by 7
- 2025DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Designcited by 6
- 2025Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflowscited by 6
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generationcited by 6
- 2025CHIMERA: A Knowledge Base of Scientific Idea Recombinations for Research Analysis and Ideationcited by 6
- 2025Surfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptionscited by 6
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Taskscited by 6
- 2025Interaction as Intelligence: Deep Research With Human-AI Partnershipcited by 5
- 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedbackcited by 4
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgetscited by 3
- 2025NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modificationcited by 3
- 2025Evalet: Evaluating Large Language Models through Functional Fragmentationcited by 3
- 2024CUPID: Contextual Understanding of Prompt-conditioned Image Distributionscited by 2
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writingcited by 2
- 2025Scaffolding Recursive Divergence and Convergence in Story Ideationcited by 2
- 2025StoryEnsemble: Enabling Dynamic Exploration & Iteration in the Design Process with AI and Forward-Backward Propagationcited by 2
- 2025ThematicPlane: Bridging Tacit User Intent and Latent Spaces for Image Generationcited by 2
- 2025The AI Memory Gap: Users Misremember What They Created With AI or Withoutcited by 2
- 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Modelscited by 2
- 2026Texterial: A Text-as-Material Interaction Paradigm for LLM-Mediated Writingcited by 2
- 2026Where You Inject Diversity Matters: A Unified Framework for Diverse Generationcited by 2
- 2025AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulationscited by 1
- 2025Steerable Chatbots: Exploring Personalization Control Interfaces via LLM Activation Steeringcited by 1
- 2025HiLDe: Intentional Code Generation via Human-in-the-Loop Decodingcited by 1
- 2025CareerPooler: AI-Powered Metaphorical Pool Simulation Improves Experience and Outcomes in Career Explorationcited by 1
- 2026Bridging Gulfs in UI Generation through Semantic Guidancecited by 1
- 2026InterDeepResearch: Enabling Human-Agent Collaborative Information Seeking through Interactive Deep Researchcited by 1
- 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Taskscited by 1
- 2026PSI: Shared State as the Missing Layer for Coherent AI-Generated Instruments in Personal AI Agentscited by 1
- 2026Narrative Keyframing for Generative Creative Writingcited by 1
- 2025The Role of Visualization in LLM-Assisted Knowledge Graph Systems: Effects on User Trust, Exploration, and Workflowscited by 0
- 2026TreeWriter: AI-Assisted Hierarchical Planning and Writing for Long-Form Documentscited by 0
- 2025Elsewise: Authoring Open-ended Interactive Narrative with Possibility Space Visualizationcited by 0
- 2026Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluationcited by 0
- 2026An Embodied Companion for Visual Storytellingcited by 0
- 2026Brief2Design: A Multi-phased, Compositional Approach to Prompt-based Graphic Designcited by 0
- 2026Alignment has a Fantasia Problemcited by 0
50 most cited of 64 All 64 (JSON)
- 2026VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents3 Oct 2026
- 2026NarrativeSteward: Coordinating Delegation, Guidance, and Verification in Agent-Assisted Interactive Narrative Authoring30 Sep 2026
- 2026Personalizing Personal Health Interfaces: Co-Design with Generative AI14 Sep 2026
- 2026PeerPen: AI-Assisted Writing for Online Mental Health Peer Support14 Sep 2026
- 2026The Garden of Forking Prompts: How Users Explore Narrative Space in Story Generation13 Sep 2026
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026Narrative Keyframing for Generative Creative Writing11 Aug 2026
- 2026VeriForge: Mitigating Latent Knowledge Gaps in Narrative Drafting via Mixed-Initiative Scaffolding10 Aug 2026
- 2026Where You Inject Diversity Matters: A Unified Framework for Diverse Generation9 Jun 2026
- 2026Seeing the Hivemind: A Consensus-Aware Interaction Technique for Mitigating AI Homogenization8 Jun 2026
- 2026Language as a Material Interface for Creative LLM Interaction25 May 2026
- 2026Conversations in Space: Non-Linear LLM Interaction in Everyday Use15 May 2026
38 more
- 2026Co-Writing with AI: An Empirical Study of Diverse Academic Writing Workflows28 Apr 2026
- 2026Value-Sensitive AI for Prayer: Balancing the Agencies Between Human and AI Agents in Spiritual Context28 Apr 2026
- 2026MindTrellis: Co-Creating Knowledge Structures with AI through Interactive Visual Exploration25 Apr 2026
- 2026Alignment has a Fantasia Problem23 Apr 2026
- 2026Brief2Design: A Multi-phased, Compositional Approach to Prompt-based Graphic Design13 Apr 2026
- 2026PSI: Shared State as the Missing Layer for Coherent AI-Generated Instruments in Personal AI Agents9 Apr 2026
- 2026Beyond Compliance: How AI Could Help Creative Writers by Refusing Them3 Apr 2026
- 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Tasks19 Mar 2026
- 2026InterDeepResearch: Enabling Human-Agent Collaborative Information Seeking through Interactive Deep Research13 Mar 2026
- 2026Texterial: A Text-as-Material Interaction Paradigm for LLM-Mediated Writing28 Feb 2026
- 2026Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluation10 Feb 2026
- 2026Bridging Gulfs in UI Generation through Semantic Guidance27 Jan 2026
- 2026TreeWriter: AI-Assisted Hierarchical Planning and Writing for Long-Form Documents19 Jan 2026
- 2026An Embodied Companion for Visual Storytelling18 Jan 2026
- 2025Elsewise: Authoring Open-ended Interactive Narrative with Possibility Space Visualization21 Dec 2025
- 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Models20 Dec 2025
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Tasks6 Oct 2025
- 2025Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems18 Sep 2025
- 2025The AI Memory Gap: Users Misremember What They Created With AI or Without15 Sep 2025
- 2025CareerPooler: AI-Powered Metaphorical Pool Simulation Improves Experience and Outcomes in Career Exploration14 Sep 2025
- 2025Evalet: Evaluating Large Language Models through Functional Fragmentation14 Sep 2025
- 2025ThematicPlane: Bridging Tacit User Intent and Latent Spaces for Image Generation8 Aug 2025
- 2025StoryEnsemble: Enabling Dynamic Exploration & Iteration in the Design Process with AI and Forward-Backward Propagation5 Aug 2025
- 2025NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modification5 Aug 2025
- 2025Interaction as Intelligence: Deep Research With Human-AI Partnership21 Jul 2025
- 2025Surfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptions21 Jul 2025
- 2025Scaffolding Recursive Divergence and Convergence in Story Ideation4 Jul 2025
- 2025Literature-Grounded Novelty Assessment of Scientific Ideas27 Jun 2025
- 2025PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writing4 Jun 2025
- 2025HiLDe: Intentional Code Generation via Human-in-the-Loop Decoding28 May 2025
- 2025CHIMERA: A Knowledge Base of Scientific Idea Recombinations for Research Analysis and Ideation27 May 2025
- 2025The Role of Visualization in LLM-Assisted Knowledge Graph Systems: Effects on User Trust, Exploration, and Workflows20 May 2025
- 2025Steerable Chatbots: Exploring Personalization Control Interfaces via LLM Activation Steering7 May 2025
- 2025AI Chatbots for Mental Health: Values and Harms from Lived Experiences of Depression26 Apr 2025
- 2025POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generation18 Apr 2025
- 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process16 Apr 2025
- 2025AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulations13 Apr 2025
- 2025Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets27 Mar 2025
50 newest of 64 All 64 (JSON)
- 2025Classroom Simulacra: Building Contextual Student Generative Agents in Online Education for Learning Behavioral Simulationcited by 15
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Taskscited by 6
- 2025AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulationscited by 1
- 2026InterDeepResearch: Enabling Human-Agent Collaborative Information Seeking through Interactive Deep Researchcited by 1
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysiscited by 0
- 2026AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis18 Aug 2026
- 2026InterDeepResearch: Enabling Human-Agent Collaborative Information Seeking through Interactive Deep Research13 Mar 2026
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Tasks6 Oct 2025
- 2025AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulations13 Apr 2025
- 2025Classroom Simulacra: Building Contextual Student Generative Agents in Online Education for Learning Behavioral Simulation4 Feb 2025
- 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
- 2025Literature-Grounded Novelty Assessment of Scientific Ideascited by 19
- 2024Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI Workflowcited by 14
- 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
- 2025AI Chatbots for Mental Health: Values and Harms from Lived Experiences of Depressioncited by 13
- 2024Augmented Object Intelligence with XR-Objectscited by 12
- 2024Guiding and Diversifying LLM-Based Story Generation via Answer Set Programmingcited by 9
- 2025From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysiscited by 9
- 2025WhatELSE: Shaping Narrative Spaces at Configurable Level of Abstraction for AI-bridged Interactive Storytellingcited by 8
- 2025AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Toolscited by 8
- 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
- 2025Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systemscited by 7
12 most cited of 55 All 55 (JSON)
- 2026VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents3 Oct 2026
- 2026NarrativeSteward: Coordinating Delegation, Guidance, and Verification in Agent-Assisted Interactive Narrative Authoring30 Sep 2026
- 2026Personalizing Personal Health Interfaces: Co-Design with Generative AI14 Sep 2026
- 2026PeerPen: AI-Assisted Writing for Online Mental Health Peer Support14 Sep 2026
- 2026The Garden of Forking Prompts: How Users Explore Narrative Space in Story Generation13 Sep 2026
- 2026Narrative Keyframing for Generative Creative Writing11 Aug 2026
- 2026VeriForge: Mitigating Latent Knowledge Gaps in Narrative Drafting via Mixed-Initiative Scaffolding10 Aug 2026
- 2026Where You Inject Diversity Matters: A Unified Framework for Diverse Generation9 Jun 2026
- 2026Seeing the Hivemind: A Consensus-Aware Interaction Technique for Mitigating AI Homogenization8 Jun 2026
- 2026Language as a Material Interface for Creative LLM Interaction25 May 2026
- 2026Conversations in Space: Non-Linear LLM Interaction in Everyday Use15 May 2026
- 2026Co-Writing with AI: An Empirical Study of Diverse Academic Writing Workflows28 Apr 2026
12 newest of 55 All 55 (JSON)