Next Steps for Human-Centered Generative AI: A Technical Perspective
Not on the map. Why?
Abstract (arXiv)
Through iterative, cross-disciplinary discussions, we define and propose next-steps for Human-centered Generative AI (HGAI). We contribute a comprehensive research agenda that lays out future directions of Generative AI spanning three levels: aligning with human values; assimilating human intents; and augmenting human abilities. By identifying these next-steps, we intend to draw interdisciplinary research teams to pursue a coherent set of emergent ideas in HGAI, focusing on their interested topics while maintaining a coherent big picture of the future work landscape.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 70 of its 170 references that are in the map. First posted on arXiv 27 Jun 2023.
Builds on
70 of 170 references.
References · 70
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Segment Anythingcited by 8,234
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
38 more
- 2018Datasheets for Datasetscited by 1,386
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2020Concept Bottleneck Modelscited by 1,032
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 304
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
- 2023The False Promise of Imitating Proprietary LLMscited by 263
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
- 2020Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generationcited by 141
- 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
- 2022Training Language Models with Memory Augmentationcited by 113
- 2020Towards Controllable Biases in Language Generationcited by 112
- 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
- 2023Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Taskscited by 103
- 2019Gmail Smart Compose: Real-Time Assisted Writingcited by 98
- 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
- 2023Tractable Control for Autoregressive Language Generationcited by 65
- 2020Conceptual Metaphors Impact Perceptions of Human-AI Collaborationcited by 47
- 2022Investigating Explainability of Generative AI for Code through Scenario-based Designcited by 47
- 2017Machine Teaching: A New Paradigm for Building Machine Learning Systemscited by 41
- 2022Controllable Text Generation with Neurally-Decomposed Oraclecited by 41
- 2022Certified Neural Network Watermarks with Randomized Smoothingcited by 41
- 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
- 2023Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learningcited by 41
- 2023Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Promptingcited by 36
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2023: 6; 2024: 3; 2025: 4.
13 papers.
Sort:
By area:
- 2023Can LLM-Generated Misinformation Be Detected?cited by 177
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
- 2023Beyond the Chat: Executable and Verifiable Text-Editing with LLMscited by 35
- 2023Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domainscited by 15
- 2024OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMscited by 10
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
- 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILEcited by 3
- 2025Prototyping Multimodal GenAI Real-Time Agents with Counterfactual Replays and Hybrid Wizard-of-Ozcited by 2
- 2023Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorialcited by 1
- 2024GenLens: A Systematic Evaluation of Visual GenAI Model Outputscited by 1
- 2025A Human-Centered Approach to Identifying Promises, Risks, & Challenges of Text-to-Image Generative AI in Radiologycited by 0
1 more
- 2025Prototyping Multimodal GenAI Real-Time Agents with Counterfactual Replays and Hybrid Wizard-of-Oz8 Oct 2025
- 2025XR Blocks: Accelerating Human-centered AI + XR Innovation29 Sep 2025
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design21 Aug 2025
- 2025A Human-Centered Approach to Identifying Promises, Risks, & Challenges of Text-to-Image Generative AI in Radiology22 Jul 2025
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILE20 Dec 2024
- 2024OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMs6 May 2024
- 2024GenLens: A Systematic Evaluation of Visual GenAI Model Outputs6 Feb 2024
- 2023Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domains25 Nov 2023
- 2023The Value-Sensitive Conversational Agent Co-Design Framework18 Oct 2023
- 2023Beyond the Chat: Executable and Verifiable Text-Editing with LLMs27 Sep 2023
- 2023Art or Artifice? Large Language Models and the False Promise of Creativity25 Sep 2023
- 2023Can LLM-Generated Misinformation Be Detected?25 Sep 2023
- 2023Can LLM-Generated Misinformation Be Detected?cited by 177
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
- 2023Beyond the Chat: Executable and Verifiable Text-Editing with LLMscited by 35
- 2023Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domainscited by 15
- 2024OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMscited by 10
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILEcited by 3
- 2024GenLens: A Systematic Evaluation of Visual GenAI Model Outputscited by 1
- 2025A Human-Centered Approach to Identifying Promises, Risks, & Challenges of Text-to-Image Generative AI in Radiologycited by 0
- 2025XR Blocks: Accelerating Human-centered AI + XR Innovationcited by 0
- 2025XR Blocks: Accelerating Human-centered AI + XR Innovation29 Sep 2025
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design21 Aug 2025
- 2025A Human-Centered Approach to Identifying Promises, Risks, & Challenges of Text-to-Image Generative AI in Radiology22 Jul 2025
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILE20 Dec 2024
- 2024OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMs6 May 2024
- 2024GenLens: A Systematic Evaluation of Visual GenAI Model Outputs6 Feb 2024
- 2023Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domains25 Nov 2023
- 2023Beyond the Chat: Executable and Verifiable Text-Editing with LLMs27 Sep 2023
- 2023Art or Artifice? Large Language Models and the False Promise of Creativity25 Sep 2023
- 2023Can LLM-Generated Misinformation Be Detected?25 Sep 2023