mlsanityData to 14 Oct 2026

ChatGPT and U(X): A Rapid Review on Measuring the User Experience

arXiv 2503.15808 ↗First posted 20 Mar 2025cs.HC cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

ChatGPT, powered by a large language model (LLM), has revolutionized everyday human-computer interaction (HCI) since its 2022 release. While now used by millions around the world, a coherent pathway for evaluating the user experience (UX) ChatGPT offers remains missing. In this rapid review (N = 58), I explored how ChatGPT UX has been approached quantitatively so far. I focused on the independent variables (IVs) manipulated, the dependent variables (DVs) measured, and the methods used for measurement. Findings reveal trends, gaps, and emerging consensus in UX assessments. This work offers a first step towards synthesizing existing approaches to measuring ChatGPT UX, urgent trajectories to advance standardization and breadth, and two preliminary frameworks aimed at guiding future research and tool development. I seek to elevate the field of ChatGPT UX by empowering researchers and practitioners in optimizing user interactions with ChatGPT and similar LLM-based systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 129 references that are in the map. First posted on arXiv 20 Mar 2025.

Builds on

22 of 129 references.

References · 22

  1. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
  2. 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 148
  3. 2023DirectGPT: A Direct Manipulation Interface to Interact with Large Language Modelscited by 32
  4. 2024Why and When LLM-Based Assistants Can Go Wrong: Investigating the Effectiveness of Prompt-Based Interactions for Software Help-Seekingcited by 26
  5. 2018The State of Speech in HCI: Trends, Themes and Challengescited by 21
  6. 2024CloChat: Understanding How People Customize, Interact, and Experience Personas in Large Language Modelscited by 19
  7. 2023Improved Trust in Human-Robot Collaboration with ChatGPTcited by 18
  8. 2024Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulationcited by 18
  9. 2023Let's have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitationscited by 16
  10. 2023Nonverbal Cues in Human-Robot Interaction: A Communication Studies Perspectivecited by 16
  11. 2023User Interaction Patterns and Breakdowns in Conversing with LLM-Powered Voice Assistantscited by 15
  12. 2024HILL: A Hallucination Identifier for Large Language Modelscited by 11
10 more
  1. 2023Closing the Loop: Testing ChatGPT to Generate Model Explanations to Improve Human Labelling of Sponsored Content on Social Mediacited by 9
  2. 2021Measuring Voice UX Quantitatively: A Rapid Reviewcited by 6
  3. 2024CUI@CHI 2024: Building Trust in CUIs-From Design to Deploymentcited by 6
  4. 2024Silver-Tongued and Sundry: Exploring Intersectional Pronouns with ChatGPTcited by 6
  5. 2024User Centric Evaluation of Code Generation Toolscited by 5
  6. 2024Enhancing Programming Error Messages in Real Time with Generative AIcited by 3
  7. 2023The Systematic Review-lution: A Manifesto to Promote Rigour and Inclusivity in Research Synthesiscited by 2
  8. 2023The Partner Modelling Questionnaire: A validated self-report measure of perceptions toward machines as dialogue partnerscited by 2
  9. 2024Unraveling the Dilemma of AI Errors: Exploring the Effectiveness of Human and Machine Explanations for Large Language Modelscited by 2
  10. 2023The Impact of Performance Expectancy, Workload, Risk, and Satisfaction on Trust in ChatGPT: Cross-sectional Survey Analysiscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Digital Companionship: Overlapping Uses of AI Companions and AI Assistantscited by 7