Conversational AI Powered by Large Language Models Amplifies False Memories in Witness Interviews
Not on the map. Why?
Abstract (arXiv)
This study examines the impact of AI on human false memories -- recollections of events that did not occur or deviate from actual occurrences. It explores false memory induction through suggestive questioning in Human-AI interactions, simulating crime witness interviews. Four conditions were tested: control, survey-based, pre-scripted chatbot, and generative chatbot using a large language model (LLM). Participants (N=200) watched a crime video, then interacted with their assigned AI interviewer or survey, answering questions including five misleading ones. False memories were assessed immediately and after one week. Results show the generative chatbot condition significantly increased false memory formation, inducing over 3 times more immediate false memories than the control and 1.7 times more than the survey method. 36.4% of users' responses to the generative chatbot were misled through the interaction. After one week, the number of false memories induced by generative chatbots remained constant. However, confidence in these false memories remained higher than the control after one week. Moderating factors were explored: users who were less familiar with chatbots but more familiar with AI technology, and more interested in crime investigations, were more susceptible to false memories. These findings highlight the potential risks of using advanced AI in sensitive contexts, like police interviews, emphasizing the need for ethical considerations.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 7 of its 37 references that are in the map. First posted on arXiv 8 Aug 2024.
Builds on
7 of 37 references.
References · 7
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 260
- 2024Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory Augmentationcited by 20
- 2022Deceptive AI Systems That Give Explanations Are Just as Convincing as Honest AI Systems in Human-Machine Decision Makingcited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 2.
5 papers.
- 2024Synthetic Human Memories: AI-Edited Images and Videos Can Implant False Memories and Distort Recollectioncited by 7
- 2025SCOPE: Stochastic and Counterbiased Option Placement for Evaluating Large Language Modelscited by 2
- 2026If LLMs Have Human-Like Attributes, Then So Does Age of Empires IIcited by 2
- 2024If Eleanor Rigby Had Met ChatGPT: A Study on Loneliness in a Post-LLM Worldcited by 1
- 2026Auditing the Synthetic Memoir: Measuring Scene-Level Confabulation in LLM-Generated Autobiography Against the Documented Record of the Life It Describescited by 0
- 2026Auditing the Synthetic Memoir: Measuring Scene-Level Confabulation in LLM-Generated Autobiography Against the Documented Record of the Life It Describes23 Aug 2026
- 2026If LLMs Have Human-Like Attributes, Then So Does Age of Empires II29 May 2026
- 2025SCOPE: Stochastic and Counterbiased Option Placement for Evaluating Large Language Models24 Jul 2025
- 2024If Eleanor Rigby Had Met ChatGPT: A Study on Loneliness in a Post-LLM World2 Dec 2024
- 2024Synthetic Human Memories: AI-Edited Images and Videos Can Implant False Memories and Distort Recollection13 Sep 2024