The Psychogenic Machine: Simulating AI Psychosis, Delusion Reinforcement and Harm Enablement in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Background: Emerging reports of "AI psychosis" are on the rise, where user-LLM interactions may exacerbate or induce psychosis or adverse psychological symptoms. Whilst the sycophantic and agreeable nature of LLMs can be beneficial, it becomes a vector for harm by reinforcing delusional beliefs in vulnerable users. Methods: Psychosis-bench is a novel benchmark designed to systematically evaluate the psychogenicity of LLMs comprises 16 structured, 12-turn conversational scenarios simulating the progression of delusional themes(Erotic Delusions, Grandiose/Messianic Delusions, Referential Delusions) and potential harms. We evaluated eight prominent LLMs for Delusion Confirmation (DCS), Harm Enablement (HES), and Safety Intervention(SIS) across explicit and implicit conversational contexts. Findings: Across 1,536 simulated conversation turns, all LLMs demonstrated psychogenic potential, showing a strong tendency to perpetuate rather than challenge delusions (mean DCS of 0.91 ±0.88). Models frequently enabled harmful user requests (mean HES of 0.69 ±0.84) and offered safety interventions in only roughly a third of applicable turns (mean SIS of 0.37 ±0.48). 51 / 128 (39.8%) of scenarios had no safety interventions offered. Performance was significantly worse in implicit scenarios, models were more likely to confirm delusions and enable harm while offering fewer interventions (p < .001). A strong correlation was found between DCS and HES (rs = .77). Model performance varied widely, indicating that safety is not an emergent property of scale alone. Conclusion: This study establishes LLM psychogenicity as a quantifiable risk and underscores the urgent need for re-thinking how we train LLMs. We frame this issue not merely as a technical challenge but as a public health imperative requiring collaboration between developers, policymakers, and healthcare professionals.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 10 of its 19 references that are in the map. First posted on arXiv 13 Sep 2025.
Builds on
10 of 19 references.
References · 10
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2019A Question-Entailment Approach to Question Answeringcited by 134
- 2025SycEval: Evaluating LLM Sycophancycited by 108
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 104
- 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 69
- 2025Sequential Diagnosis with Language Modelscited by 60
- 2025Technological folie `a deux: Feedback Loops Between AI Chatbots and Mental Illnesscited by 15
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026How RLHF Amplifies Sycophancycited by 23
- 2026AI Psychosis: Does Conversational AI Amplify Delusion-Related Language?cited by 5
- 2026Alignment midtraining for animalscited by 4
- 2026Architecting Trust in Artificial Epistemic Agentscited by 3
- 2026An Independent Safety Evaluation of Kimi K2.5cited by 3
- 2026The Dynamics of Delusion: Modeling Bidirectional False Belief Amplification in Human-Chatbot Dialoguecited by 3
- 2026Lost in Delusion: Examining LLM Safety Under User Delusions and Distresscited by 1
- 2026Inducing language models to assert their own consciousness restores human beliefs and valuescited by 1
- 2026Theory of Mind and Self-Attributions of Mentality are Dissociable in LLMscited by 0
- 2026Can AI Help You Get Over Your Breakup? One Session with a Belief-Reframing Chatbot Shows Sustained Distress Reductioncited by 0
- 2026Beyond the Sycophancy Score: How Task, Model, and Pressure Shape LLM Yieldingcited by 0
- 2026Beyond the Sycophancy Score: How Task, Model, and Pressure Shape LLM Yielding30 Sep 2026
- 2026Inducing language models to assert their own consciousness restores human beliefs and values30 Jul 2026
- 2026Lost in Delusion: Examining LLM Safety Under User Delusions and Distress31 May 2026
- 2026Can AI Help You Get Over Your Breakup? One Session with a Belief-Reframing Chatbot Shows Sustained Distress Reduction5 May 2026
- 2026The Dynamics of Delusion: Modeling Bidirectional False Belief Amplification in Human-Chatbot Dialogue28 Apr 2026
- 2026An Independent Safety Evaluation of Kimi K2.53 Apr 2026
- 2026Theory of Mind and Self-Attributions of Mentality are Dissociable in LLMs30 Mar 2026
- 2026Alignment midtraining for animals21 Mar 2026
- 2026AI Psychosis: Does Conversational AI Amplify Delusion-Related Language?20 Mar 2026
- 2026Architecting Trust in Artificial Epistemic Agents3 Mar 2026
- 2026How RLHF Amplifies Sycophancy1 Feb 2026