mlsanityData to 7 Oct 2026

Large Language Models Pass the Turing Test

arXiv 2503.23674 ↗First posted 31 Mar 2025cs.CL cs.HCcited by 48

Not on the map. Why?

Abstract (arXiv)

We evaluated 4 systems (ELIZA, GPT-4o, LLaMa-3.1-405B, and GPT-4.5) in two randomised, controlled, and pre-registered Turing tests on independent populations. Participants had 5 minute conversations simultaneously with another human participant and one of these systems before judging which conversational partner they thought was human. When prompted to adopt a humanlike persona, GPT-4.5 was judged to be the human 73% of the time: significantly more often than interrogators selected the real human participant. LLaMa-3.1, with the same prompt, was judged to be the human 56% of the time -- not significantly more or less often than the humans they were being compared to -- while baseline models (ELIZA and GPT-4o) achieved win rates significantly below chance (23% and 21% respectively). The results constitute the first empirical evidence that any artificial system passes a standard three-party Turing test. The results have implications for debates about what kind of intelligence is exhibited by Large Language Models (LLMs), and the social and economic impacts these systems are likely to have.

Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 13 of its 55 references that are in the map. First posted on arXiv 31 Mar 2025.

Builds on

13 of 55 references.

References · 13

  1. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
  2. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
  3. 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
  4. 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
  5. 2024A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Modelscited by 95
  6. 2025Why human-AI relationships need socioaffective alignmentcited by 47
  7. 2023Does GPT-4 pass the Turing test?cited by 37
  8. 2023Artificial Influence: An Analysis Of AI-Driven Persuasioncited by 31
  9. 2024A Mechanism-Based Approach to Mitigating Harms from Persuasive Generative AIcited by 31
  10. 2023Human or Not? A Gamified Approach to the Turing Testcited by 16
  11. 2024Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Modelscited by 14
  12. 2025A Rigorous Turing Test: a Foundation for Evaluating Artificial General Intelligencecited by 2
1 more
  1. 2025ChatGPT-4 and other LLMs in the Turing Test: A Critical Analysiscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 26; 2026: 22.

48 papers.

Sort:

By area:

  1. 2026HumanLM: Simulating Users with State Alignment Beats Response Imitationcited by 31
  2. 2025Pangu Ultra: Pushing the Limits of Dense Large Language Models on Ascend NPUscited by 13
  3. 2025TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulationcited by 13
  4. 2025Transformers Provably Learn Chain-of-Thought Reasoning with Length Generalizationcited by 12
  5. 2025Evidence for Limited Metacognition in LLMscited by 11
  6. 2025Epistemological Fault Lines Between Human and Artificial Intelligencecited by 11
  7. 2026ConvApparel: A Benchmark Dataset and Validation Framework for User Simulators in Conversational Recommenderscited by 10
  8. 2025Different types of syntactic agreement recruit the same units within large language modelscited by 7
  9. 2025Multilingual Test-Time Scaling via Initial Thought Transfercited by 5
  10. 2025Do Large Language Models (Really) Need Statistical Foundations?cited by 5
  11. 2025Large Language Model probabilities cannot distinguish between possible and impossible languagecited by 5
  12. 2026LLMs and people both learn to form conventions -- just not with each othercited by 5
36 more
  1. 2025The Other Mind: How Language Models Exhibit Human Temporal Cognitioncited by 4
  2. 2025Assessing LLMs in Art Contexts: Critique Generation and Theory of Mind Evaluationcited by 3
  3. 2025The Pragmatic Mind of Machines: Tracing the Emergence of Pragmatic Competence in Large Language Modelscited by 3
  4. 2025Exploring Consciousness in LLMs: A Systematic Survey of Theories, Implementations, and Frontier Riskscited by 3
  5. 2025Large Language Models are Near-Optimal Decision-Makers with a Non-Human Learning Behaviorcited by 3
  6. 2025Are LLM Agents Behaviorally Coherent? Latent Profiles for Social Simulationcited by 3
  7. 2025Love, Lies, and Language Models: Investigating AI's Role in Romance-Baiting Scamscited by 3
  8. 2026More Human or More AI? Visualizing Human-AI Collaboration Disclosures in Journalistic News Productioncited by 3
  9. 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Modelscited by 3
  10. 2026How Open Must Language Models be to Enable Reliable Scientific Inference?cited by 2
  11. 2026Let's Have a Conversation: Designing and Evaluating LLM Agents for Interactive Optimizationcited by 2
  12. 2026Accommodation Goes Both Ways: Studying Linguistic Convergence Between Humans and Language Modelscited by 2
  13. 2026Modular Cognitive Architecture Emerges in Large Language Modelscited by 2
  14. 2025HADA: Human-AI Agent Decision Alignment Architecturecited by 1
  15. 2026HAL: Inducing Human-likeness in LLMs with Alignmentcited by 1
  16. 2026Human or Machine? A Preliminary Turing Test for Speech-to-Speech Interactioncited by 1
  17. 2026RealityTest: How People Probe AI Identity and Whether Models Disclose Itcited by 1
  18. 2026Bridging Creative Intent and Visual Quality: Creator-Driven Recurrent Video Generation with Agentic Feedback Loopscited by 1
  19. 2025Natural, Artificial, and Human Intelligencescited by 0
  20. 2025The NordDRG AI Benchmark for Large Language Modelscited by 0
  21. 2025Too Human to Model:The Uncanny Valley of LLMs in Social Simulation -- When Generative Language Agents Misalign with Modelling Principlescited by 0
  22. 2025A Collaborative Framework Integrating Large Language Model and Chemical Fragment Space: Mutual Inspiration for Lead Designcited by 0
  23. 2025CoVeR: Conformal Calibration for Versatile and Reliable Autoregressive Next-Token Predictioncited by 0
  24. 2025Artificially intelligent agents in the social and behavioral sciences: A history and outlookcited by 0
  25. 2025Mathematics with large language models as provers and verifierscited by 0
  26. 2025Generative AI in Heritage Practice: Improving the Accessibility of Heritage Guidancecited by 0
  27. 2025Can machines think efficiently?cited by 0
  28. 2026Intelligence Requires Grounding But Not Embodimentcited by 0
  29. 2026Assessing Spear-Phishing Website Generation in Large Language Model Coding Agentscited by 0
  30. 2026Book your room in the Turing Hotel! A symmetric and distributed Turing Test with multiple AIs and humanscited by 0
  31. 2026Process Matters more than Output for Distinguishing Humans from Machinescited by 0
  32. 2026How Much Do LLMs Know About Chinese Zero Pronouns?cited by 0
  33. 2026The complexities of patient-centred conversational artificial intelligencecited by 0
  34. 2026Identity from the Outside: A Conceptual Framework and Research Program for AI Personality Clonescited by 0
  35. 2026Pretrained Persona Mixture Models and Tandem Models for Human Simulationcited by 0
  36. 2026Are Human-Aligned Models Models of Humans? A Turing-Test Gap in Preference Alignmentcited by 0