mlsanityData to 7 Oct 2026

LLMs as Oracles: Reliance on LLMs for Subjective Personal Questions

arXiv 2609.14849 ↗First posted 13 Sep 2026cs.CY cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We characterize how people are turning to LLMs as oracles: all-knowing authorities on subjective personal questions. Motivated by risks to users' autonomy and well-being, we develop a typology and LLM-based methods to measure this form of AI reliance at scale and understand how people are offloading judgment and decision-making to AI. Applying our typology to public usage data (68K prompts from WildChat and ThoughtTrace), we find that LLM-as-oracle use has increased over time (2023-2026) and is more prevalent among younger users. We further build a privacy-preserving data donation tool to analyze individuals' longitudinal usage data (140K prompts from 52 participants), identifying similar trends. People are often unaware of their own LLM-as-oracle use, and express dissatisfaction with this behavior after seeing our tool's analysis. Finally, we identify two drivers of LLM-as-oracle use: people's perceptions of AI and the behavior of AI models themselves, which motivate possible interventions to support users' self-deliberation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 166 references that are in the map. First posted on arXiv 13 Sep 2026.

Builds on

54 of 166 references.

References · 54

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  3. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
  4. 2024Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Expertscited by 369
  5. 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
  6. 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
  7. 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
  8. 2024Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertaintycited by 106
  9. 2021Algorithmic Monoculture and Social Welfarecited by 98
  10. 2023The Metacognitive Demands and Opportunities of Generative AIcited by 85
  11. 2023Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfacescited by 71
  12. 2022In conversation with Artificial Intelligence: aligning language models with human valuescited by 61
38 more
  1. 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 61
  2. 2021Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Makingcited by 58
  3. 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
  4. 2019Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processescited by 53
  5. 2020Conceptual Metaphors Impact Perceptions of Human-AI Collaborationcited by 47
  6. 2025Creating General User Models from Computer Usecited by 44
  7. 2023Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systemscited by 40
  8. 2024The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labelscited by 37
  9. 2025ChatBench: From Static Benchmarks to Human-AI Evaluationcited by 31
  10. 2025Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Modelcited by 24
  11. 2023The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authorscited by 22
  12. 2025How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Studycited by 21
  13. 2025Interaction Context Often Increases Sycophancy in LLMscited by 21
  14. 2024WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wildcited by 20
  15. 2023The Role of Inclusion, Control, and Ownership in Workplace AI-Mediated Communicationcited by 19
  16. 2025Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Reviewcited by 16
  17. 2024Lessons From an App Update at Replika AI: Identity Discontinuity in Human-AI Relationshipscited by 15
  18. 2026Who's in Charge? Disempowerment Patterns in Real-World LLM Usagecited by 15
  19. 2024Contrastive Explanations That Anticipate Human Misconceptions Can Improve Human Decision-Making Skillscited by 11
  20. 2026Sycophantic AI makes human interaction feel more effortful and less satisfying over timecited by 11
  21. 2025Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systemscited by 7
  22. 2025Just-In-Time Objectives: A General Approach for Specialized AI Interactionscited by 7
  23. 2026Reporting and Reviewing LLM-Integrated Systems in HCI: Challenges and Considerationscited by 4
  24. 2026ThoughtTrace: Understanding User Thoughts in Real-World LLM Interactionscited by 4
  25. 2025"In my defense, only three hours on Instagram": Designing Toward Digital Self-Awareness and Wellbeingcited by 3
  26. 2025When AI Gives Advice: Evaluating AI and Human Responses to Online Advice-Seeking for Well-Beingcited by 3
  27. 2026AI-Wrapped: Participatory, Privacy-Preserving Measurement of Longitudinal LLM Use In-the-Wildcited by 3
  28. 2026Ambiguity Collapse by LLMs: A Taxonomy of Epistemic Riskscited by 3
  29. 2025Increasing happiness through conversations with artificial intelligencecited by 2
  30. 2025Seeking Late Night Life Lines: Experiences of Conversational AI Use in Mental Health Crisiscited by 2
  31. 2026Interpretive Cultures: Resonance, randomness, and negotiated meaning for AI-assisted tarot divinationcited by 2
  32. 2026Beyond Anthropomorphism: a Spectrum of Interface Metaphors for LLMscited by 2
  33. 2026What Users Cannot See: Evaluating LLM Emotional Support Beyond User Preferencecited by 2
  34. 2026The efficiency-gain illusion: People underestimate the rate of AI use and overestimate its benefits on simple taskscited by 2
  35. 2026AI advice suppresses people's willingness to say "I don't know", even when the advice is wrong and accuracy is incentivizedcited by 2
  36. 2026Emotional Support with Conversational AI: Talking to Machines About Lifecited by 1
  37. 2026Comparing Design Metaphors and User-Driven Metaphors for Interaction Designcited by 1
  38. 2026Behavior Latticing: Inferring User Motivations from Unstructured Interactionscited by 1

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.