mlsanityData to 14 Oct 2026

It Matters How You Say It: Exploring Rhetorical Patterns for AI-Assisted Information Evaluation

arXiv 2607.17627 ↗First posted 20 Jul 2026cs.HC cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Prior work on AI-assisted information evaluation has largely focused on what AI systems communicate, comparing explanation types and formats, with responses predominantly cast in directive rhetoric where the system delivers a verdict and the user passively accepts it. While debate-style interactions have recently shown promise in prompting critical evaluation over deference, the rhetorical patterns that structure AI responses and how they might induce reflection, uncertainty, or independent reasoning remain largely unexamined. To address this, we investigated eight rhetorical patterns known to induce contemplation: Intentional Misleading, Interpretive Alternative, Scaffold Explanation, Triggering Distrust, Information Distortion, Alternative Framing, Socratic Questioning, and an Oracle baseline. Through a within-subject study with n=98 participants on a hint-on-demand fact verification task, we observed preliminary evidence that Scaffold Explanation were associated with the highest accuracy gains, and encouraging deeper reflection. Surprisingly, the adversarial conditions also improved accuracy modestly. Participants preferred Alternative Framing most and Interpretive Alternative least, largely due to the latter's perceived time cost. We discuss the implications of designing conversational agents with varied rhetorical styles and the trade-offs among user performance, satisfaction, and contemplation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 75 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

18 of 75 references.

References · 18

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  3. 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
  4. 2021A Survey on Automated Fact-Checkingcited by 378
  5. 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
  6. 2024Debating with More Persuasive LLMs Leads to More Truthful Answerscited by 266
  7. 2023Combating Misinformation in the Age of LLMs: Opportunities and Challengescited by 95
  8. 2021Fool Me Twice: Entailment from Wikipedia Gamificationcited by 50
  9. 2024Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Languagecited by 31
  10. 2018Trends in the Diffusion of Misinformation on Social Mediacited by 25
  11. 2024Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classroomscited by 20
  12. 2024Healthcare Copilot: Eliciting the Power of General LLMs for Medical Consultationcited by 17
6 more
  1. 2024Exploring a Behavioral Model of "Positive Friction" in Human-AI Interactioncited by 9
  2. 2025Better Slow than Sorry: Introducing Positive Friction for Reliable Dialogue Systemscited by 7
  3. 2024A Browser Extension for in-place Signaling and Assessment of Misinformationcited by 3
  4. 2025Context, Credibility, and Control: User Reflections on AI Assisted Misinformation Toolscited by 1
  5. 2025Designing Effective AI Explanations for Misinformation Detection: A Comparative Study of Content, Social, and Combined Explanationscited by 1
  6. 2026Using Grok to Avoid Personal Attacks While Correcting Misinformation on Xcited by 1

Built on by

Not cited yet.