Critical or Compliant? The Double-Edged Sword of Reasoning in Chain-of-Thought Explanations
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Explanations are often promoted as tools for transparency, but they can also foster confirmation bias; users may assume reasoning is correct whenever outputs appear acceptable. We study this double-edged role of Chain-of-Thought (CoT) explanations in multimodal moral scenarios by systematically perturbing reasoning chains and manipulating delivery tones. Specifically, we analyze reasoning errors in vision language models (VLMs) and how they impact user trust and the ability to detect errors. Our findings reveal two key effects: (1) users often equate trust with outcome agreement, sustaining reliance even when reasoning is flawed, and (2) the confident tone suppresses error detection while maintaining reliance, showing that delivery styles can override correctness. These results highlight how CoT explanations can simultaneously clarify and mislead, underscoring the need for NLP systems to provide explanations that encourage scrutiny and critical thinking rather than blind trust. All code will be released publicly.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 16 of its 58 references that are in the map. First posted on arXiv 15 Nov 2025.
Builds on
16 of 58 references.
Closest ancestors · 4
Same direction, newest first
- 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety15 Jul
- 2025Reasoning Models Don't Always Say What They Think8 May
- 2025Thoughts without Thinking: Reconsidering the Explanatory Value of Chain-of-Thought Reasoning in LLMs through Agentic Pipelines1 May
- 2023Measuring Faithfulness in Chain-of-Thought Reasoning17 Jul
Other references · 12
- 2023GPT-4 Technical Reportcited by 18,396
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2024Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Modelscited by 105
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Modelscited by 25
- 2025Measuring and mitigating overreliance to build human-compatible AIcited by 12
- 2024Why Would You Suggest That? Human Trust in Language Model Responsescited by 9
- 2025HalLoc: Token-level Localization of Hallucinations for Vision Language Modelscited by 9
- 2025Bias in the Loop: How Humans Evaluate AI-Generated Suggestionscited by 4
- 2025Evaluating Explainability: A Framework for Systematic Assessment and Reporting of Explainable AI Featurescited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating the False Trust Engendered by LLM Explanations
- 2026Lie to Me: How Faithful Is Chain-of-Thought Reasoning in Reasoning Models?
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting
- 2026Seeing the Reasoning: How LLM Rationales Influence User Trust and Decision-Making in Factual Verification Tasks
- 2026Do Models Know Why They Changed Their Mind? Interpretability and Faithfulness of Chain-of-Thought Under Knowledge Conflict
- 2026Hidden Error Awareness in Chain-of-Thought Reasoning: The Signal Is Diagnostic, Not Causal
- 2026Ulterior Motives: Detecting Misaligned Reasoning in Continuous Thought Models
- 2026Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning