Does a model's stated reason for rejecting a candidate do any work?
Not on the map. Why?
Abstract (arXiv)
Asked to choose between candidates and explain the choice, a language model often rejects a rival by naming a fact its profile lacks: no director, no date of death. That sentence is a claim about the text in front of the model, and it can be tested without any judge. We insert a real corpus sentence stating the named fact into the rival's profile and ask again under greedy decoding. Two controls separate content from placement: a length-matched irrelevant sentence at the same profile, and the same two sentences at a third option the model never mentioned. In the largest of three runs, six open models on 2WikiMultihopQA, supplying the named fact at the profile the model named moves its choice more than the irrelevant control does, odds ratio 3.57 [1.54, 8.26], Holm p=0.0210, and this survives dropping any single model. The contrast the design was built to detect, the same fact at the option nobody named, does not clear correction, Holm p=0.2428. The strongest result in the family carries no content claim at all: the identical irrelevant sentence moves the choice more at the named rival than at the third option, Holm p=0.0008. Repair and control also differ in co-candidate mentions, relation template and fluency; post-hoc matching on the first two preserves the content effects' direction, matching fluency weakens one, so the content contrasts bound an effect rather than establish one. A forced single-token probability read disagrees in direction with the free-text choice on that same contrast, and three candidate explanations for the disagreement find no support. Every measurement is a string rule, so each was validated against the records it reads; validation caught eight defects. The largest, a choice-parsing rule that returned the option a model had just rejected in 17.1% of adjudicable responses, would have reported six surviving contrasts instead of four.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 39 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
35 of 39 references.
References · 35
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 530
- 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 356
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
- 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 263
- 2022Leveraging Large Language Models for Multiple Choice Question Answeringcited by 203
23 more
- 2020Measuring Association Between Labels and Free-Text Rationalescited by 160
- 2018Pathologies of Neural Models Make Interpretations Difficultcited by 140
- 2023Faithfulness Tests for Natural Language Explanationscited by 107
- 2020Explaining NLP Models via Minimal Contrastive Editing (MiCE)cited by 106
- 2024Are self-explanations from Large Language Models faithful?cited by 101
- 2024ContextCite: Attributing Model Generation to Contextcited by 98
- 2022Interpreting Language Models with Contrastive Explanationscited by 92
- 2021The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance Explanationscited by 87
- 2023Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanationscited by 85
- 2021Contrastive Explanations for Model Interpretabilitycited by 75
- 2023On Measuring Faithfulness or Self-consistency of Natural Language Explanationscited by 73
- 2024"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Modelscited by 69
- 2018Contrastive Explanation: A Structural-Model Approachcited by 65
- 2025Walk the Talk? Measuring the Faithfulness of Large Language Model Explanationscited by 45
- 2024The Probabilities Also Matter: A More Faithful Metric for Faithfulness of Free-Text Explanations in Large Language Modelscited by 29
- 2024FaithLM: Towards Faithful Explanations for Large Language Modelscited by 19
- 2022Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detectioncited by 18
- 2025LLMs Don't Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanationscited by 16
- 2024Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectorscited by 15
- 2024Look at the Text: Instruction-Tuned Language Models are More Robust Multiple Choice Selectors than You Thinkcited by 14
- 2026A Positive Case for Faithfulness: LLM Self-Explanations Help Predict Model Behaviorcited by 13
- 2025A Causal Lens for Evaluating Faithfulness Metricscited by 12
- 2025Explanation-Driven Counterfactual Testing for Faithfulness in Vision-Language Model Explanationscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Easy to Catch a Liar, Hard to Clear an Honest One: Language Models Diagnosing a Corrupted Reward Channel from a Verified Record
- 2025Why Do Some Language Models Fake Alignment While Others Don't?
- 2026Why Models Know But Don't Say: Chain-of-Thought Faithfulness Divergence Between Thinking Tokens and Answers in Open-Weight Reasoning Models
- 2026When Reasoning Traces Conflict with Evidence: How Answer Configuration Shapes Evidence Following
- 2026Copying Before Suppression: What Drives a Below-Chance Dip During Language Model Training?
- 2024What Evidence Do Language Models Find Convincing?
- 2026How Much Does a Reasoning Summary Reveal? An Observability Ladder for Large Language Models
- 2026Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scale