Lost in Interpretation: The Plausibility-Faithfulness Trade-off in Cross-Lingual Explanations
Not on the map. Why?
Abstract (arXiv)
LLMs deployed multilingually are often audited via English explanations for non-English inputs. We evaluate extractive explanations ''where the model identifies input token spans as evidence alongside a generated rationale'' and uncover a systematic trade-off: English-pivot explanations can achieve higher span agreement with human rationales while their evidence becomes less causally grounded in the model's prediction, as measured by both comprehensiveness and sufficiency. Across 3 tasks, 5~languages, and 2~multilingual LLM families, we find that English explanations frequently produce fluent but loosely anchored rationales, with comprehensiveness degrading by up to 5.7x relative to native-language conditions - even as task accuracy remains stable across settings. For socially nuanced classification, English pivots also fail to preserve pragmatic cues, reducing both faithfulness and span agreement. We recommend auditing explanations in the input language, reporting multi-faceted faithfulness metrics beyond lexical overlap, and treating English rationales as communication summaries rather than faithful decision traces.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 19 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
13 of 19 references.
References · 13
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 590
- 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 523
- 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
- 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Promptingcited by 163
- 2020Measuring Association Between Labels and Free-Text Rationalescited by 159
- 2025Soteria: Language-Specific Functional Parameter Steering for Multilingual Safety Alignmentcited by 10
- 2025Attributional Safety Failures in Large Language Models under Code-Mixed Perturbationscited by 6
Built on by
Not cited yet.