Understanding the Impact of Linguistic Realization Choices on LLM Stance with Causal Tracing
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are known to be sensitive to prompt and input formulations. However, existing studies have focused on lexical realization and largely ignored constructional choice. This paper studies whether linguistic construction can systematically shift LLM decisions and where these shifts can be causally localized inside the model. We use political stance judgment as a meaning-sensitive case study and extend an English political statements dataset, resulting in six controlled linguistic rewrite types that preserve or invert the meaning of a statement. Experiments on four open-weight models show that stance instability affect both meaning-preserving and meaning-inversing rewrites. Because output shifts reveal that rewrites affect stance, but not where in the model, we apply activation patching, where activations from the original statement are substituted into the forward pass for the rewritten statement and measure which components recover the original stance distribution. The results show that mid-to-late decoder layers, especially block outputs at the final prompt position, provide the strongest restoration signal.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 44 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
14 of 44 references.
References · 14
- 2017Attention Is All You Needcited by 59,932
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 328
- 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
- 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
- 2023On the Calibration of Large Language Models and Alignmentcited by 72
- 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
- 2020Linguistically-Informed Transformations (LIT): A Method for Automatically Generating Contrast Setscited by 31
- 2025Mechanistic Interpretability of Emotion Inference in Large Language Modelscited by 24
- 2025Prompt Perturbations Reveal Human-Like Biases in Large Language Model Survey Responsescited by 13
- 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patchingcited by 5
- 2018Teaching Syntax by Adversarial Distractioncited by 4
Built on by
Not cited yet.