mlsanityData to 7 Oct 2026

Who is In Charge? Dissecting Role Conflicts in Instruction Following

arXiv 2510.01228 ↗First posted 23 Sep 2025cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Large language models should follow hierarchical instructions where system prompts override user inputs, yet recent work shows they often ignore this rule while strongly obeying social cues such as authority or consensus. We extend these behavioral findings with mechanistic interpretations on a large-scale dataset. Linear probing shows conflict-decision signals are encoded early, with system-user and social conflicts forming distinct subspaces. Direct Logit Attribution reveals stronger internal conflict detection in system-user cases but consistent resolution only for social cues. Steering experiments show that, despite using social cues, the vectors surprisingly amplify instruction following in a role-agnostic way. Together, these results explain fragile system obedience and underscore the need for lightweight hierarchy-sensitive alignment methods.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 14 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

13 of 14 references.

References · 13

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2024Mixtral of Expertscited by 1,785
  4. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  5. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  6. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  7. 2023Steering Language Models With Activation Engineeringcited by 824
  8. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
  9. 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 314
  10. 2024Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoderscited by 133
  11. 2023Improving Activation Steering in Language Models with Mean-Centringcited by 64
  12. 2025Control Illusion: The Failure of Instruction Hierarchies in Large Language Modelscited by 31
1 more
  1. 2025Instruction Following by Principled Boosting Attention of Large Language Modelscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.