Discourse-Role Labels as Presentation-Time Variables for Context Use in Language Models
Not on the map. Why?
Abstract (arXiv)
Context-augmented language model systems often wrap supplied content with labels such as Reference:, Evidence:, Instruction:, Note:, or Example:, but the effect of these labels on reader-model behavior remains underexplored. We introduce a paired fixed-content probe over 500 MMLU-Pro items: each item receives the same misleading answer-bearing assertion under different discourse-role labels, and adoption is measured by whether the model outputs the injected wrong option. Across GPT-5.5, DeepSeek V4 Pro, Llama-3-8B-Instruct, and Qwen2.5-7B-Instruct, Misleading Adoption Rate shifts by 56-84 percentage points. Binding or source-like labels such as Instruction: and Reference: produce high adoption, whereas Example: consistently suppresses it. Paired tests, bootstrap intervals, final-instruction ablations, and Qwen final-step log-probability probes support a label-conditioned candidate preference. Boundary probes show where the effect weakens or persists: arithmetic tasks reduce adoption, passage-shaped external context preserves smaller label gaps, short-answer evaluation rules out option-letter copying, and nested-label conflicts suggest that illustrative framing can delimit adoption scope. A 200-case single-author manual audit confirms that the short-answer contrasts are stable under conservative adjudication. The resulting claim is bounded but practical: context-utilization and reader-side RAG benchmarks should report and control wrapper labels, because presentation choices can change measured reliance on supplied context.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 33 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
27 of 33 references.
References · 27
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
- 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 149
- 2024Does Prompt Formatting Have Any Impact on LLM Performance?cited by 141
- 2024In-Context Learning with Long-Context Models: An In-Depth Explorationcited by 128
- 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 86
- 2024Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?cited by 81
15 more
- 2023In-Context Learning with Iterative Demonstration Selectioncited by 74
- 2024Sufficient Context: A New Lens on Retrieval Augmented Generation Systemscited by 72
- 2024Revisiting Demonstration Selection Strategies in In-Context Learningcited by 58
- 2025Benchmarking Prompt Sensitivity in Large Language Modelscited by 38
- 2025Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMscited by 30
- 2025FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generationcited by 28
- 2024Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generationcited by 25
- 2024The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysiscited by 13
- 2024Demonstration Augmentation for Zero-shot In-context Learningcited by 11
- 2025Resisting Contextual Interference in RAG via Parametric-Knowledge Reinforcementcited by 11
- 2025When Punctuation Matters: A Large-Scale Comparison of Prompt Robustness Methods for LLMscited by 10
- 2026Indirect Prompt Injection in the Wild: An Empirical Study of Prevalence, Techniques, and Objectivescited by 6
- 2026SD-RAG: A Prompt-Injection-Resilient Framework for Selective Disclosure in Retrieval-Augmented Generationcited by 4
- 2026Revisiting Prompt Sensitivity in Large Language Models for Text Classification: The Role of Prompt Underspecificationcited by 3
- 2026Understanding the Prompt Sensitivitycited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.