mlsanityData to 14 Oct 2026

Discourse-Role Labels as Presentation-Time Variables for Context Use in Language Models

arXiv 2606.04109 ↗First posted 2 Jun 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Context-augmented language model systems often wrap supplied content with labels such as Reference:, Evidence:, Instruction:, Note:, or Example:, but the effect of these labels on reader-model behavior remains underexplored. We introduce a paired fixed-content probe over 500 MMLU-Pro items: each item receives the same misleading answer-bearing assertion under different discourse-role labels, and adoption is measured by whether the model outputs the injected wrong option. Across GPT-5.5, DeepSeek V4 Pro, Llama-3-8B-Instruct, and Qwen2.5-7B-Instruct, Misleading Adoption Rate shifts by 56-84 percentage points. Binding or source-like labels such as Instruction: and Reference: produce high adoption, whereas Example: consistently suppresses it. Paired tests, bootstrap intervals, final-instruction ablations, and Qwen final-step log-probability probes support a label-conditioned candidate preference. Boundary probes show where the effect weakens or persists: arithmetic tasks reduce adoption, passage-shaped external context preserves smaller label gaps, short-answer evaluation rules out option-letter copying, and nested-label conflicts suggest that illustrative framing can delimit adoption scope. A 200-case single-author manual audit confirms that the short-answer contrasts are stable under conservative adjudication. The resulting claim is bounded but practical: context-utilization and reader-side RAG benchmarks should report and control wrapper labels, because presentation choices can change measured reliance on supplied context.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 33 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

27 of 33 references.

References · 27

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  2. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  3. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
  4. 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
  5. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
  6. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267
  7. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
  8. 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 149
  9. 2024Does Prompt Formatting Have Any Impact on LLM Performance?cited by 141
  10. 2024In-Context Learning with Long-Context Models: An In-Depth Explorationcited by 128
  11. 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 86
  12. 2024Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?cited by 81
15 more
  1. 2023In-Context Learning with Iterative Demonstration Selectioncited by 74
  2. 2024Sufficient Context: A New Lens on Retrieval Augmented Generation Systemscited by 72
  3. 2024Revisiting Demonstration Selection Strategies in In-Context Learningcited by 58
  4. 2025Benchmarking Prompt Sensitivity in Large Language Modelscited by 38
  5. 2025Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMscited by 30
  6. 2025FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generationcited by 28
  7. 2024Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generationcited by 25
  8. 2024The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysiscited by 13
  9. 2024Demonstration Augmentation for Zero-shot In-context Learningcited by 11
  10. 2025Resisting Contextual Interference in RAG via Parametric-Knowledge Reinforcementcited by 11
  11. 2025When Punctuation Matters: A Large-Scale Comparison of Prompt Robustness Methods for LLMscited by 10
  12. 2026Indirect Prompt Injection in the Wild: An Empirical Study of Prevalence, Techniques, and Objectivescited by 6
  13. 2026SD-RAG: A Prompt-Injection-Resilient Framework for Selective Disclosure in Retrieval-Augmented Generationcited by 4
  14. 2026Revisiting Prompt Sensitivity in Large Language Models for Text Classification: The Role of Prompt Underspecificationcited by 3
  15. 2026Understanding the Prompt Sensitivitycited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.