mlsanityData to 14 Oct 2026

From Context-Aware to Conflict-Aware: Generalizing Contrastive Decoding for Knowledge Conflict in LLMs

arXiv 2606.10298 ↗First posted 9 Jun 2026cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

When large language models generate from retrieved or augmented contexts, conflicts between external context and parametric priors remain a central reliability bottleneck. Existing contrastive decoding methods follow a context-aware paradigm that unilaterally amplifies context over parametric priors, overwriting correct priors when the context is erroneous. We generalize this to the conflict-aware paradigm that dynamically allocates authority between prior and context based on conflict signals, rather than presupposing context trustworthiness. We show that the affine combination of prior and context logits yields a power family with an inherent regime asymmetry: extrapolation amplifies errors unboundedly when the prior is correct, interpolation under-corrects when the context is correct, and no static regime covers both. Existing contrastive decoding methods are instances of this family, mostly extrapolative. To evaluate both conflict directions, we propose TriState-Bench, a model-aware evaluation protocol that calibrates per-model prior knowledge to measure three conflict states: correction, resistance, and agreement. To resolve the asymmetry, we propose Adaptive Regime Routing (ARR), which routes between regimes at each step, lifting resistance EM from below 6 to 16--33 without sacrificing correction or agreement. Our code is available at https://github.com/keith-Jiang/conflict-aware-decoding.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 24 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

23 of 24 references.

References · 23

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  6. 2019Language Models as Knowledge Bases?cited by 1,936
  7. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  8. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  9. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
  10. 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 609
  11. 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 356
  12. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
11 more
  1. 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
  2. 2024Knowledge Conflicts for LLMs: A Surveycited by 283
  3. 2022RealTime QA: What's the Answer Right Now?cited by 244
  4. 2022Large Language Models with Controllable Working Memorycited by 169
  5. 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 113
  6. 2023Context-faithful Prompting for Large Language Modelscited by 80
  7. 2024Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineeringcited by 63
  8. 2024AdaCAD: Adaptively Decoding to Balance Conflicts between Contextual and Parametric Knowledgecited by 37
  9. 2025Taming Knowledge Conflicts in Language Modelscited by 30
  10. 2024Discerning and Resolving Knowledge Conflicts through Adaptive Decoding with Contextual Information-Entropy Constraintcited by 27
  11. 2025CoCoA: Confidence and Context-Aware Adaptive Decoding for Resolving Knowledge Conflicts in Large Language Modelscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.