The Override Gap: A Magnitude Account of Knowledge Conflict Failure in Hypernetwork-Based Instant LLM Adaptation
Not on the map. Why?
Abstract (arXiv)
Hypernetwork-based methods such as Doc-to-LoRA internalize a document into an LLM's weights in a single forward pass, but they fail systematically on conflicts: when the document contradicts pretraining knowledge, accuracy collapses to 46.4% on the deepest facts. We show the failure is a magnitude problem rather than a representational one. The hypernetwork already targets the right layers, but its adapter margin is approximately constant across documents while the pretrained margin grows with training frequency, so deep conflicts lose by construction. The account predicts that failure should track prior strength: sorting 194 conflicts by the base model's log-probability on the contradicted fact, baseline accuracy falls from 68% on weak-prior questions to 16% on strong-prior ones, a 52 percentage-point gap. The cure is amplitude. Selective Layer Boosting scales the adapter at its top-norm layers, and Conflict-Aware Internalization triggers boosting only when the base model is confident. Both are training-free; together they raise deep-conflict accuracy from 46.4% to 71.0% on Gemma-2B and from 53.6% to 72.5% on Mistral-7B while preserving novel-knowledge recall, and beat vanilla retrieval-augmented generation on medium conflicts by 18 percentage points despite operating entirely in parameter space. We release KID-Bench, a 489-question benchmark that separates novel recall, cross-knowledge combination, and prior-graded conflicts.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 38 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
37 of 38 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2023Qwen Technical Reportcited by 3,344
- 2023Mistral 7Bcited by 3,164
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2016HyperNetworkscited by 1,027
25 more
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2022Toy Models of Superpositioncited by 971
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
- 2021Knowledge Neurons in Pretrained Transformerscited by 601
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
- 2021Fast Model Editing at Scalecited by 498
- 2022Memory-Based Model Editing at Scalecited by 447
- 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 364
- 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 357
- 2016A Learned Representation For Artistic Stylecited by 341
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
- 2024Knowledge Conflicts for LLMs: A Surveycited by 283
- 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 242
- 2023Transformer-Patcher: One Mistake worth One Neuroncited by 197
- 2024Mixture of LoRA Expertscited by 181
- 2024ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLMcited by 73
- 2025Text-to-LoRA: Instant Transformer Adaptioncited by 58
- 2026Doc-to-LoRA: Learning to Instantly Internalize Contextscited by 43
- 2024X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Designcited by 42
- 2025Vision as LoRAcited by 37
- 2026SHINE: A Scalable In-Context Hypernetwork for Mapping Context to LoRA in a Single Passcited by 25
- 2024LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generationcited by 19
- 2025HyperLoRA: Parameter-Efficient Adaptive Generation for Portrait Synthesiscited by 10
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Accommodate Knowledge Conflicts in Retrieval-augmented LLMs: Towards Robust Response Generation in the Wild
- 2026Exploring Knowledge Conflicts for Faithful LLM Reasoning: Benchmark and Method
- 2026Tracking the Limits of Knowledge Propagation: How LLMs Fail at Multi-Step Reasoning with Conflicting Knowledge
- 2026Scaling Laws for Hypernetwork-Based Knowledge Injection in Large Language Models
- 2025Resolving Editing-Unlearning Conflicts: A Knowledge Codebook Framework for Large Language Model Updating
- 2024Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
- 2024Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models
- 2025FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generation