H-Node Attack and Defense in Large Language Models
Not on the map. Why?
Abstract (arXiv)
We present H-Node Adversarial Noise Cancellation (H-Node ANC), a mechanistic framework that identifies, exploits, and defends hallucination representations in transformer-based large language models (LLMs) at the level of individual hidden-state dimensions. A logistic regression probe trained on last-token hidden states localizes hallucination signal to a small set of high-variance dimensions -- termed Hallucination Nodes (H-Nodes) -- with probe AUC reaching 0.90 across four architectures. A white-box adversarial attack amplifies these dimensions at inference time via a real-time forward hook, achieving a selectivity of 3.02x with less than 10% visibility to the defender. Adaptive ANC defense suppresses H-Node excess in-pass using confidence-weighted cancellation, reducing grounded activation drift by 33-42% over static cancellation. A dynamic iterative extension that re-ranks cancellation targets across successive passes recovers up to 0.69 robustness from a single-pass baseline of 8%. All contributions are validated on OPT-125M, Phi-3-mini-4k-instruct, LLaMA-3-8B-Instruct, and Mistral-7B-Instruct-v0.3 (125M-8B parameters). Perplexity impact is surgical (<5%) and MMLU degradation is at most 3%, confirming that the defense does not impair general reasoning capability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 41 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
35 of 41 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2016Pointer Sentinel Mixture Modelscited by 2,992
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
23 more
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
- 2023The Internal State of an LLM Knows When It's Lyingcited by 644
- 2021Knowledge Neurons in Pretrained Transformerscited by 590
- 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 367
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
- 2023Linearity of Relation Decoding in Transformer Language Modelscited by 190
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026REALISTA: Realistic Latent Adversarial Attacks that Elicit LLM Hallucinations
- 2025Mirage in the Eyes: Hallucination Attack on Multi-modal Large Language Models with Only Attention Sink
- 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
- 2026Eliciting Intrinsic Hallucinations in LLMs via Semantically Equivalent Adversarial Attacks
- 2025DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Models
- 2025Look Closer! An Adversarial Parametric Editing Framework for Hallucination Mitigation in VLMs
- 2025Poison as Cure: Visual Noise for Mitigating Object Hallucinations in LVMs
- 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models