mlsanityData to 7 Oct 2026

H-Node Attack and Defense in Large Language Models

arXiv 2603.26045 ↗First posted 27 Mar 2026cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We present H-Node Adversarial Noise Cancellation (H-Node ANC), a mechanistic framework that identifies, exploits, and defends hallucination representations in transformer-based large language models (LLMs) at the level of individual hidden-state dimensions. A logistic regression probe trained on last-token hidden states localizes hallucination signal to a small set of high-variance dimensions -- termed Hallucination Nodes (H-Nodes) -- with probe AUC reaching 0.90 across four architectures. A white-box adversarial attack amplifies these dimensions at inference time via a real-time forward hook, achieving a selectivity of 3.02x with less than 10% visibility to the defender. Adaptive ANC defense suppresses H-Node excess in-pass using confidence-weighted cancellation, reducing grounded activation drift by 33-42% over static cancellation. A dynamic iterative extension that re-ranks cancellation targets across successive passes recovers up to 0.69 robustness from a single-pass baseline of 8%. All contributions are validated on OPT-125M, Phi-3-mini-4k-instruct, LLaMA-3-8B-Instruct, and Mistral-7B-Instruct-v0.3 (125M-8B parameters). Perplexity impact is surgical (<5%) and MMLU degradation is at most 3%, confirming that the defense does not impair general reasoning capability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 41 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

35 of 41 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  8. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  9. 2017On Calibration of Modern Neural Networkscited by 4,860
  10. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  11. 2016Pointer Sentinel Mixture Modelscited by 2,992
  12. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
23 more
  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2022Emergent Abilities of Large Language Modelscited by 2,483
  4. 2020Extracting Training Data from Large Language Modelscited by 2,144
  5. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  6. 2019Language Models as Knowledge Bases?cited by 1,922
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  8. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  9. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  10. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  11. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  12. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  13. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  14. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  15. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  16. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
  17. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
  18. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  19. 2023The Internal State of an LLM Knows When It's Lyingcited by 644
  20. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  21. 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 367
  22. 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
  23. 2023Linearity of Relation Decoding in Transformer Language Modelscited by 190

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026REALISTA: Realistic Latent Adversarial Attacks that Elicit LLM Hallucinations
  2. 2025Mirage in the Eyes: Hallucination Attack on Multi-modal Large Language Models with Only Attention Sink
  3. 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
  4. 2026Eliciting Intrinsic Hallucinations in LLMs via Semantically Equivalent Adversarial Attacks
  5. 2025DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Models
  6. 2025Look Closer! An Adversarial Parametric Editing Framework for Hallucination Mitigation in VLMs
  7. 2025Poison as Cure: Visual Noise for Mitigating Object Hallucinations in LVMs
  8. 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models