mlsanityData to 7 Oct 2026

LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correction

arXiv 2512.18623 ↗First posted 21 Dec 2025cs.CL cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning from human feedback are data intensive and computationally expensive, while static parameter editing methods struggle with context dependent errors and catastrophic forgetting. We propose LLM-CAS, a framework that formulates real-time hallucination correction as a hierarchical reinforcement learning problem. LLM-CAS trains an agent to learn a policy that dynamically selects temporary neuron perturbations during inference based on the current context. Unlike prior dynamic approaches that rely on heuristic or predefined adjustments, this policy driven mechanism enables adaptive and fine grained correction without permanent parameter modification. Experiments across multiple language models demonstrate that LLM-CAS consistently improves factual accuracy, achieving gains of 10.98 percentage points on StoryCloze, 2.71 points on TriviaQA, and 2.06 points on the MC1 score of TruthfulQA. These results outperform both static editing methods such as ITI and CAA and the dynamic SADI framework. Overall, LLM-CAS provides an efficient and context aware solution for improving the reliability of LLMs, with promising potential for future multimodal extensions.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 36 of its 55 references that are in the map. First posted on arXiv 21 Dec 2025.

Builds on

36 of 55 references.

References · 36

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2017Deep reinforcement learning from human preferencescited by 3,846
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  7. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  8. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  9. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  10. 2015Trust Region Policy Optimizationcited by 2,503
  11. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  12. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
24 more
  1. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  2. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  3. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  4. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  5. 2022Mass-Editing Memory in a Transformercited by 976
  6. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  7. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
  8. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  9. 2021Fast Model Editing at Scalecited by 491
  10. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  11. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  12. 2016Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcited by 282
  13. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  14. 2023Sources of Hallucination by Large Language Models on Inference Taskscited by 168
  15. 2024Unfamiliar Finetuning Examples Control How Language Models Hallucinatecited by 85
  16. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  17. 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectorscited by 61
  18. 2017Towards better understanding of gradient-based attribution methods for Deep Neural Networkscited by 51
  19. 2024The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Unitscited by 34
  20. 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 33
  21. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Modelscited by 33
  22. 2025RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliabilitycited by 14
  23. 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interactioncited by 14
  24. 20253DAlign-DAER: Dynamic Attention Policy and Efficient Retrieval Strategy for Fine-grained 3D-Text Alignment at Scalecited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 7.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024Using Hallucinations to Bypass GPT4's Filter
  2. 2026Token-Guard: Towards Token-Level Hallucination Control via Self-Checking Decoding
  3. 2025Preemptive Hallucination Reduction: An Input-Level Approach for Multimodal Language Model
  4. 2026DEEPO: Dual-Entropy Enhanced Policy Optimization for Hallucination in MLLMs
  5. 2026Beyond Global Editing: Per-Instance Disentangled Subspaces for Training-Free Hallucination Mitigation in LVLMs
  6. 2026MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucination
  7. 2026AFTER: Mitigating the Object Hallucination of LVLM via Adaptive Factual-Guided Activation Editing
  8. 2026Alleviating Hallucination in Reasoning Tasks with Training-Free Uncertainty-Guided Steering