LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correction
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning from human feedback are data intensive and computationally expensive, while static parameter editing methods struggle with context dependent errors and catastrophic forgetting. We propose LLM-CAS, a framework that formulates real-time hallucination correction as a hierarchical reinforcement learning problem. LLM-CAS trains an agent to learn a policy that dynamically selects temporary neuron perturbations during inference based on the current context. Unlike prior dynamic approaches that rely on heuristic or predefined adjustments, this policy driven mechanism enables adaptive and fine grained correction without permanent parameter modification. Experiments across multiple language models demonstrate that LLM-CAS consistently improves factual accuracy, achieving gains of 10.98 percentage points on StoryCloze, 2.71 points on TriviaQA, and 2.06 points on the MC1 score of TruthfulQA. These results outperform both static editing methods such as ITI and CAA and the dynamic SADI framework. Overall, LLM-CAS provides an efficient and context aware solution for improving the reliability of LLMs, with promising potential for future multimodal extensions.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 36 of its 55 references that are in the map. First posted on arXiv 21 Dec 2025.
Builds on
36 of 55 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2015Trust Region Policy Optimizationcited by 2,503
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
24 more
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2022Mass-Editing Memory in a Transformercited by 976
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
- 2021Knowledge Neurons in Pretrained Transformerscited by 590
- 2021Fast Model Editing at Scalecited by 491
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
- 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
- 2016Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcited by 282
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2023Sources of Hallucination by Large Language Models on Inference Taskscited by 168
- 2024Unfamiliar Finetuning Examples Control How Language Models Hallucinatecited by 85
- 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
- 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectorscited by 61
- 2017Towards better understanding of gradient-based attribution methods for Deep Neural Networkscited by 51
- 2024The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Unitscited by 34
- 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 33
- 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Modelscited by 33
- 2025RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliabilitycited by 14
- 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interactioncited by 14
- 20253DAlign-DAER: Dynamic Attention Policy and Efficient Retrieval Strategy for Fine-grained 3D-Text Alignment at Scalecited by 12
Built on by
Citing papers per year: 2025: 8; 2026: 7.
15 papers.
Sort:
By area:
- 2026AdaMARP: An Adaptive Multi-Agent Interaction Framework for General Immersive Role-Playingcited by 8
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generationcited by 4
- 2026ResWM: Residual-Action World Model for Visual RLcited by 2
- 2026Neuron-Anchored Rule Extraction for Large Language Models via Contrastive Hierarchical Ablationcited by 2
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Expertscited by 1
- 2025SirenPose: Dynamic Scene Reconstruction via Geometric Supervisioncited by 0
- 2025SA-DiffuSeq: Addressing Computational and Scalability Challenges in Long-Document Generation with Sparse Attentioncited by 0
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generationcited by 0
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priorscited by 0
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architecturescited by 0
- 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domainscited by 0
- 2026Multi-Agent Cooperative Learning for Robust Vision-Language Alignment under OOD Conceptscited by 0
3 more
- 2026Bridging the Semantic Chasm: Synergistic Conceptual Anchoring for Generalized Few-Shot and Zero-Shot OOD Perceptioncited by 0
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Miningcited by 0
- 2026ProgAgent:A Continual RL Agent with Progress-Aware Rewardscited by 0
- 2026Neuron-Anchored Rule Extraction for Large Language Models via Contrastive Hierarchical Ablation4 May 2026
- 2026ResWM: Residual-Action World Model for Visual RL11 Mar 2026
- 2026ProgAgent:A Continual RL Agent with Progress-Aware Rewards8 Mar 2026
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Mining17 Feb 2026
- 2026Bridging the Semantic Chasm: Synergistic Conceptual Anchoring for Generalized Few-Shot and Zero-Shot OOD Perception30 Jan 2026
- 2026AdaMARP: An Adaptive Multi-Agent Interaction Framework for General Immersive Role-Playing16 Jan 2026
- 2026Multi-Agent Cooperative Learning for Robust Vision-Language Alignment under OOD Concepts11 Jan 2026
- 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domains27 Dec 2025
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation27 Dec 2025
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architectures26 Dec 2025
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priors25 Dec 2025
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generation25 Dec 2025
3 more
- 2025SA-DiffuSeq: Addressing Computational and Scalability Challenges in Long-Document Generation with Sparse Attention23 Dec 2025
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Experts23 Dec 2025
- 2025SirenPose: Dynamic Scene Reconstruction via Geometric Supervision23 Dec 2025
- 2026ResWM: Residual-Action World Model for Visual RLcited by 2
- 2026ResWM: Residual-Action World Model for Visual RL11 Mar 2026
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generationcited by 4
- 2025SirenPose: Dynamic Scene Reconstruction via Geometric Supervisioncited by 0
- 2025SA-DiffuSeq: Addressing Computational and Scalability Challenges in Long-Document Generation with Sparse Attentioncited by 0
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generationcited by 0
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priorscited by 0
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architecturescited by 0
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Miningcited by 0
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Mining17 Feb 2026
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation27 Dec 2025
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architectures26 Dec 2025
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priors25 Dec 2025
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generation25 Dec 2025
- 2025SA-DiffuSeq: Addressing Computational and Scalability Challenges in Long-Document Generation with Sparse Attention23 Dec 2025
- 2025SirenPose: Dynamic Scene Reconstruction via Geometric Supervision23 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2024Using Hallucinations to Bypass GPT4's Filter
- 2026Token-Guard: Towards Token-Level Hallucination Control via Self-Checking Decoding
- 2025Preemptive Hallucination Reduction: An Input-Level Approach for Multimodal Language Model
- 2026DEEPO: Dual-Entropy Enhanced Policy Optimization for Hallucination in MLLMs
- 2026Beyond Global Editing: Per-Instance Disentangled Subspaces for Training-Free Hallucination Mitigation in LVLMs
- 2026MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucination
- 2026AFTER: Mitigating the Object Hallucination of LVLM via Adaptive Factual-Guided Activation Editing
- 2026Alleviating Hallucination in Reasoning Tasks with Training-Free Uncertainty-Guided Steering