CORVUS: Red-Teaming Hallucination Detectors via Internal Signal Camouflage in Large Language Models
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Single-pass hallucination detectors rely on internal telemetry (e.g., uncertainty, hidden-state geometry, and attention) of large language models, implicitly assuming hallucinations leave separable traces in these signals. We study a white-box, model-side adversary that fine-tunes lightweight LoRA adapters on the model while keeping the detector fixed, and introduce CORVUS, an efficient red-teaming procedure that learns to camouflage detector-visible telemetry under teacher forcing, including an embedding-space FGSM attention stress test. Trained on 1,000 out-of-distribution Alpaca instructions (<0.5% trainable parameters), CORVUS transfers to FAVA-Annotation across Llama-2, Vicuna, Llama-3, and Qwen2.5, and degrades both training-free detectors (e.g., LLM-Check) and probe-based detectors (e.g., SEP, ICR-probe), motivating adversary-aware auditing that incorporates external grounding or cross-model evidence.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 11 of its 24 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
11 of 24 references.
References · 11
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023The Internal State of an LLM Knows When It's Lyingcited by 659
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
- 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 197
- 2024ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretabilitycited by 101
- 2023Do Androids Know They're Only Dreaming of Electric Sheep?cited by 67
- 2025ICR Probe: Tracking Hidden State Dynamics for Reliable Hallucination Detection in LLMscited by 32
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Spectral Guardrails for Agents in the Wild: Detecting Tool Use Hallucinations via Attention Topology
- 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
- 2025MTRE: Multi-Token Reliability Estimation for Hallucination Detection in VLMs
- 2026Kestrel: Grounding Self-Refinement for LVLM Hallucination Mitigation
- 2026LLM-as-Judge Framework for Evaluating Tone-Induced Hallucination in Vision-Language Models
- 2026Detection Without Correction: A Robust Asymmetry in Activation-Based Hallucination Probing
- 2025Seeing is Believing: Rich-Context Hallucination Detection for MLLMs via Backward Visual Grounding
- 2026Scalable Token-Level Hallucination Detection in Large Language Models