HulluEdit: Single-Pass Evidence-Consistent Subspace Editing for Mitigating Hallucinations in Large Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs
Abstract (arXiv)
Object hallucination in Large Vision-Language Models (LVLMs) significantly hinders their reliable deployment. Existing methods struggle to balance efficiency and accuracy: they often require expensive reference models and multiple forward passes, or apply static edits that risk suppressing genuine visual evidence. To address this, we introduce HulluEdit, a single-pass, reference-free intervention framework. Our core innovation is orthogonal subspace editing: we decompose the hidden states of the model into orthogonal subspaces - visual evidence, conflicting priors, and residual uncertainty - enabling selective suppression of hallucinatory patterns without interfering with visual grounding. This approach mathematically guarantees that edits applied to the prior subspace leave the visual component entirely unaffected. Extensive experiments show that HulluEdit achieves state-of-the-art hallucination reduction on benchmarks including POPE and CHAIR across diverse architectures, while preserving general capabilities on MME and maintaining efficient inference. Our method consistently outperforms contrastive decoding and static subspace editing baselines, offering a new pathway toward more trustworthy LVLMs.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 31 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
28 of 31 references.
Closest ancestors · 10
Same direction, newest first
- 2025ClearSight: Visual Signal Enhancement for Object Hallucination Mitigation in Multimodal Large language Models17 Mar
- 2024Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projection18 Dec
- 2024MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation15 Oct
- 2024Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding27 Mar
- 2024HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding1 Mar
- 2024A Survey on Hallucination in Large Vision-Language Models1 Feb
- 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation29 Nov
- 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding28 Nov
- 2023Woodpecker: Hallucination Correction for Multimodal Large Language Models24 Oct
- 2023Evaluating Object Hallucination in Large Vision-Language Models17 May
Other references · 18
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2024Qwen2 Technical Reportcited by 2,076
- 2024Mixtral of Expertscited by 1,785
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
6 more
- 2018Object Hallucination in Image Captioningcited by 661
- 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 598
- 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 367
- 2017Beam Search Strategies for Neural Machine Translationcited by 232
- 2023Contrastive Decoding Improves Reasoning in Large Language Modelscited by 71
- 2024A Stitch in Time Saves Nine: Small VLM is a Precise Guidance for Accelerating Large VLMscited by 35
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Global Editing: Per-Instance Disentangled Subspaces for Training-Free Hallucination Mitigation in LVLMs
- 2026VCE: A zero-cost hallucination mitigation method of LVLMs via visual contrastive editing
- 2026HIME: Mitigating Object Hallucinations in LVLMs via Hallucination Insensitivity Model Editing
- 2026Mitigating Object Hallucinations in Vision-Language Models through Region-Aware Attention Recalibration
- 2026Hallucination-aware intermediate representation edit in large vision-language models
- 2025Exposing Hallucinations To Suppress Them: VLMs Representation Editing With Generative Anchors
- 2024Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations
- 2024Reducing Hallucinations in Vision-Language Models via Latent Space Steering