mlsanityData to 14 Oct 2026

OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination

arXiv 2610.02999 ↗First posted 2 Oct 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which evidence sustains a generated commitment. We introduce OmniConfess, a training-free method for mitigating omni-modal hallucinations. It fixes a candidate response and re-scores it at token resolution under controlled channel-wise evidence interventions, producing a structured token-by-channel confession that reveals the response's evidential dependence. OmniConfess uses this confession to preserve grounded content and correct commitments driven by irrelevant or contradictory evidence. To evaluate OmniConfess, we construct OmniHalluBench, a 3,540-example benchmark built from six datasets spanning text, image, audio, and video settings and both judgment and free-form generation. Experiments show that OmniConfess mitigates hallucinations across heterogeneous modality and task settings. Our code and benchmark are publicly available at https://github.com/RongHuiQiang/OmniConfess.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 36 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

33 of 36 references.

References · 33

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  3. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
  4. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  5. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
  6. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 688
  7. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  8. 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocationcited by 478
  9. 2023Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuningcited by 445
  10. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
  11. 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 376
  12. 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
21 more
  1. 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 283
  2. 2024Multi-Modal Hallucination Control by Visual Information Groundingcited by 208
  3. 2023Self-Evaluation Guided Beam Search for Reasoningcited by 196
  4. 2024RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Modelscited by 60
  5. 2024AVHBench: A Cross-Modal Hallucination Benchmark for Audio-Visual Large Language Modelscited by 56
  6. 2024The Curse of Multi-Modalities: Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audiocited by 53
  7. 2024PhD: A ChatGPT-Prompted Visual hallucination Evaluation Datasetcited by 45
  8. 2022MM-SHAP: A Performance-agnostic Metric for Measuring Multimodal Contributions in Vision and Language Models & Taskscited by 43
  9. 2024HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal Reasoningcited by 32
  10. 2025Token Activation Map to Visually Explain Multimodal LLMscited by 32
  11. 2025AVCD: Mitigating Hallucinations in Audio-Visual Large Language Models through Contrastive Decodingcited by 30
  12. 2024Alleviating Hallucination in Large Vision-Language Models with Active Retrieval Augmentationcited by 29
  13. 2025Where MLLMs Attend and What They Rely On: Explaining Autoregressive Token Generationcited by 16
  14. 2025φ-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitationcited by 13
  15. 2026MoD-DPO: Towards Mitigating Cross-modal Hallucinations in Omni LLMs using Modality Decoupled Preference Optimizationcited by 6
  16. 2026MAD: Modality-Adaptive Decoding for Mitigating Cross-Modal Hallucinations in Multimodal Large Language Modelscited by 5
  17. 2025Do LVLMs Know What They Know? A Systematic Study of Knowledge Boundary Perception in LVLMscited by 4
  18. 2026OmniHalluc-L: Counterfactual Benchmarking and Modality-Perturbation Reliability Calibration for Long-Form Omni Hallucinationcited by 3
  19. 2025OMHBench: Benchmarking Balanced and Grounded Omni-Modal Multi-Hop Reasoningcited by 2
  20. 2026Token-Guard: Towards Token-Level Hallucination Control via Self-Checking Decodingcited by 2
  21. 2026OmniTrace: A Unified Framework for Generation-Time Attribution in Omni-Modal LLMscited by 1

Built on by

Not cited yet.