HALDETECT at ImageEval 2026 Shared Tasks: Answer-First Contrastive Grounding with QLoRA
On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs
Abstract (arXiv)
Large multimodal models tend to hallucinate visual detail fluently, which limits their deployment for fine-grained interpretation. We present HALDETECT, our system for the English hallucination-detection track (Task 1b) of ImageEval 2026, in which a system must identify, from an image and three culturally plausible statements, the single visually grounded one. We frame the item as one contrastive decision, emit the answer before its explanation, and structure reasoning around colour/texture, shape/form, and context. Our best submitted adapter fine-tunes Qwen2.5-VL-7B-Instruct with 4-bit QLoRA while freezing the vision encoder and reaches Contrastive Instability (CI) 0.035 on the 1,000-item test set; we placed third of eight teams. Development experiments show that answer order can matter more than model scale and that adaptation beats prompting alone. Retrospective paired analysis of the released gold labels confirms the QLoRA gain over the best prompt but not the small gap between the devtest-selected and best-test adapters, and reseeding all four training sizes shows that the apparent data-scaling curve does not survive a seed change. The 35 residual errors are culturally plausible function, material, and recognition distinctions; naive adapter voting does not help.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 5 of its 10 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
5 of 10 references.
References · 5
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2025OASIS: A Multilingual and Multimodal Dataset for Culturally Grounded Spoken Visual QAcited by 5
- 2026Said Aloud, Read Different: Cross-Modal Instability in Multimodal Modelscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Detecting and Preventing Hallucinations in Large Vision Language Models
- 2024HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal Reasoning
- 2024HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding
- 2025Mitigating Hallucination in Multimodal LLMs with Layer Contrastive Decoding
- 2026CHASD: Language Increment-Calibrated Contrastive Decoding against Hallucination in LVLMs
- 2026Do We Really Need External Tools to Mitigate Hallucinations? SIRA: Shared-Prefix Internal Reconstruction of Attribution
- 2024Delve into Visual Contrastive Decoding for Hallucination Mitigation of Large Vision-Language Models
- 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding