MultAttnAttrib: Training-Free Multimodal Attribution in Long Document Question Answering
Not on the map. Why?
Abstract (arXiv)
As grounded QA systems are increasingly deployed in AI assistants, accurately attributing generated answers to evidence is critical for user trust and model safety. While unimodal attributions have been explored in depth, the multimodal setting remains relatively under-researched. As a result, we introduce MultAttnAttrib, a training-free attribution-generation method that leverages a model's prefill pass, selected attention heads, and calibrated thresholds to locate source evidence within a document. To establish baseline results for the method, we introduce MultAttrEval, a complementary benchmark dataset annotated with fine-grained, ground-truth attributions for answer components grounded in multimodal source documents. To our knowledge, this is the first evaluation dataset designed specifically for multimodal attribution in long-form documents. Experimental results show that MultAttnAttrib consistently outperforms a variety of attribution-generation methods, including several strong prompting-based approaches and matches the latest frontier models such as GPT 5.4. Our method not only substantially improves attribution accuracy for both unimodal and multimodal attribution types, but also produces attributions at up to one-seventh of the direct inference latency compared to prompting on the same base model.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 134 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
20 of 134 references.
References · 20
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2023Evaluating Verifiability in Generative Search Enginescited by 303
- 2024Retrieval Head Mechanistically Explains Long-Context Factualitycited by 232
- 2023Stabilizing Transformer Training by Preventing Attention Entropy Collapsecited by 161
- 2024Attribute First, then Generate: Locally-attributable Grounded Text Generationcited by 54
- 2024MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokenscited by 50
- 2024Training Language Models to Generate Text with Citations via Fine-grained Rewardscited by 42
- 2025Benchmarking Retrieval-Augmented Multimodal Generation for Document Question Answeringcited by 36
- 2024VISA: Retrieval Augmented Generation with Visual Source Attributioncited by 28
8 more
- 2024Peering into the Mind of Language Models: An Approach for Attribution in Contextual Question Answeringcited by 25
- 2024Beyond Logit Lens: Contextual Embeddings for Robust Hallucination Detection & Grounding in VLMscited by 22
- 2024Learning to Generate Answers with Citations via Factual Consistency Modelscited by 13
- 2024CoTAR: Chain-of-Thought Attribution Reasoning with Multi-level Granularitycited by 12
- 2024Enhancing Post-Hoc Attributions in Long Document Comprehension via Coarse Grained Answer Decompositioncited by 12
- 2025VeriCite: Towards Reliable Citations in Retrieval-Augmented Generation via Rigorous Verificationcited by 8
- 2026SciClaimEval: Cross-modal Claim Verification in Scientific Paperscited by 7
- 2026Multimodal Fact-Level Attribution for Verifiable Reasoningcited by 2
Built on by
Not cited yet.