mlsanityData to 14 Oct 2026

MGA-VQA: Secure and Interpretable Graph-Augmented Visual Question Answering with Memory-Guided Protection Against Unauthorized Knowledge Use

arXiv 2511.17881 ↗First posted 22 Nov 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Document Visual Question Answering (DocVQA) requires models to jointly understand textual semantics, spatial layout, and visual features. Current methods struggle with explicit spatial relationship modeling, inefficiency with high-resolution documents, multi-hop reasoning, and limited interpretability. We propose MGA-VQA, a multi-modal framework that integrates token-level encoding, spatial graph reasoning, memory-augmented inference, and question-guided compression. Unlike prior black-box models, MGA-VQA introduces interpretable graph-based decision pathways and structured memory access for enhanced reasoning transparency. Evaluation across six benchmarks (FUNSD, CORD, SROIE, DocVQA, STE-VQA, and RICO) demonstrates superior accuracy and efficiency, with consistent improvements in both answer prediction and spatial localization.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 43 references that are in the map. First posted on arXiv 22 Nov 2025.

Builds on

36 of 43 references.

References · 36

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2015VQA: Visual Question Answeringcited by 2,506
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  8. 2025Gemma 3 Technical Reportcited by 1,824
  9. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  10. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  11. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
  12. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
24 more
  1. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
  2. 2020LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understandingcited by 408
  3. 2021OCR-free Document Understanding Transformercited by 407
  4. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 349
  5. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 256
  6. 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
  7. 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 116
  8. 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 95
  9. 2020On the General Value of Evidence, and Bilingual Scene-Text Visual Question Answeringcited by 78
  10. 2022Multi-hop Question Answeringcited by 64
  11. 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
  12. 2024DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimmingcited by 35
  13. 2023PDFVQA: A New Dataset for Real-World VQA on PDF Documentscited by 28
  14. 2024GRAM: Global Reasoning for Multi-Page VQAcited by 23
  15. 2024DocLayLLM: An Efficient Multi-modal Extension of Large Language Models for Text-rich Document Understandingcited by 23
  16. 2025Visual question answering: from early developments to recent advances -- a surveycited by 19
  17. 2022Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural Networkscited by 17
  18. 2025A Token-level Text Image Foundation Model for Document Understandingcited by 14
  19. 2024DLaVA: Document Language and Vision Assistant for Answer Localization with Enhanced Interpretability and Trustworthinesscited by 8
  20. 2024Hypergraph based Understanding for Document Semantic Entity Recognitioncited by 4
  21. 2025QG-VTC: Question-Guided Visual Token Compression in MLLMs for Efficient VQAcited by 4
  22. 2024GeoContrastNet: Contrastive Key-Value Edge Learning for Language-Agnostic Document Understandingcited by 3
  23. 2025Reasoning-Based AI for Startup Evaluation (R.A.I.S.E.): A Memory-Augmented, Multi-Step Decision Frameworkcited by 3
  24. 2024Challenges in Pre-Training Graph Neural Networks for Context-Based Fake News Detection: An Evaluation of Current Strategies and Resource Limitationscited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2022Dynamic Key-value Memory Enhanced Multi-step Graph Reasoning for Knowledge-based Visual Question Answering
  2. 2026Towards Self-Explainable Document Visual Question Answering with Chain-of-Explanation Predictions
  3. 2025ARIAL: An Agentic Framework for Document VQA with Precise Answer Localization
  4. 2026DocTrace: Towards Traceable Long Document VQA via Hierarchical Evidence Graph Reasoning
  5. 2026SAFE-G: Structure-aware Faithful Evidence-guided Generation for Knowledge-based Visual Question Answering
  6. 2026VISPATH: Visual-Intent-Guided Path Reasoning for Multimodal Knowledge Graph Question Answering
  7. 2026Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering
  8. 2026ViSAR: Training-Free Adaptive-k Retrieval for Visual Document Question Answering