mlsanityData to 14 Oct 2026

MG2-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generation

arXiv 2604.04969 ↗First posted 4 Apr 2026cs.IR cs.AIcited by 1

On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG

also in 1 more
Abstract (arXiv)

Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while current graph-based methods rely on costly ``translation-to-text'' pipelines that discard fine-grained visual information. To address these limitations, we propose MG2-RAG, a lightweight Multi-Granularity Graph RAG framework that jointly improves graph construction, modality fusion, and cross-modal retrieval. MG2-RAG constructs a hierarchical multimodal knowledge graph by combining lightweight textual parsing with entity-driven visual grounding, enabling textual entities and visual regions to be fused into unified multimodal nodes that preserve atomic evidence. Building on this representation, we introduce a multi-granularity graph retrieval mechanism that aggregates dense similarities and propagates relevance across the graph to support structured multi-hop reasoning. Extensive experiments across four representative multimodal tasks (i.e., retrieval, knowledge-based VQA, reasoning, and classification) demonstrate that MG2-RAG consistently achieves state-of-the-art performance while reducing graph construction overhead with an average 43.3× speedup and 23.9× cost reduction compared with advanced graph-based frameworks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 75 of its 89 references that are in the map. First posted on arXiv 4 Apr 2026.

Builds on

75 of 89 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering27 Nov
  2. 2025mRAG: Elucidating the Design Space of Multi-modal Retrieval-Augmented Generation29 May
  3. 2024Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering25 Nov
  4. 2024mR2AG: Multimodal Retrieval-Reflection-Augmented Generation for Knowledge-Based VQA22 Nov
  5. 2024RoRA-VLM: Robust Retrieval-Augmented Vision Language Models11 Oct
  6. 2024EchoSight: Advancing Visual-Language Models with Wiki Knowledge17 Jul
  7. 2024ColPali: Efficient Document Retrieval with Vision Language Models27 Jun
  8. 2024Wiki-LLaVA: Hierarchical Retrieval-Augmented Generation for Multimodal LLMs23 Apr
  9. 2022REVEAL: Retrieval-Augmented Visual-Language Pre-Training with Multi-Source Multimodal Knowledge Memory10 Dec
  10. 2022Retrieval-Augmented Multimodal Language Modeling22 Nov

Other references · 65

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  8. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  9. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  10. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  11. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  12. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
38 more
  1. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  3. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  4. 2025SAM 3: Segment Anything with Conceptscited by 906
  5. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  6. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
  7. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
  8. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
  9. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
  10. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
  11. 2019PlotQA: Reasoning over Scientific Plotscited by 321
  12. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  13. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
  14. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 265
  15. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
  16. 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 223
  17. 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 220
  18. 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
  19. 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 138
  20. 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
  21. 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 119
  22. 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categoriescited by 107
  23. 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Toolscited by 106
  24. 2019MMKG: Multi-Modal Knowledge Graphscited by 105
  25. 2024EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameterscited by 99
  26. 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
  27. 2018CrisisMMD: Multimodal Twitter Datasets from Natural Disasterscited by 89
  28. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
  29. 2024Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphscited by 78
  30. 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
  31. 2025Chain-of-Retrieval Augmented Generationcited by 49
  32. 2025LinearRAG: Linear Graph Retrieval Augmented Generation on Large-scale Corporacited by 49
  33. 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 44
  34. 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makerscited by 42
  35. 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
  36. 2025REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmarkcited by 35
  37. 2025KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAGcited by 29
  38. 2025ArchRAG: Attributed Community-based Hierarchical Retrieval-Augmented Generationcited by 28

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025M3KG-RAG: Multi-hop Multimodal Knowledge Graph-enhanced Retrieval-Augmented Generation
  2. 2025RAG-Anything: All-in-One RAG Framework
  3. 2025Multimodal RAG for Unstructured Data:Leveraging Modality-Aware Knowledge Graphs with Hybrid Retrieval
  4. 2026MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation
  5. 2025MegaRAG: Multimodal Knowledge Graph-Based Retrieval Augmented Generation
  6. 2026Multi-Granularity Context-Enhanced RAG over Multimodal Knowledge Graphs
  7. 2025A Multi-Granularity Retrieval Framework for Visually-Rich Documents
  8. 2025VAT-KG: Knowledge-Intensive Multimodal Knowledge Graph Dataset for Retrieval-Augmented Generation