MG2-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generation
On the map: Multimodal LLMs / vision-language models → Document understanding and multimodal RAG
also in 1 more
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while current graph-based methods rely on costly ``translation-to-text'' pipelines that discard fine-grained visual information. To address these limitations, we propose MG2-RAG, a lightweight Multi-Granularity Graph RAG framework that jointly improves graph construction, modality fusion, and cross-modal retrieval. MG2-RAG constructs a hierarchical multimodal knowledge graph by combining lightweight textual parsing with entity-driven visual grounding, enabling textual entities and visual regions to be fused into unified multimodal nodes that preserve atomic evidence. Building on this representation, we introduce a multi-granularity graph retrieval mechanism that aggregates dense similarities and propagates relevance across the graph to support structured multi-hop reasoning. Extensive experiments across four representative multimodal tasks (i.e., retrieval, knowledge-based VQA, reasoning, and classification) demonstrate that MG2-RAG consistently achieves state-of-the-art performance while reducing graph construction overhead with an average 43.3× speedup and 23.9× cost reduction compared with advanced graph-based frameworks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Document understanding and multimodal RAG, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 75 of its 89 references that are in the map. First posted on arXiv 4 Apr 2026.
Builds on
75 of 89 references.
Closest ancestors · 10
Same direction, newest first
- 2025ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering27 Nov
- 2025mRAG: Elucidating the Design Space of Multi-modal Retrieval-Augmented Generation29 May
- 2024Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering25 Nov
- 2024mR2AG: Multimodal Retrieval-Reflection-Augmented Generation for Knowledge-Based VQA22 Nov
- 2024RoRA-VLM: Robust Retrieval-Augmented Vision Language Models11 Oct
- 2024EchoSight: Advancing Visual-Language Models with Wiki Knowledge17 Jul
- 2024ColPali: Efficient Document Retrieval with Vision Language Models27 Jun
- 2024Wiki-LLaVA: Hierarchical Retrieval-Augmented Generation for Multimodal LLMs23 Apr
- 2022REVEAL: Retrieval-Augmented Visual-Language Pre-Training with Multi-Source Multimodal Knowledge Memory10 Dec
- 2022Retrieval-Augmented Multimodal Language Modeling22 Nov
Other references · 65
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
38 more
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
- 2019PlotQA: Reasoning over Scientific Plotscited by 321
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 265
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
- 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 223
- 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 220
- 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
- 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 138
- 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
- 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 119
- 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categoriescited by 107
- 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Toolscited by 106
- 2019MMKG: Multi-Modal Knowledge Graphscited by 105
- 2024EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameterscited by 99
- 2022Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answeringcited by 93
- 2018CrisisMMD: Multimodal Twitter Datasets from Natural Disasterscited by 89
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
- 2024Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphscited by 78
- 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
- 2025Chain-of-Retrieval Augmented Generationcited by 49
- 2025LinearRAG: Linear Graph Retrieval Augmented Generation on Large-scale Corporacited by 49
- 2024Multimodal Reasoning with Multimodal Knowledge Graphcited by 44
- 2024PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makerscited by 42
- 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
- 2025REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmarkcited by 35
- 2025KET-RAG: A Cost-Efficient Multi-Granular Indexing Framework for Graph-RAGcited by 29
- 2025ArchRAG: Attributed Community-based Hierarchical Retrieval-Augmented Generationcited by 28
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025M3KG-RAG: Multi-hop Multimodal Knowledge Graph-enhanced Retrieval-Augmented Generation
- 2025RAG-Anything: All-in-One RAG Framework
- 2025Multimodal RAG for Unstructured Data:Leveraging Modality-Aware Knowledge Graphs with Hybrid Retrieval
- 2026MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation
- 2025MegaRAG: Multimodal Knowledge Graph-Based Retrieval Augmented Generation
- 2026Multi-Granularity Context-Enhanced RAG over Multimodal Knowledge Graphs
- 2025A Multi-Granularity Retrieval Framework for Visually-Rich Documents
- 2025VAT-KG: Knowledge-Intensive Multimodal Knowledge Graph Dataset for Retrieval-Augmented Generation