mlsanityData to 14 Oct 2026

Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generation

arXiv 2505.16237 ↗First posted 22 May 2025cs.CLcited by 9

On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG

Abstract (arXiv)

Despite the strong abilities, large language models (LLMs) still suffer from hallucinations and reliance on outdated knowledge, raising concerns in knowledge-intensive tasks. Graph-based retrieval-augmented generation (GRAG) enriches LLMs with knowledge by retrieving graphs leveraging relational evidence, but it faces two challenges: structure-coupled irrelevant knowledge introduced by neighbor expansion and structure-reasoning discrepancy between graph embeddings and LLM semantics. We propose ourmodel, an anchor-and-rationale guided refinement framework to address these challenges. It prompts an LLM to extract anchors and rationale chains, which provide intermediate supervision for (1) node-level alignment that identifies critical nodes and prunes noisy evidence, and (2) graph-level alignment that bridges graph and language semantic spaces via contrastive learning. Extensive experiments on commonsense reasoning, scene graph understanding, and knowledge graph reasoning demonstrate consistent gains over 18 strong baselines, validating the effectiveness of ourmodel for improving graph-grounded generation. The code can be found in https://anonymous.4open.science/r/Align-GRAG-F3D8/.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 39 of its 55 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

39 of 55 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning30 May
  2. 2024Don't Forget to Connect! Improving RAG with Graph-based Reranking28 May
  3. 2024GRAG: Graph Retrieval-Augmented Generation26 May
  4. 2024Retrieval-Augmented Generation with Knowledge Graphs for Customer Service Question Answering26 Apr
  5. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr

Other references · 34

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  5. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
  6. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  7. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 593
  8. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
  9. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  10. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
  11. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
  12. 2023Can Language Models Solve Graph Problems in Natural Language?cited by 252
22 more
  1. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
  2. 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
  3. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
  4. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  5. 2022A Review on Language Models as Knowledge Basescited by 157
  6. 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
  7. 2023Large Language Models in Law: A Surveycited by 128
  8. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  9. 2022UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graphcited by 103
  10. 2024KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graphcited by 93
  11. 2024Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphscited by 78
  12. 2024A Survey of Large Language Models for Graphscited by 72
  13. 2024Can GNN be Good Adapter for LLMs?cited by 71
  14. 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendationcited by 57
  15. 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 55
  16. 2024Efficient Tuning and Inference for Large Language Models on Textual Graphscited by 54
  17. 2024IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner Monologuescited by 40
  18. 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 39
  19. 2023Disentangled Representation Learning with Large Language Models for Text-Attributed Graphscited by 36
  20. 2024Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentationcited by 24
  21. 2025Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answeringcited by 15
  22. 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregationcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 7.

9 papers.

  1. 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environmentscited by 14
  2. 2025Think-on-Graph 3.0: Efficient and Adaptive LLM Reasoning on Heterogeneous Graphs via Multi-Agent Dual-Evolving Context Retrievalcited by 10
  3. 2026MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Searchcited by 5
  4. 2026Tandem: Riding Together with Large and Small Language Models for Efficient Reasoningcited by 2
  5. 2026LLM as Graph Kernel: Rethinking Message Passing on Text-Rich Graphscited by 1
  6. 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Frameworkcited by 0
  7. 2026BRIDGE: Bridging Reasoning In Distillation Gap Elimination via Structure-Aware Maskingcited by 0
  8. 2026AdapTime: Enabling Adaptive Temporal Reasoning in Large Language Modelscited by 0
  9. 2026MultiDx: A Multi-Source Knowledge Integration Framework towards Diagnostic Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Enhancing Large Language Model for Knowledge Graph Completion via Structure-Aware Alignment-Tuning
  2. 2024GUNDAM: Aligning Large Language Models with Graph Understanding
  3. 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs
  4. 2025GPR: Empowering Generation with Graph-Pretrained Retriever
  5. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation
  6. 2026GraphScout: Empowering Large Language Models with Intrinsic Exploration Ability for Agentic Graph Reasoning
  7. 2025GRIP: In-Parameter Graph Reasoning through Fine-Tuning Large Language Models
  8. 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generation