mlsanityData to 7 Oct 2026

QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering

arXiv 2104.06378 ↗First posted 13 Apr 2021cs.CL cs.LGcited by 386

Not on the map. Why?

Cited by 65 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge from large KGs, and (ii) perform joint reasoning over the QA context and KG. In this work, we propose a new model, QA-GNN, which addresses the above challenges through two key innovations: (i) relevance scoring, where we use LMs to estimate the importance of KG nodes relative to the given QA context, and (ii) joint reasoning, where we connect the QA context and KG to form a joint graph, and mutually update their representations through graph neural networks. We evaluate our model on QA benchmarks in the commonsense (CommonsenseQA, OpenBookQA) and biomedical (MedQA-USMLE) domains. QA-GNN outperforms existing LM and LM+KG models, and exhibits capabilities to perform interpretable and structured reasoning, e.g., correctly handling negation in questions.

Key facts. Cited by 386 papers in the map (data through 7 Oct 2026). Builds on 48 of its 65 references that are in the map. First posted on arXiv 13 Apr 2021.

Builds on

48 of 65 references.

References · 48

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2017Graph Attention Networkscited by 8,854
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  7. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  8. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  9. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  10. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  11. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  12. 2019Language Models as Knowledge Bases?cited by 1,922
36 more
  1. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  2. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  3. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  4. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  5. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  6. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
  7. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  8. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  9. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  10. 2017A simple neural network module for relational reasoningcited by 345
  11. 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 240
  12. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 233
  13. 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
  14. 2019PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Textcited by 182
  15. 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 169
  16. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 167
  17. 2019What Can Neural Networks Reason About?cited by 155
  18. 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
  19. 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
  20. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  21. 2020Graph-based, Self-Supervised Program Repair from Diagnostic Feedbackcited by 93
  22. 2019Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answeringcited by 68
  23. 2017Graph-based Neural Multi-Document Summarizationcited by 54
  24. 2015Traversing Knowledge Graphs in Vector Spacecited by 51
  25. 2018Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledgecited by 48
  26. 2018Improving Natural Language Inference Using External Knowledge in the Science Questions Domaincited by 48
  27. 2018Commonsense for Generative Multi-Hop Question Answering Taskscited by 48
  28. 2020Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answeringcited by 44
  29. 2019Improving Question Answering over Incomplete KBs with Knowledge-Aware Readercited by 37
  30. 2019Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answeringcited by 37
  31. 2019Careful Selection of Knowledge to solve Open Book Question Answeringcited by 35
  32. 2019From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Projectcited by 33
  33. 2019Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Modelscited by 28
  34. 2019Ranking and Selecting Multi-Hop Knowledge Paths to Better Predict Human Needscited by 22
  35. 2019Improving Question Answering with External Knowledgecited by 16
  36. 2020Knowledge Fusion and Semantic Knowledge Ranking for Open Domain Question Answeringcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 20; 2022: 64; 2023: 87; 2024: 95; 2025: 63; 2026: 57.

386 papers.

Sort:

By area:

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  2. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  3. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  4. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  5. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
  6. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  7. 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 213
  8. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
  9. 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 170
  10. 2022A Review on Language Models as Knowledge Basescited by 156
  11. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  12. 2023Knowledge Graph Prompting for Multi-Document Question Answeringcited by 150
38 more
  1. 2023Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learningcited by 132
  2. 2024GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoningcited by 128
  3. 2022Retrieval-Augmented Multimodal Language Modelingcited by 125
  4. 2023Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answeringcited by 119
  5. 2023Large Language Models as Analogical Reasonerscited by 107
  6. 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
  7. 2024CRAG -- Comprehensive RAG Benchmarkcited by 94
  8. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
  9. 2024GRAG: Graph Retrieval-Augmented Generationcited by 77
  10. 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Modelscited by 73
  11. 2023Large Language Models and Knowledge Graphs: Opportunities and Challengescited by 71
  12. 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Constructioncited by 70
  13. 2024AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoningcited by 69
  14. 2023Graph Neural Prompting with Large Language Modelscited by 64
  15. 2023Natural Language Reasoning, A Surveycited by 61
  16. 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoningcited by 60
  17. 2025PathRAG: Pruning Graph-based Retrieval Augmented Generation with Relational Pathscited by 60
  18. 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
  19. 2024Large Language Models Reflect the Ideology of their Creatorscited by 56
  20. 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
  21. 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 53
  22. 2021Complex Knowledge Base Question Answering: A Surveycited by 52
  23. 2025RAG vs. GraphRAG: A Systematic Evaluation and Key Insightscited by 51
  24. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  25. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 47
  26. 2024Reasoning-Enhanced Healthcare Predictions with Knowledge Graph Community Retrievalcited by 45
  27. 2022Knowledge Graph Embedding: A Survey from the Perspective of Representation Spacescited by 41
  28. 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
  29. 2021Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attentioncited by 40
  30. 2025GFM-RAG: Graph Foundation Model for Retrieval Augmented Generationcited by 40
  31. 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 40
  32. 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 38
  33. 2022SizeShiftReg: a Regularization Method for Improving Size-Generalization in Graph Neural Networkscited by 36
  34. 2022CommunityLM: Probing Partisan Worldviews from Language Modelscited by 36
  35. 2023Knowledge Solver: Teaching LLMs to Search for Domain Knowledge from Knowledge Graphscited by 35
  36. 2023Graph Reasoning for Question Answering with Triplet Retrievalcited by 34
  37. 2024Benchmarks as Microscopes: A Call for Model Metrologycited by 33
  38. 2023ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddingscited by 32

50 most cited of 386 All 386 (JSON)