Improving Natural Language Inference Using External Knowledge in the Science Questions Domain
Not on the map. Why?
Abstract (arXiv)
Natural Language Inference (NLI) is fundamental to many Natural Language Processing (NLP) applications including semantic search and question answering. The NLI problem has gained significant attention thanks to the release of large scale, challenging datasets. Present approaches to the problem largely focus on learning-based methods that use only textual information in order to classify whether a given premise entails, contradicts, or is neutral with respect to a given hypothesis. Surprisingly, the use of methods based on structured knowledge -- a central topic in artificial intelligence -- has not received much attention vis-a-vis the NLI problem. While there are many open knowledge bases that contain various types of reasoning information, their use for NLI has not been well explored. To address this, we present a combination of techniques that harness knowledge graphs to improve performance on the NLI problem in the science questions domain. We present the results of applying our techniques on text, graph, and text-to-graph based models, and discuss implications for the use of external knowledge in solving the NLI problem. Our model achieves the new state-of-the-art performance on the NLI problem over the SciTail science questions dataset.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 9; 2023: 13; 2024: 5; 2025: 3; 2026: 1.
48 papers.
Sort:
By area:
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 170
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Modelscited by 73
- 2023Graph Neural Prompting with Large Language Modelscited by 64
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2022Kformer: Knowledge Injection in Transformer Feed-Forward Layerscited by 37
- 2023Graph Reasoning for Question Answering with Triplet Retrievalcited by 34
- 2021Meta-Knowledge Transfer for Inductive Knowledge Graph Embeddingcited by 31
- 2023Biomedical knowledge graph-optimized prompt generation for large language modelscited by 30
36 more
- 2021SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Miningcited by 24
- 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
- 2023GrapeQA: GRaph Augmentation and Pruning to Enhance Question-Answeringcited by 17
- 2023Structure Pretraining and Prompt Tuning for Knowledge Graph Transfercited by 16
- 2023Meta Prompting for AI Systemscited by 16
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsingcited by 15
- 2022A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answeringcited by 13
- 2022ComFact: A Benchmark for Linking Contextual Commonsense Knowledgecited by 11
- 2021Box Embeddings: An open-source library for representation learning using geometric structurescited by 9
- 2021Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratingscited by 9
- 2022A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inferencecited by 8
- 2023FiTs: Fine-grained Two-stage Training for Knowledge-aware Question Answeringcited by 8
- 2021SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoningcited by 7
- 2022Relation-Aware Language-Graph Transformer for Question Answeringcited by 7
- 2024Safety Control of Service Robots with LLMs and Embodied Knowledge Graphscited by 7
- 2024Way to Specialist: Closing Loop Between Specialized LLM and Evolving Domain Knowledge Graphcited by 6
- 2021KGSynNet: A Novel Entity Synonyms Discovery Framework with Knowledge Graphcited by 4
- 2021ExBERT: An External Knowledge Enhanced BERT for Natural Language Inferencecited by 4
- 2022CoSe-Co: Text Conditioned Generative CommonSense Contextualizercited by 3
- 2023Towards Faithful Knowledge Graph Explanation Through Deep Alignment in Commonsense Question Answeringcited by 3
- 2021Does Commonsense help in detecting Sarcasm?cited by 2
- 2021Commonsense Knowledge in Word Associations and ConceptNetcited by 2
- 2022Structured Knowledge Grounding for Question Answeringcited by 2
- 2025Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Predictioncited by 2
- 2021Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inferencecited by 1
- 2021TextRGNN: Residual Graph Neural Networks for Text Classificationcited by 1
- 2023LMExplainer: Grounding Knowledge and Explaining Language Modelscited by 1
- 2023Leveraging Knowledge and Reinforcement Learning for Enhanced Reliability of Language Modelscited by 1
- 2024PipeNet: Question Answering with Semantic Pruning over Knowledge Graphscited by 1
- 2024Compositional Generalization with Grounded Language Modelscited by 1
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoningcited by 1
- 2021Understanding in Artificial Intelligencecited by 0
- 2024Internal and External Knowledge Interactive Refinement Framework for Knowledge-Intensive Question Answeringcited by 0
- 2025Interpretability Framework for LLMs in Undergraduate Calculuscited by 0
- 2026Semantic Abstraction for Natural Language Inference: a Methodological Framework for Discovering and Compensating Semantic Knowledge and Reasoning Gaps in Large Language Modelscited by 0
- 2026Semantic Abstraction for Natural Language Inference: a Methodological Framework for Discovering and Compensating Semantic Knowledge and Reasoning Gaps in Large Language Models22 Sep 2026
- 2025Interpretability Framework for LLMs in Undergraduate Calculus19 Oct 2025
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoning28 May 2025
- 2025Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Prediction11 Apr 2025
- 2024Way to Specialist: Closing Loop Between Specialized LLM and Evolving Domain Knowledge Graph28 Nov 2024
- 2024Internal and External Knowledge Interactive Refinement Framework for Knowledge-Intensive Question Answering23 Aug 2024
- 2024Compositional Generalization with Grounded Language Models7 Jun 2024
- 2024Safety Control of Service Robots with LLMs and Embodied Knowledge Graphs28 May 2024
- 2024PipeNet: Question Answering with Semantic Pruning over Knowledge Graphs31 Jan 2024
- 2023Biomedical knowledge graph-optimized prompt generation for large language models29 Nov 2023
- 2023Meta Prompting for AI Systems20 Nov 2023
- 2023Towards Faithful Knowledge Graph Explanation Through Deep Alignment in Commonsense Question Answering7 Oct 2023
36 more
- 2023Graph Neural Prompting with Large Language Models27 Sep 2023
- 2023Leveraging Knowledge and Reinforcement Learning for Enhanced Reliability of Language Models25 Aug 2023
- 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models17 Aug 2023
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmap14 Jun 2023
- 2023Graph Reasoning for Question Answering with Triplet Retrieval30 May 2023
- 2023LMExplainer: Grounding Knowledge and Explaining Language Models29 Mar 2023
- 2023GrapeQA: GRaph Augmentation and Pruning to Enhance Question-Answering22 Mar 2023
- 2023Structure Pretraining and Prompt Tuning for Knowledge Graph Transfer3 Mar 2023
- 2023FiTs: Fine-grained Two-stage Training for Knowledge-aware Question Answering23 Feb 2023
- 2022Relation-Aware Language-Graph Transformer for Question Answering2 Dec 2022
- 2022ComFact: A Benchmark for Linking Contextual Commonsense Knowledge23 Oct 2022
- 2022Structured Knowledge Grounding for Question Answering17 Sep 2022
- 2022CoSe-Co: Text Conditioned Generative CommonSense Contextualizer12 Jun 2022
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifier6 Jun 2022
- 2022A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference31 May 2022
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answering21 Jan 2022
- 2022Kformer: Knowledge Injection in Transformer Feed-Forward Layers15 Jan 2022
- 2022A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering14 Jan 2022
- 2021TextRGNN: Residual Graph Neural Networks for Text Classification30 Dec 2021
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering6 Dec 2021
- 2021Meta-Knowledge Transfer for Inductive Knowledge Graph Embedding27 Oct 2021
- 2021GNN is a Counter? Revisiting GNN for Question Answering7 Oct 2021
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing21 Sep 2021
- 2021Commonsense Knowledge in Word Associations and ConceptNet20 Sep 2021
- 2021Does Commonsense help in detecting Sarcasm?17 Sep 2021
- 2021Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings16 Sep 2021
- 2021Box Embeddings: An open-source library for representation learning using geometric structures10 Sep 2021
- 2021Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference8 Sep 2021
- 2021SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining20 Aug 2021
- 2021ExBERT: An External Knowledge Enhanced BERT for Natural Language Inference3 Aug 2021
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answering25 May 2021
- 2021SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning18 Apr 2021
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering13 Apr 2021
- 2021KGSynNet: A Novel Entity Synonyms Discovery Framework with Knowledge Graph16 Mar 2021
- 2021Understanding in Artificial Intelligence17 Jan 2021
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 170
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Modelscited by 73
- 2023Graph Reasoning for Question Answering with Triplet Retrievalcited by 34
- 2023GrapeQA: GRaph Augmentation and Pruning to Enhance Question-Answeringcited by 17
- 2022Structured Knowledge Grounding for Question Answeringcited by 2
- 2025Interpretability Framework for LLMs in Undergraduate Calculuscited by 0
- 2026Semantic Abstraction for Natural Language Inference: a Methodological Framework for Discovering and Compensating Semantic Knowledge and Reasoning Gaps in Large Language Modelscited by 0
- 2026Semantic Abstraction for Natural Language Inference: a Methodological Framework for Discovering and Compensating Semantic Knowledge and Reasoning Gaps in Large Language Models22 Sep 2026
- 2025Interpretability Framework for LLMs in Undergraduate Calculus19 Oct 2025
- 2023MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models17 Aug 2023
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023
- 2023Graph Reasoning for Question Answering with Triplet Retrieval30 May 2023
- 2023GrapeQA: GRaph Augmentation and Pruning to Enhance Question-Answering22 Mar 2023
- 2022Structured Knowledge Grounding for Question Answering17 Sep 2022
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifier6 Jun 2022
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answering21 Jan 2022
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsingcited by 15
- 2021RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing21 Sep 2021
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2023Graph Neural Prompting with Large Language Modelscited by 64
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2022Kformer: Knowledge Injection in Transformer Feed-Forward Layerscited by 37
- 2021Meta-Knowledge Transfer for Inductive Knowledge Graph Embeddingcited by 31
- 2023Biomedical knowledge graph-optimized prompt generation for large language modelscited by 30
- 2021SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Miningcited by 24
- 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
- 2023Structure Pretraining and Prompt Tuning for Knowledge Graph Transfercited by 16
- 2023Meta Prompting for AI Systemscited by 16
12 most cited of 38 All 38 (JSON)
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoning28 May 2025
- 2025Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Prediction11 Apr 2025
- 2024Way to Specialist: Closing Loop Between Specialized LLM and Evolving Domain Knowledge Graph28 Nov 2024
- 2024Internal and External Knowledge Interactive Refinement Framework for Knowledge-Intensive Question Answering23 Aug 2024
- 2024Compositional Generalization with Grounded Language Models7 Jun 2024
- 2024Safety Control of Service Robots with LLMs and Embodied Knowledge Graphs28 May 2024
- 2024PipeNet: Question Answering with Semantic Pruning over Knowledge Graphs31 Jan 2024
- 2023Biomedical knowledge graph-optimized prompt generation for large language models29 Nov 2023
- 2023Meta Prompting for AI Systems20 Nov 2023
- 2023Towards Faithful Knowledge Graph Explanation Through Deep Alignment in Commonsense Question Answering7 Oct 2023
- 2023Graph Neural Prompting with Large Language Models27 Sep 2023
- 2023Leveraging Knowledge and Reinforcement Learning for Enhanced Reliability of Language Models25 Aug 2023
12 newest of 38 All 38 (JSON)