mlsanityData to 14 Oct 2026

Can We Do Interpretable NLI with Graphs Based on Atomic Propositions?

arXiv 2609.16814 ↗First posted 15 Sep 2026cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

While Large Language Model (LLM)-based Natural Language Inference (NLI) systems achieve high accuracy, their decision-making processes lack auditable structures. This paper explores whether NLI can be performed using only interpretable, graph-based representations of evidence. We introduce a fully graph-based pipeline where the classifier never directly processes the input text. Instead, sentences are decomposed into atomic propositions, converted into ConceptNet triples via constrained decoding, and represented as three graphs per pair: premise, hypothesis, and a retrieved ConceptNet subgraph. These graphs are then fed into a fine-tuned 0.8-billion-parameter language model. On the SNLI dataset, our pipeline achieves 89.7% accuracy, just 1.9 points below an identically trained text-based model. On ANLI, it matches the published performance of RoBERTa-large on rounds R2 and R3 (48.0% vs. 48.9% and 44.9% vs. 44.4%) but trails by 16 points on R1, resulting in an overall gap of 9 to 14 points compared to its text counterpart. We term this gap the price of interpretability and demonstrate that it stems from representational limitations rather than data constraints. Ablation studies further reveal that graphs and text are complementary: combining both modalities achieves 92.1% accuracy on SNLI.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

17 of 38 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  5. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  6. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  7. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  8. 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
  9. 2018Annotation Artifacts in Natural Language Inference Datacited by 671
  10. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  11. 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
  12. 2018Combining Fact Extraction and Verification with Neural Semantic Matching Networkscited by 120
5 more
  1. 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 53
  2. 2017Neural Natural Language Inference Models Enhanced with External Knowledgecited by 40
  3. 2025NLI under the Microscope: What Atomic Hypothesis Decomposition Revealscited by 11
  4. 2026Atomic-SNLI: Fine-Grained Natural Language Inference through Atomic Fact Decompositioncited by 3
  5. 2026LLM-based Atomic Propositions help weak extractors: Evaluation of a Propositioner for triplet extractioncited by 1

Built on by

Not cited yet.