Discourse-Aware Graph Networks for Textual Logical Reasoning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Textual logical reasoning, especially question-answering (QA) tasks with logical reasoning, requires awareness of particular logical structures. The passage-level logical relations represent entailment or contradiction between propositional units (e.g., a concluding sentence). However, such structures are unexplored as current QA systems focus on entity-based relations. In this work, we propose logic structural-constraint modeling to solve the logical reasoning QA and introduce discourse-aware graph networks (DAGNs). The networks first construct logic graphs leveraging in-line discourse connectives and generic logic theories, then learn logic representations by end-to-end evolving the logic relations with an edge-reasoning mechanism and updating the graph features. This pipeline is applied to a general encoder, whose fundamental features are joined with the high-level logic features for answer prediction. Experiments on three textual logical reasoning datasets demonstrate the reasonability of the logical structures built in DAGNs and the effectiveness of the learned logic features. Moreover, zero-shot transfer results show the features' generality to unseen logical texts.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 90 of its 137 references that are in the map. First posted on arXiv 4 Jul 2022.
Builds on
90 of 137 references.
References · 90
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2016Layer Normalizationcited by 5,579
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
38 more
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
- 2016Bag of Tricks for Efficient Text Classificationcited by 869
- 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
- 2019Graph Transformer Networkscited by 520
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
- 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
- 2020Transformers as Soft Reasoners over Languagecited by 265
- 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
- 2020Retrieve, Program, Repeat: Complex Knowledge Base Question Answering via Alternate Meta-learningcited by 216
- 2019Visualizing and Measuring the Geometry of BERTcited by 215
- 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 211
- 2017Constructing Datasets for Multi-hop Reading Comprehension Across Documentscited by 190
- 2015The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systemscited by 172
- 2020Injecting Numerical Reasoning Skills into Language Modelscited by 133
- 2015Large-scale Simple Question Answering with Memory Networkscited by 127
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
- 2020MuTual: A Dataset for Multi-Turn Dialogue Reasoningcited by 114
- 2019Semantics-aware BERT for Language Understandingcited by 111
- 2019Fine-grained Fact Verification with Kernel Graph Attention Networkcited by 105
- 2019Discourse-Aware Neural Extractive Text Summarizationcited by 104
- 2016Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbotscited by 103
- 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 101
- 2019GEAR: Graph-based Evidence Aggregating and Reasoning for Fact Verificationcited by 100
- 2018Context-Aware Neural Machine Translation Learns Anaphora Resolutioncited by 97
- 2020Non-Local Graph Neural Networkscited by 91
- 2019Hierarchical Graph Network for Multi-hop Question Answeringcited by 83
- 2020Coreferential Reasoning Learning for Language Representationcited by 80
50 most cited of 90 All 90 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024GRS-QA -- Graph Reasoning-Structured Question Answering Dataset
- 2023Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension
- 2026From Chains to Graphs: Self-Structured Reasoning for General-Domain LLMs
- 2023Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs
- 2023Domain Specific Question Answering Over Knowledge Graphs Using Logical Programming and Large Language Models
- 2025Reasoning with Graphs: Structuring Implicit Knowledge to Enhance LLMs Reasoning
- 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning
- 2024Integrating Large Language Models with Graph-based Reasoning for Conversational Question Answering