Augmenting Neural Networks with First-order Logic
Not on the map. Why?
Abstract (arXiv)
Today, the dominant paradigm for training neural networks involves minimizing task loss on a large dataset. Using world knowledge to inform a model, and yet retain the ability to perform end-to-end training remains an open question. In this paper, we present a novel framework for introducing declarative knowledge to neural network architectures in order to guide training and prediction. Our framework systematically compiles logical statements into computation graphs that augment a neural network without extra learnable parameters or manual redesign. We evaluate our modeling strategy on three tasks: machine comprehension, natural language inference, and text chunking. Our experiments show that knowledge-augmented networks can strongly improve over baselines, especially in low-data regimes.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 13; 2023: 12; 2024: 7; 2025: 5; 2026: 3.
51 papers.
Sort:
By area:
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detectioncited by 66
- 2021Incorporating Domain Knowledge into Deep Neural Networkscited by 56
- 2023Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Modelscited by 38
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Reviewcited by 37
- 2021Multi-Label Classification Neural Networks with Hard Logical Constraintscited by 36
- 2022ROAD-R: The Autonomous Driving Dataset with Logical Requirementscited by 34
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2023GLoRE: Evaluating Logical Reasoning of Large Language Modelscited by 13
- 2021DomiKnowS: A Library for Integration of Symbolic Domain Knowledge in Deep Learningcited by 12
- 2023Semantic Strengthening of Neuro-Symbolic Learningcited by 12
38 more
- 2024Do Large Language Models Understand Logic or Just Mimick Context?cited by 10
- 2024Learning with Logical Constraints but without Shortcut Satisfactioncited by 10
- 2025DMWM: Dual-Mind World Model with Long-Term Imaginationcited by 10
- 2021Learning Constraints and Descriptive Segmentation for Subevent Detectioncited by 9
- 2021Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratingscited by 9
- 2021Exploring Distantly-Labeled Rationales in Neural Network Modelscited by 8
- 2021Evaluating Relaxations of Logic for Neural Networks: A Comprehensive Studycited by 8
- 2022AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehensioncited by 8
- 2023AutoML in The Wild: Obstacles, Workarounds, and Expectationscited by 8
- 2024Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learnerscited by 8
- 2021AI Descartes: Combining Data and Theory for Derivable Scientific Discoverycited by 7
- 2024EXPLAIN, AGREE, LEARN: Scaling Learning for Neural Probabilistic Logiccited by 6
- 2022A Solver-Free Framework for Scalable Learning in Neural ILP Architecturescited by 5
- 2024Logic Rules as Explanations for Legal Case Retrievalcited by 5
- 2025The Need for Verification in AI-Driven Scientific Discoverycited by 5
- 2022A Novel Multi-Task Learning Approach for Context-Sensitive Compound Type Identification in Sanskritcited by 4
- 2023Augmenting deep neural networks with symbolic knowledge: Towards trustworthy and interpretable AI for educationcited by 4
- 2024Exploiting T-norms for Deep Learning in Autonomous Drivingcited by 4
- 2022Knowledge Enhanced Neural Networks for relational domainscited by 3
- 2023LogicMP: A Neuro-symbolic Approach for Encoding First-order Logic Constraintscited by 3
- 2025LogiCoL: Logically-Informed Contrastive Learning for Set-based Dense Retrievalcited by 3
- 2022Memory Classifiers: Two-stage Classification for Robustness in Machine Learningcited by 2
- 2022Reduced Implication-bias Logic Loss for Neuro-Symbolic Learningcited by 2
- 2023Parallel Neurosymbolic Integration with Concordiacited by 2
- 2023The Integer Linear Programming Inference Cookbookcited by 2
- 2022Label Augmentation with Reinforced Labeling for Weak Supervisioncited by 1
- 2022Movement Analytics: Current Status, Application to Manufacturing, and Future Prospects from an AI Perspectivecited by 1
- 2022Neural DAEs: Constrained neural networkscited by 1
- 2023Current and Future Challenges in Knowledge Representation and Reasoningcited by 1
- 2024MedLogic-AQA: Enhancing Medical Question Answering with Abstractive Models Focusing on Logical Structurescited by 1
- 2021A Review of Some Techniques for Inclusion of Domain-Knowledge into Deep Neural Networkscited by 0
- 2022Constrained Training of Neural Networks via Theorem Provingcited by 0
- 2023Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structurescited by 0
- 2023Improving Text Matching in E-Commerce Search with A Rationalizable, Intervenable and Fast Entity-Based Relevance Modelcited by 0
- 2025Bridging Neural Networks and Dynamic Time Warping for Adaptive Time Series Classificationcited by 0
- 2025Towards Scalable Lottery Ticket Networks using Genetic Algorithmscited by 0
- 2026On Improving Neurosymbolic Learning by Exploiting the Representation Spacecited by 0
- 2026Structure-Preserving Document Translation via Multi-Stage LLM Pipeline: A Case Study in Marathicited by 0
50 most cited of 51 All 51 (JSON)
- 2026CONSISTRE: A Unified Consistency-Aware Framework for Document-Level Relation Extraction with Large Language Models27 Jul 2026
- 2026Structure-Preserving Document Translation via Multi-Stage LLM Pipeline: A Case Study in Marathi27 Jun 2026
- 2026On Improving Neurosymbolic Learning by Exploiting the Representation Space8 Feb 2026
- 2025The Need for Verification in AI-Driven Scientific Discovery1 Sep 2025
- 2025Towards Scalable Lottery Ticket Networks using Genetic Algorithms12 Aug 2025
- 2025Bridging Neural Networks and Dynamic Time Warping for Adaptive Time Series Classification13 Jul 2025
- 2025LogiCoL: Logically-Informed Contrastive Learning for Set-based Dense Retrieval26 May 2025
- 2025DMWM: Dual-Mind World Model with Long-Term Imagination11 Feb 2025
- 2024MedLogic-AQA: Enhancing Medical Question Answering with Abstractive Models Focusing on Logical Structures20 Oct 2024
- 2024EXPLAIN, AGREE, LEARN: Scaling Learning for Neural Probabilistic Logic15 Aug 2024
- 2024Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learners30 Apr 2024
- 2024Logic Rules as Explanations for Legal Case Retrieval3 Mar 2024
38 more
- 2024Learning with Logical Constraints but without Shortcut Satisfaction1 Mar 2024
- 2024Do Large Language Models Understand Logic or Just Mimick Context?19 Feb 2024
- 2024Exploiting T-norms for Deep Learning in Autonomous Driving17 Feb 2024
- 2023Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models15 Nov 2023
- 2023Augmenting deep neural networks with symbolic knowledge: Towards trustworthy and interpretable AI for education1 Nov 2023
- 2023GLoRE: Evaluating Logical Reasoning of Large Language Models13 Oct 2023
- 2023LogicMP: A Neuro-symbolic Approach for Encoding First-order Logic Constraints27 Sep 2023
- 2023Current and Future Challenges in Knowledge Representation and Reasoning8 Aug 2023
- 2023Improving Text Matching in E-Commerce Search with A Rationalizable, Intervenable and Fast Entity-Based Relevance Model1 Jul 2023
- 2023The Integer Linear Programming Inference Cookbook30 Jun 2023
- 2023Parallel Neurosymbolic Integration with Concordia1 Jun 2023
- 2023Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structures30 May 2023
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-47 Apr 2023
- 2023Semantic Strengthening of Neuro-Symbolic Learning28 Feb 2023
- 2023AutoML in The Wild: Obstacles, Workarounds, and Expectations21 Feb 2023
- 2022Neural DAEs: Constrained neural networks25 Nov 2022
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computing28 Oct 2022
- 2022A Solver-Free Framework for Scalable Learning in Neural ILP Architectures17 Oct 2022
- 2022ROAD-R: The Autonomous Driving Dataset with Logical Requirements4 Oct 2022
- 2022Movement Analytics: Current Status, Application to Manufacturing, and Future Prospects from an AI Perspective4 Oct 2022
- 2022A Novel Multi-Task Learning Approach for Context-Sensitive Compound Type Identification in Sanskrit22 Aug 2022
- 2022Reduced Implication-bias Logic Loss for Neuro-Symbolic Learning14 Aug 2022
- 2022Constrained Training of Neural Networks via Theorem Proving8 Jul 2022
- 2022Memory Classifiers: Two-stage Classification for Robustness in Machine Learning10 Jun 2022
- 2022Knowledge Enhanced Neural Networks for relational domains31 May 2022
- 2022Label Augmentation with Reinforced Labeling for Weak Supervision13 Apr 2022
- 2022AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension16 Mar 2022
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Review24 Feb 2022
- 2021Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings16 Sep 2021
- 2021Learning Constraints and Descriptive Segmentation for Subevent Detection13 Sep 2021
- 2021AI Descartes: Combining Data and Theory for Derivable Scientific Discovery3 Sep 2021
- 2021DomiKnowS: A Library for Integration of Symbolic Domain Knowledge in Deep Learning27 Aug 2021
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Survey25 Aug 2021
- 2021Evaluating Relaxations of Logic for Neural Networks: A Comprehensive Study28 Jul 2021
- 2021A Review of Some Techniques for Inclusion of Domain-Knowledge into Deep Neural Networks21 Jul 2021
- 2021Exploring Distantly-Labeled Rationales in Neural Network Models3 Jun 2021
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detection31 Mar 2021
- 2021Multi-Label Classification Neural Networks with Hard Logical Constraints24 Mar 2021
50 newest of 51 All 51 (JSON)
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Reviewcited by 37
- 2023GLoRE: Evaluating Logical Reasoning of Large Language Modelscited by 13
- 2024Do Large Language Models Understand Logic or Just Mimick Context?cited by 10
- 2022AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehensioncited by 8
- 2022Reduced Implication-bias Logic Loss for Neuro-Symbolic Learningcited by 2
- 2024Do Large Language Models Understand Logic or Just Mimick Context?19 Feb 2024
- 2023GLoRE: Evaluating Logical Reasoning of Large Language Models13 Oct 2023
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-47 Apr 2023
- 2022Reduced Implication-bias Logic Loss for Neuro-Symbolic Learning14 Aug 2022
- 2022AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension16 Mar 2022
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Review24 Feb 2022
- 2025DMWM: Dual-Mind World Model with Long-Term Imaginationcited by 10
- 2025DMWM: Dual-Mind World Model with Long-Term Imagination11 Feb 2025
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
- 2021GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detectioncited by 66
- 2021Incorporating Domain Knowledge into Deep Neural Networkscited by 56
- 2023Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Modelscited by 38
- 2021Multi-Label Classification Neural Networks with Hard Logical Constraintscited by 36
- 2022ROAD-R: The Autonomous Driving Dataset with Logical Requirementscited by 34
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2021DomiKnowS: A Library for Integration of Symbolic Domain Knowledge in Deep Learningcited by 12
- 2023Semantic Strengthening of Neuro-Symbolic Learningcited by 12
- 2024Learning with Logical Constraints but without Shortcut Satisfactioncited by 10
- 2021Learning Constraints and Descriptive Segmentation for Subevent Detectioncited by 9
- 2021Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratingscited by 9
12 most cited of 43 All 43 (JSON)
- 2026CONSISTRE: A Unified Consistency-Aware Framework for Document-Level Relation Extraction with Large Language Models27 Jul 2026
- 2026Structure-Preserving Document Translation via Multi-Stage LLM Pipeline: A Case Study in Marathi27 Jun 2026
- 2026On Improving Neurosymbolic Learning by Exploiting the Representation Space8 Feb 2026
- 2025The Need for Verification in AI-Driven Scientific Discovery1 Sep 2025
- 2025Towards Scalable Lottery Ticket Networks using Genetic Algorithms12 Aug 2025
- 2025Bridging Neural Networks and Dynamic Time Warping for Adaptive Time Series Classification13 Jul 2025
- 2025LogiCoL: Logically-Informed Contrastive Learning for Set-based Dense Retrieval26 May 2025
- 2024MedLogic-AQA: Enhancing Medical Question Answering with Abstractive Models Focusing on Logical Structures20 Oct 2024
- 2024EXPLAIN, AGREE, LEARN: Scaling Learning for Neural Probabilistic Logic15 Aug 2024
- 2024Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learners30 Apr 2024
- 2024Logic Rules as Explanations for Legal Case Retrieval3 Mar 2024
- 2024Learning with Logical Constraints but without Shortcut Satisfaction1 Mar 2024
12 newest of 43 All 43 (JSON)