Embedding Symbolic Knowledge into Deep Networks
Not on the map. Why?
Abstract (arXiv)
In this work, we aim to leverage prior symbolic knowledge to improve the performance of deep models. We propose a graph embedding network that projects propositional formulae (and assignments) onto a manifold via an augmented Graph Convolutional Network (GCN). To generate semantically-faithful embeddings, we develop techniques to recognize node heterogeneity, and semantic regularization that incorporate structural constraints into the embedding. Experiments show that our approach improves the performance of models trained to perform entailment checking and visual relation prediction. Interestingly, we observe a connection between the tractability of the propositional theory representation and the ease of embedding. Future exploration of this connection may elucidate the relationship between knowledge compilation and vector representation learning.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 11; 2023: 8; 2024: 11; 2025: 5; 2026: 1.
49 papers.
Sort:
By area:
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
- 2021Incorporating Domain Knowledge into Deep Neural Networkscited by 56
- 2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
- 2022Deep Learning with Logical Constraintscited by 44
- 2021A Survey on Neural-symbolic Learning Systemscited by 39
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2023Neural-Logic Human-Object Interaction Detectioncited by 25
- 2021Relation-aware Compositional Zero-shot Learning for Attribute-Object Pair Recognitioncited by 19
- 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcutscited by 19
- 2023LOGICSEG: Parsing Visual Semantics with Neural Logic Learning and Reasoningcited by 17
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
37 more
- 2021Embedding Symbolic Temporal Knowledge into Deep Sequential Modelscited by 11
- 2022CARE: Certifiably Robust Learning with Reasoning via Variational Inferencecited by 10
- 2022Knowledge-augmented Deep Learning and Its Applications: A Surveycited by 10
- 2024Weakly Supervised Anomaly Detection via Knowledge-Data Alignmentcited by 10
- 2024Learning with Logical Constraints but without Shortcut Satisfactioncited by 10
- 2022Tractable Boolean and Arithmetic Circuitscited by 9
- 2023Sample-Efficient Learning of Novel Visual Conceptscited by 8
- 2024Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learnerscited by 8
- 2024LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulationcited by 8
- 2026ST4VLA: Spatially Guided Training for Vision-Language-Action Modelscited by 8
- 2021AI Descartes: Combining Data and Theory for Derivable Scientific Discoverycited by 7
- 2021A Critical Review of Inductive Logic Programming Techniques for Explainable AIcited by 7
- 2022Neuro-Symbolic Learning: Principles and Applications in Ophthalmologycited by 7
- 2025Symbolic Knowledge Extraction and Injection with Sub-symbolic Predictors: A Systematic Literature Reviewcited by 7
- 2021Inclusion of Domain-Knowledge into GNNs using Mode-Directed Inverse Entailmentcited by 6
- 2022Logical Reasoning for Task Oriented Dialogue Systemscited by 5
- 2025The Need for Verification in AI-Driven Scientific Discoverycited by 5
- 2021Neuro-Symbolic VQA: A review from the perspective of AGI desideratacited by 4
- 2024Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learningcited by 4
- 2021SYNERGY: Building Task Bots at Scale Using Symbolic Knowledge and Machine Teachingcited by 3
- 2024stl2vec: Semantic and Interpretable Vector Representation of Temporal Logiccited by 3
- 2023Learning from Noisy Crowd Labels with Logicscited by 2
- 2023Parallel Neurosymbolic Integration with Concordiacited by 2
- 2023Towards Unbiased Exploration in Partial Label Learningcited by 2
- 2022Differentiable Fuzzy ALC: A Neural-Symbolic Representation Language for Symbol Groundingcited by 1
- 2022Neural Controller Synthesis for Signal Temporal Logic Specifications Using Encoder-Decoder Structured Networkscited by 1
- 2023A Novel Neural-symbolic System under Statistical Relational Learningcited by 1
- 2023Spatial Knowledge-Infused Hierarchical Learning: An Application in Flood Mapping on Earth Imagerycited by 1
- 2024Bridging the Intent Gap: Knowledge-Enhanced Visual Generationcited by 1
- 2025Bridging Logic and Learning: Decoding Temporal Logic Embeddings via Transformerscited by 1
- 2021A Review of Some Techniques for Inclusion of Domain-Knowledge into Deep Neural Networkscited by 0
- 2021Incorporation of Deep Neural Network & Reinforcement Learning with Domain Knowledgecited by 0
- 2021Integrating Regular Expressions with Neural Networks via DFAcited by 0
- 2022Scalable Regularization of Scene Graph Generation Models using Symbolic Theoriescited by 0
- 2022A Roadmap to Domain Knowledge Integration in Machine Learningcited by 0
- 2024Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canadacited by 0
- 2025Physics-Inspired Spatial Temporal Graph Neural Networks for Predicting Industrial Chain Resiliencecited by 0
- 2026ST4VLA: Spatially Guided Training for Vision-Language-Action Models10 Feb 2026
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy15 Oct 2025
- 2025The Need for Verification in AI-Driven Scientific Discovery1 Sep 2025
- 2025Physics-Inspired Spatial Temporal Graph Neural Networks for Predicting Industrial Chain Resilience22 Aug 2025
- 2025Bridging Logic and Learning: Decoding Temporal Logic Embeddings via Transformers10 Jul 2025
- 2025Symbolic Knowledge Extraction and Injection with Sub-symbolic Predictors: A Systematic Literature Review23 Jan 2025
- 2024LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulation1 Nov 2024
- 2024Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada15 Jul 2024
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy23 Jun 2024
- 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts14 Jun 2024
- 2024stl2vec: Semantic and Interpretable Vector Representation of Temporal Logic23 May 2024
- 2024Bridging the Intent Gap: Knowledge-Enhanced Visual Generation21 May 2024
37 more
- 2024Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learning3 May 2024
- 2024Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learners30 Apr 2024
- 2024Learning with Logical Constraints but without Shortcut Satisfaction1 Mar 2024
- 2024Weakly Supervised Anomaly Detection via Knowledge-Data Alignment6 Feb 2024
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Models22 Jan 2024
- 2023Spatial Knowledge-Infused Hierarchical Learning: An Application in Flood Mapping on Earth Imagery12 Dec 2023
- 2023Neural-Logic Human-Object Interaction Detection16 Nov 2023
- 2023LOGICSEG: Parsing Visual Semantics with Neural Logic Learning and Reasoning24 Sep 2023
- 2023A Novel Neural-symbolic System under Statistical Relational Learning16 Sep 2023
- 2023Towards Unbiased Exploration in Partial Label Learning2 Jul 2023
- 2023Sample-Efficient Learning of Novel Visual Concepts15 Jun 2023
- 2023Parallel Neurosymbolic Integration with Concordia1 Jun 2023
- 2023Learning from Noisy Crowd Labels with Logics13 Feb 2023
- 2022A Roadmap to Domain Knowledge Integration in Machine Learning12 Dec 2022
- 2022Neural Controller Synthesis for Signal Temporal Logic Specifications Using Encoder-Decoder Structured Networks10 Dec 2022
- 2022Knowledge-augmented Deep Learning and Its Applications: A Survey30 Nov 2022
- 2022Differentiable Fuzzy ALC: A Neural-Symbolic Representation Language for Symbol Grounding22 Nov 2022
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computing28 Oct 2022
- 2022CARE: Certifiably Robust Learning with Reasoning via Variational Inference12 Sep 2022
- 2022Scalable Regularization of Scene Graph Generation Models using Symbolic Theories6 Sep 2022
- 2022Neuro-Symbolic Learning: Principles and Applications in Ophthalmology31 Jul 2022
- 2022Deep Learning with Logical Constraints1 May 2022
- 2022Logical Reasoning for Task Oriented Dialogue Systems8 Feb 2022
- 2022Tractable Boolean and Arithmetic Circuits7 Feb 2022
- 2021A Critical Review of Inductive Logic Programming Techniques for Explainable AI31 Dec 2021
- 2021A Survey on Neural-symbolic Learning Systems10 Nov 2021
- 2021SYNERGY: Building Task Bots at Scale Using Symbolic Knowledge and Machine Teaching21 Oct 2021
- 2021Integrating Regular Expressions with Neural Networks via DFA7 Sep 2021
- 2021AI Descartes: Combining Data and Theory for Derivable Scientific Discovery3 Sep 2021
- 2021Relation-aware Compositional Zero-shot Learning for Attribute-Object Pair Recognition10 Aug 2021
- 2021Incorporation of Deep Neural Network & Reinforcement Learning with Domain Knowledge29 Jul 2021
- 2021A Review of Some Techniques for Inclusion of Domain-Knowledge into Deep Neural Networks21 Jul 2021
- 2021Inclusion of Domain-Knowledge into GNNs using Mode-Directed Inverse Entailment22 May 2021
- 2021Neuro-Symbolic Artificial Intelligence: Current Trends11 May 2021
- 2021Neuro-Symbolic VQA: A review from the perspective of AGI desiderata13 Apr 2021
- 2021Incorporating Domain Knowledge into Deep Neural Networks27 Feb 2021
- 2021Embedding Symbolic Temporal Knowledge into Deep Sequential Models28 Jan 2021
- 2024LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulationcited by 8
- 2022Logical Reasoning for Task Oriented Dialogue Systemscited by 5
- 2022Differentiable Fuzzy ALC: A Neural-Symbolic Representation Language for Symbol Groundingcited by 1
- 2023A Novel Neural-symbolic System under Statistical Relational Learningcited by 1
- 2024LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulation1 Nov 2024
- 2023A Novel Neural-symbolic System under Statistical Relational Learning16 Sep 2023
- 2022Differentiable Fuzzy ALC: A Neural-Symbolic Representation Language for Symbol Grounding22 Nov 2022
- 2022Logical Reasoning for Task Oriented Dialogue Systems8 Feb 2022
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
- 2021Incorporating Domain Knowledge into Deep Neural Networkscited by 56
- 2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
- 2022Deep Learning with Logical Constraintscited by 44
- 2021A Survey on Neural-symbolic Learning Systemscited by 39
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2023Neural-Logic Human-Object Interaction Detectioncited by 25
- 2021Relation-aware Compositional Zero-shot Learning for Attribute-Object Pair Recognitioncited by 19
- 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcutscited by 19
- 2023LOGICSEG: Parsing Visual Semantics with Neural Logic Learning and Reasoningcited by 17
- 2022CARE: Certifiably Robust Learning with Reasoning via Variational Inferencecited by 10
- 2022Knowledge-augmented Deep Learning and Its Applications: A Surveycited by 10
12 most cited of 41 All 41 (JSON)
- 2025The Need for Verification in AI-Driven Scientific Discovery1 Sep 2025
- 2025Physics-Inspired Spatial Temporal Graph Neural Networks for Predicting Industrial Chain Resilience22 Aug 2025
- 2025Bridging Logic and Learning: Decoding Temporal Logic Embeddings via Transformers10 Jul 2025
- 2025Symbolic Knowledge Extraction and Injection with Sub-symbolic Predictors: A Systematic Literature Review23 Jan 2025
- 2024Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada15 Jul 2024
- 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts14 Jun 2024
- 2024stl2vec: Semantic and Interpretable Vector Representation of Temporal Logic23 May 2024
- 2024Bridging the Intent Gap: Knowledge-Enhanced Visual Generation21 May 2024
- 2024Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learning3 May 2024
- 2024Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learners30 Apr 2024
- 2024Learning with Logical Constraints but without Shortcut Satisfaction1 Mar 2024
- 2024Weakly Supervised Anomaly Detection via Knowledge-Data Alignment6 Feb 2024
12 newest of 41 All 41 (JSON)