mlsanityData to 14 Oct 2026

Bridging the Gap: Representation Spaces in Neuro-Symbolic AI

arXiv 2411.04393 ↗First posted 7 Nov 2024cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Neuro-symbolic AI is an effective method for improving the overall performance of AI models by combining the advantages of neural networks and symbolic learning. However, there are differences between the two in terms of how they process data, primarily because they often use different data representation methods, which is often an important factor limiting the overall performance of the two. From this perspective, we analyzed 191 studies from 2013 by constructing a four-level classification framework. The first level defines five types of representation spaces, and the second level focuses on five types of information modalities that the representation space can represent. Then, the third level describes four symbolic logic methods. Finally, the fourth-level categories propose three collaboration strategies between neural networks and symbolic learning. Furthermore, we conducted a detailed analysis of 46 research based on their representation space.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 89 of its 203 references that are in the map. First posted on arXiv 7 Nov 2024.

Builds on

89 of 203 references.

References · 89

  1. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 391
  2. 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
  3. 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 309
  4. 2019Deep Learning for Symbolic Mathematicscited by 270
  5. 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
  6. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 156
  7. 2019Neural Logic Machinescited by 145
  8. 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 140
  9. 2016Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignmentcited by 128
  10. 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 103
  11. 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 101
  12. 2020Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspectivecited by 95
38 more
  1. 2022Learning Neuro-Symbolic Skills for Bilevel Planningcited by 58
  2. 2022Deep Symbolic Regression for Recurrent Sequencescited by 54
  3. 2020Leveraging Abstract Meaning Representation for Knowledge Base Question Answeringcited by 53
  4. 2018PEORL: Integrating Symbolic Planning and Hierarchical Reinforcement Learning for Robust Decision-Makingcited by 52
  5. 2021PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D Worldcited by 47
  6. 2016Towards Deep Symbolic Reinforcement Learningcited by 42
  7. 2022Plansformer: Generating Symbolic Plans using Transformerscited by 41
  8. 2021Neural-Symbolic Solver for Math Word Problems with Auxiliary Taskscited by 38
  9. 2019Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answeringcited by 37
  10. 2020Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledgecited by 37
  11. 2017Making Neural Programming Architectures Generalize via Recursioncited by 35
  12. 2019Correlating neural and symbolic representations of languagecited by 33
  13. 2023Neuro-Symbolic Continual Learning: Knowledge, Reasoning Shortcuts and Concept Rehearsalcited by 33
  14. 2020Scalable Neural Methods for Reasoning With a Symbolic Knowledge Basecited by 32
  15. 2021Neuro-Symbolic Reinforcement Learning with First-Order Logiccited by 30
  16. 2022JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agentscited by 30
  17. 2023The Neuro-Symbolic Inverse Planning Engine (NIPE): Modeling Probabilistic Social Inferences from Linguistic Inputscited by 23
  18. 2022Neuro-Symbolic Verification of Deep Neural Networkscited by 21
  19. 2022Deep Symbolic Learning: Discovering Symbols and Rules from Perceptionscited by 21
  20. 2023GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEscited by 18
  21. 2021Neuro-Symbolic Forward Reasoningcited by 16
  22. 2023Reasoning in Large Language Models Through Symbolic Math Word Problemscited by 16
  23. 2024Softened Symbol Grounding for Neuro-symbolic Systemscited by 16
  24. 2024Towards Rationality in Language and Multimodal Agents: A Surveycited by 16
  25. 2023Natural Language Embedded Programs for Hybrid Language Symbolic Reasoningcited by 15
  26. 2020Learning Task-General Representations with Generative Neuro-Symbolic Modelingcited by 14
  27. 2022Empowering Language Models with Knowledge Graph Reasoning for Question Answeringcited by 14
  28. 2023Neuro-Symbolic World Models for Adapting to Open World Noveltycited by 14
  29. 2024Vehicle: Bridging the Embedding Gap in the Verification of Neuro-Symbolic Programscited by 14
  30. 2017Semantic Code Repair using Neuro-Symbolic Transformation Networkscited by 13
  31. 2018Towards Symbolic Reinforcement Learning with Common Sensecited by 12
  32. 2022Neuro-Symbolic Learning of Answer Set Programs from Raw Datacited by 12
  33. 2021Neuro-Symbolic Constraint Programming for Structured Predictioncited by 11
  34. 2021LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linkingcited by 11
  35. 2021Weakly Supervised Neuro-Symbolic Module Networks for Numerical Reasoningcited by 10
  36. 2020Generating new concepts with hybrid neuro-symbolic modelscited by 9
  37. 2021pix2rule: End-to-end Neuro-symbolic Rule Learningcited by 9
  38. 2018Symbolic Execution for Deep Neural Networkscited by 8

50 most cited of 89 All 89 (JSON)

Built on by

Not cited yet.