Why Do We Need Neuro-symbolic AI to Model Pragmatic Analogies?
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
A hallmark of intelligence is the ability to use a familiar domain to make inferences about a less familiar domain, known as analogical reasoning. In this article, we delve into the performance of Large Language Models (LLMs) in dealing with progressively complex analogies expressed in unstructured text. We discuss analogies at four distinct levels of complexity: lexical analogies, syntactic analogies, semantic analogies, and pragmatic analogies. As the analogies become more complex, they require increasingly extensive, diverse knowledge beyond the textual content, unlikely to be found in the lexical co-occurrence statistics that power LLMs. To address this, we discuss the necessity of employing Neuro-symbolic AI techniques that combine statistical and symbolic AI, informing the representation of unstructured text to highlight and augment relevant content, provide abstraction and guide the mapping process. Our knowledge-informed approach maintains the efficiency of LLMs while preserving the ability to explain analogies for pedagogical applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 8 of its 28 references that are in the map. First posted on arXiv 2 Aug 2023.
Builds on
8 of 28 references.
Closest ancestors · 1
Same direction, newest first
Other references · 7
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2021Implicit Representations of Meaning in Neural Language Modelscited by 179
- 2020Probing Pretrained Language Models for Lexical Semanticscited by 156
- 2021BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?cited by 56
- 2022Word Order Does Matter (And Shuffled Language Models Know It)cited by 32
- 2023ANALOGICAL -- A Novel Benchmark for Long Text Analogy Evaluation in Large Language Modelscited by 12
- 2020Neural Analogical Matchingcited by 7
Built on by
Citing papers per year: 2024: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024LLMs as Models for Analogical Reasoning
- 2025Modeling Understanding of Story-Based Analogies Using Large Language Models
- 2024AnaloBench: Benchmarking the Identification of Abstract and Long-context Analogies
- 2022Scientific and Creative Analogies in Pretrained Language Models
- 2023In-Context Analogical Reasoning with Pre-Trained Language Models
- 2023ANALOGYKB: Unlocking Analogical Reasoning of Language Models with A Million-scale Knowledge Base
- 2023ARN: Analogical Reasoning on Narratives
- 2025The Curious Case of Analogies: Investigating Analogical Reasoning in Large Language Models