Can Large Language Models generalize analogy solving like children can?
Not on the map. Why?
Abstract (arXiv)
In people, the ability to solve analogies such as "body : feet :: table : ?" emerges in childhood, and appears to transfer easily to other domains, such as the visual domain "( : ) :: < : ?". Recent research shows that large language models (LLMs) can solve various forms of analogies. However, can LLMs generalize analogy solving to new domains like people can? To investigate this, we had children, adults, and LLMs solve a series of letter-string analogies (e.g., a b : a c :: j k : ?) in the Latin alphabet, in a near transfer domain (Greek alphabet), and a far transfer domain (list of symbols). Children and adults easily generalized their knowledge to unfamiliar domains, whereas LLMs did not. This key difference between human and AI performance is evidence that these LLMs still struggle with robust human-like analogical transfer.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 18 of its 53 references that are in the map. First posted on arXiv 4 Nov 2024.
Builds on
18 of 53 references.
References · 18
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Taskscited by 246
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
- 2021Abstraction and Analogy-Making in Artificial Intelligencecited by 103
- 2023The ConceptARC Benchmark: Evaluating Understanding and Generalization in the ARC Domaincited by 101
- 2023Large Language Models Are Not Strong Abstract Reasonerscited by 53
- 2024Using Counterfactual Tasks to Evaluate the Generality of Analogical Reasoning in Large Language Modelscited by 38
6 more
- 2024KiVA: Kid-inspired Visual Analogies for Testing Large Multimodal Modelscited by 24
- 2024Evidence from counterfactual tasks supports emergent analogical reasoning in large language modelscited by 14
- 2023Response: Emergent analogical reasoning in large language modelscited by 13
- 2023Do large language models solve verbal analogies like children do?cited by 13
- 2019A Theory of Relation Learning and Cross-domain Generalizationcited by 11
- 2024Do Large Language Models Solve ARC Visual Analogies Like People Do?cited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 6; 2026: 2.
9 papers.
- 2024Evaluating the Robustness of Analogical Reasoning in Large Language Modelscited by 31
- 2025We Can't Understand AI Using our Existing Vocabularycited by 25
- 2025LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoningcited by 12
- 2025What is an "Abstract Reasoner"? Revisiting Experiments and Arguments about Large Language Modelscited by 2
- 2025Large Language Models Show Signs of Alignment with Human Neurocognition During Abstract Reasoningcited by 2
- 2025Pitfalls of Scale: Investigating the Inverse Task of Redefinition in Large Language Modelscited by 1
- 2025Breaking Thought Patterns: A Multi-Dimensional Reasoning Framework for LLMscited by 1
- 2026Enhancing Structural Mapping with LLM-derived Abstractions for Analogical Reasoning in Narrativescited by 1
- 2026Transformer See, Transformer Do: Copying as an Intermediate Step in Learning Analogical Reasoningcited by 0
- 2026Transformer See, Transformer Do: Copying as an Intermediate Step in Learning Analogical Reasoning7 Apr 2026
- 2026Enhancing Structural Mapping with LLM-derived Abstractions for Analogical Reasoning in Narratives31 Mar 2026
- 2025Large Language Models Show Signs of Alignment with Human Neurocognition During Abstract Reasoning12 Aug 2025
- 2025What is an "Abstract Reasoner"? Revisiting Experiments and Arguments about Large Language Models30 Jul 2025
- 2025Breaking Thought Patterns: A Multi-Dimensional Reasoning Framework for LLMs16 Jun 2025
- 2025Pitfalls of Scale: Investigating the Inverse Task of Redefinition in Large Language Models18 Feb 2025
- 2025LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoning16 Feb 2025
- 2025We Can't Understand AI Using our Existing Vocabulary11 Feb 2025
- 2024Evaluating the Robustness of Analogical Reasoning in Large Language Models21 Nov 2024