Psychologically-informed chain-of-thought prompts for metaphor understanding in large language models
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Probabilistic models of language understanding are valuable tools for investigating human language use. However, they need to be hand-designed for a particular domain. In contrast, large language models (LLMs) are trained on text that spans a wide array of domains, but they lack the structure and interpretability of probabilistic models. In this paper, we use chain-of-thought prompts to introduce structures from probabilistic models into LLMs. We explore this approach in the case of metaphor understanding. Our chain-of-thought prompts lead language models to infer latent variables and reason about their relationships in order to choose appropriate paraphrases for metaphors. The latent variables and relationships chosen are informed by theories of metaphor understanding from cognitive psychology. We apply these prompts to the two largest versions of GPT-3 and show that they can improve performance in a paraphrase selection task.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 11 of its 27 references that are in the map. First posted on arXiv 16 Sep 2022.
Builds on
11 of 27 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
- 2022Using cognitive psychology to understand GPT-3cited by 389
- 2021True Few-Shot Learning with Language Modelscited by 343
- 2022Can language models learn from explanations in context?cited by 248
- 2022Language models show human-like content effects on reasoning taskscited by 171
- 2022Few-shot training LLMs for project-specific code-summarizationcited by 128
- 2022Language Model Cascadescited by 104
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 3; 2025: 5; 2026: 1.
14 papers.
Sort:
By area:
- 2022Towards Reasoning in Large Language Models: A Surveycited by 593
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
- 2024Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worsecited by 107
- 2024Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challengescited by 48
- 2023AI-assisted coding: Experiments with GPT-4cited by 43
- 2023Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Modelscited by 24
- 2024Large Language Model Benchmarks in Medical Taskscited by 16
- 2023Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphorscited by 12
- 2025Non-literal Understanding of Number Words by Language Modelscited by 9
- 2025Are Large Language Models Sensitive to the Motives Behind Communication?cited by 7
- 2025Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identificationcited by 3
- 2025Conceptual Metaphor Theory as a Prompting Paradigm for Large Language Modelscited by 3
2 more
- 2025THiNK: Can Large Language Models Think-aloud?cited by 3
- 2026MetaphorVU: Towards Metaphorical Video Understandingcited by 0
- 2026MetaphorVU: Towards Metaphorical Video Understanding25 May 2026
- 2025Are Large Language Models Sensitive to the Motives Behind Communication?22 Oct 2025
- 2025THiNK: Can Large Language Models Think-aloud?26 May 2025
- 2025Non-literal Understanding of Number Words by Language Models10 Feb 2025
- 2025Conceptual Metaphor Theory as a Prompting Paradigm for Large Language Models4 Feb 2025
- 2025Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identification5 Jan 2025
- 2024Large Language Model Benchmarks in Medical Tasks28 Oct 2024
- 2024Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worse27 Oct 2024
- 2024Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challenges4 Sep 2024
- 2023Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Models2 Nov 2023
- 2023Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphors3 Aug 2023
- 2023AI-assisted coding: Experiments with GPT-425 Apr 2023
2 more
- 2022Towards Reasoning in Large Language Models: A Surveycited by 593
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
- 2024Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worsecited by 107
- 2025THiNK: Can Large Language Models Think-aloud?cited by 3
- 2025THiNK: Can Large Language Models Think-aloud?26 May 2025
- 2024Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worse27 Oct 2024
- 2022Towards Reasoning in Large Language Models: A Survey20 Dec 2022
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning15 Dec 2022
- 2024Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challengescited by 48
- 2023AI-assisted coding: Experiments with GPT-4cited by 43
- 2023Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Modelscited by 24
- 2024Large Language Model Benchmarks in Medical Taskscited by 16
- 2023Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphorscited by 12
- 2025Non-literal Understanding of Number Words by Language Modelscited by 9
- 2025Are Large Language Models Sensitive to the Motives Behind Communication?cited by 7
- 2025Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identificationcited by 3
- 2025Conceptual Metaphor Theory as a Prompting Paradigm for Large Language Modelscited by 3
- 2026MetaphorVU: Towards Metaphorical Video Understandingcited by 0
- 2026MetaphorVU: Towards Metaphorical Video Understanding25 May 2026
- 2025Are Large Language Models Sensitive to the Motives Behind Communication?22 Oct 2025
- 2025Non-literal Understanding of Number Words by Language Models10 Feb 2025
- 2025Conceptual Metaphor Theory as a Prompting Paradigm for Large Language Models4 Feb 2025
- 2025Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identification5 Jan 2025
- 2024Large Language Model Benchmarks in Medical Tasks28 Oct 2024
- 2024Large Language Models and Cognitive Science: A Comprehensive Review of Similarities, Differences, and Challenges4 Sep 2024
- 2023Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Models2 Nov 2023
- 2023Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphors3 Aug 2023
- 2023AI-assisted coding: Experiments with GPT-425 Apr 2023
Similar, not cited
Close in wording, no citation either way
- 2024Science is Exploration: Computational Frontiers for Conceptual Metaphor Theory
- 2025Metaphor identification using large language models: A comparison of RAG, prompt engineering, and fine-tuning
- 2024A Dual-Perspective Metaphor Detection Framework Using Large Language Models
- 2024Chain-of-Thought in Large Language Models: Decoding, Projection, and Activation
- 2025Probing Semantic Alignment, Lexical Invariance, and Syntactic Influence in LLM Metaphor Processing
- 2022MiQA: A Benchmark for Inference on Metaphorical Questions
- 2024Larger Language Models Don't Care How You Think: Why Chain-of-Thought Prompting Fails in Subjective Tasks
- 2026Metaphors are a Source of Cross-Domain Misalignment of Large Reasoning Models