Cognitive Modeling with Scaffolded LLMs: A Case Study of Referential Expression Generation
Not on the map. Why?
Abstract (arXiv)
To what extent can LLMs be used as part of a cognitive model of language generation? In this paper, we approach this question by exploring a neuro-symbolic implementation of an algorithmic cognitive model of referential expression generation by Dale & Reiter (1995). The symbolic task analysis implements the generation as an iterative procedure that scaffolds symbolic and gpt-3.5-turbo-based modules. We compare this implementation to an ablated model and a one-shot LLM-only baseline on the A3DS dataset (Tsvilodub & Franke, 2023). We find that our hybrid approach is cognitively plausible and performs well in complex contexts, while allowing for more open-ended modeling of language generation in a larger domain.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 48 references that are in the map. First posted on arXiv 4 Jul 2024.
Builds on
29 of 48 references.
References · 29
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
17 more
- 2023Cognitive Architectures for Language Agentscited by 422
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
- 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 213
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
- 2016Generating Visual Explanationscited by 156
- 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
- 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 118
- 2016Reasoning About Pragmatics with Neural Listeners and Speakerscited by 68
- 2017Context-aware Captions from Context-agnostic Supervisioncited by 43
- 2018Pragmatically Informative Image Captioning with Character-Level Inferencecited by 42
- 2015Learning in the Rational Speech Acts Modelcited by 16
- 2020Pragmatic Issue-Sensitive Image Captioningcited by 15
- 2019Know What You Don't Know: Modeling a Pragmatic Speaker that Refers to Objects of Unknown Categoriescited by 8
- 2024Bayesian Statistical Modeling with Predictors from LLMscited by 6
- 2023Evaluating Pragmatic Abilities of Image Captioners on A3DScited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.