The Neuro-Symbolic Inverse Planning Engine (NIPE): Modeling Probabilistic Social Inferences from Linguistic Inputs
Not on the map. Why?
Abstract (arXiv)
Human beings are social creatures. We routinely reason about other agents, and a crucial component of this social reasoning is inferring people's goals as we learn about their actions. In many settings, we can perform intuitive but reliable goal inference from language descriptions of agents, actions, and the background environments. In this paper, we study this process of language driving and influencing social reasoning in a probabilistic goal inference domain. We propose a neuro-symbolic model that carries out goal inference from linguistic inputs of agent scenarios. The "neuro" part is a large language model (LLM) that translates language descriptions to code representations, and the "symbolic" part is a Bayesian inverse planning engine. To test our model, we design and run a human experiment on a linguistic goal inference task. Our model closely matches human response patterns and better predicts human judgements than using an LLM alone.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 23 of its 52 references that are in the map. First posted on arXiv 25 Jun 2023.
Builds on
23 of 52 references.
References · 23
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
- 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 349
- 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
- 2023Faithful Chain-of-Thought Reasoningcited by 288
- 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
- 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Modelscited by 163
- 2022Synchromesh: Reliable code generation from pre-trained language modelscited by 156
- 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
11 more
- 2020Learning to Complement Humanscited by 124
- 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 119
- 2023Sequential Monte Carlo Steering of Large Language Models using Probabilistic Programscited by 80
- 2020Online Bayesian Goal Inference for Boundedly-Rational Planning Agentscited by 68
- 2022Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning taskscited by 56
- 2019On the Feasibility of Learning, Rather than Assuming, Human Biases for Reward Inferencecited by 49
- 2015Learning the Preferences of Ignorant, Inconsistent Agentscited by 45
- 2021AGENT: A Benchmark for Core Psychological Reasoningcited by 42
- 2023Dialectical language model evaluation: An initial appraisal of the commonsense spatial reasoning abilities of LLMscited by 20
- 2021Modeling the Mistakes of Boundedly Rational Agents Within a Bayesian Theory of Mindcited by 19
- 2023LaMPP: Language Models as Probabilistic Priors for Perception and Actioncited by 11
Built on by
Citing papers per year: 2024: 8; 2025: 11; 2026: 4.
23 papers.
Sort:
By area:
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
- 2025Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlocited by 46
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
- 2025Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Modelscited by 29
- 2024Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planningcited by 28
- 2024GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignmentcited by 16
- 2025Social World Modelscited by 16
- 2025Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Modelscited by 14
- 2024Neuro-Symbolic AI: Explainability, Challenges, and Future Trendscited by 10
- 2024Grounding Language about Belief in a Bayesian Theory-of-Mindcited by 8
- 2025Resource Rational Contractualism Should Guide AI Alignmentcited by 8
11 more
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agentscited by 8
- 2024Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mindcited by 6
- 2025EnigmaToM: Improve LLMs' Theory-of-Mind Reasoning Capabilities with Neural Knowledge Base of Entity Statescited by 6
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Plannercited by 5
- 2026Post-training makes large language models less human-likecited by 5
- 2026Think Thrice Before You Speak: Dual knowledge-enhanced Theory-of-Mind Reasoning for Persuasive Agentscited by 2
- 2026Grounding Social Perception in Intuitive Physicscited by 1
- 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AIcited by 0
- 2025Belief Attribution as Mental Explanation: The Role of Accuracy, Informativity, and Causalitycited by 0
- 2025What's in the Box? Reasoning about Unseen Objects from Multimodal Cuescited by 0
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotationscited by 0
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotations29 May 2026
- 2026Think Thrice Before You Speak: Dual knowledge-enhanced Theory-of-Mind Reasoning for Persuasive Agents21 May 2026
- 2026Post-training makes large language models less human-like8 May 2026
- 2026Grounding Social Perception in Intuitive Physics28 Mar 2026
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agents26 Sep 2025
- 2025Social World Models30 Aug 2025
- 2025Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Models16 Jul 2025
- 2025Resource Rational Contractualism Should Guide AI Alignment20 Jun 2025
- 2025What's in the Box? Reasoning about Unseen Objects from Multimodal Cues17 Jun 2025
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Planner2 Jun 2025
- 2025Belief Attribution as Mental Explanation: The Role of Accuracy, Informativity, and Causality26 May 2025
- 2025Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo17 Apr 2025
11 more
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models22 Mar 2025
- 2025EnigmaToM: Improve LLMs' Theory-of-Mind Reasoning Capabilities with Neural Knowledge Base of Entity States5 Mar 2025
- 2025Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models17 Feb 2025
- 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AI7 Nov 2024
- 2024Neuro-Symbolic AI: Explainability, Challenges, and Future Trends7 Nov 2024
- 2024Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mind21 Aug 2024
- 2024Building Machines that Learn and Think with People22 Jul 2024
- 2024GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment17 Mar 2024
- 2024Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planning27 Feb 2024
- 2024Grounding Language about Belief in a Bayesian Theory-of-Mind16 Feb 2024
- 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Models8 Feb 2024
- 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
- 2025Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Modelscited by 29
- 2025EnigmaToM: Improve LLMs' Theory-of-Mind Reasoning Capabilities with Neural Knowledge Base of Entity Statescited by 6
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Plannercited by 5
- 2026Think Thrice Before You Speak: Dual knowledge-enhanced Theory-of-Mind Reasoning for Persuasive Agentscited by 2
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotationscited by 0
- 2026MindZero: Learning Online Mental Reasoning With Zero Annotations29 May 2026
- 2026Think Thrice Before You Speak: Dual knowledge-enhanced Theory-of-Mind Reasoning for Persuasive Agents21 May 2026
- 2025Overcoming Multi-step Complexity in Multimodal Theory-of-Mind Reasoning: A Scalable Bayesian Planner2 Jun 2025
- 2025EnigmaToM: Improve LLMs' Theory-of-Mind Reasoning Capabilities with Neural Knowledge Base of Entity States5 Mar 2025
- 2025Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models17 Feb 2025
- 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Models8 Feb 2024
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agents26 Sep 2025
- 2025Social World Modelscited by 16
- 2025Social World Models30 Aug 2025
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2025Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlocited by 46
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
- 2024Pragmatic Instruction Following and Goal Assistance via Cooperative Language-Guided Inverse Planningcited by 28
- 2024GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignmentcited by 16
- 2025Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Modelscited by 14
- 2024Neuro-Symbolic AI: Explainability, Challenges, and Future Trendscited by 10
- 2024Grounding Language about Belief in a Bayesian Theory-of-Mindcited by 8
- 2025Resource Rational Contractualism Should Guide AI Alignmentcited by 8
- 2024Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mindcited by 6
- 2026Post-training makes large language models less human-likecited by 5
- 2026Grounding Social Perception in Intuitive Physicscited by 1
12 most cited of 15 All 15 (JSON)
- 2026Post-training makes large language models less human-like8 May 2026
- 2026Grounding Social Perception in Intuitive Physics28 Mar 2026
- 2025Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Models16 Jul 2025
- 2025Resource Rational Contractualism Should Guide AI Alignment20 Jun 2025
- 2025What's in the Box? Reasoning about Unseen Objects from Multimodal Cues17 Jun 2025
- 2025Belief Attribution as Mental Explanation: The Role of Accuracy, Informativity, and Causality26 May 2025
- 2025Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo17 Apr 2025
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models22 Mar 2025
- 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AI7 Nov 2024
- 2024Neuro-Symbolic AI: Explainability, Challenges, and Future Trends7 Nov 2024
- 2024Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mind21 Aug 2024
- 2024Building Machines that Learn and Think with People22 Jul 2024
12 newest of 15 All 15 (JSON)