Neuro-Symbolic Procedural Planning with Commonsense Prompting
Not on the map. Why?
Abstract (arXiv)
Procedural planning aims to implement complex high-level goals by decomposition into sequential simpler low-level steps. Although procedural planning is a basic skill set for humans in daily life, it remains a challenge for large language models (LLMs) that lack a deep understanding of the cause-effect relations in procedures. Previous methods require manual exemplars to acquire procedural planning knowledge from LLMs in the zero-shot setting. However, such elicited pre-trained knowledge in LLMs induces spurious correlations between goals and steps, which impair the model generalization to unseen tasks. In contrast, this paper proposes a neuro-symbolic procedural PLANner (PLAN) that elicits procedural planning knowledge from the LLMs with commonsense-infused prompting. To mitigate spurious goal-step correlations, we use symbolic program executors on the latent procedural representations to formalize prompts from commonsense knowledge bases as a causal intervention toward the Structural Causal Model. Both automatic and human evaluations on WikiHow and RobotHow show the superiority of PLAN on procedural planning without further training or manual exemplars.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 44 of its 92 references that are in the map. First posted on arXiv 6 Jun 2022.
Builds on
44 of 92 references.
References · 44
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2018VirtualHome: Simulating Household Activities via Programscited by 415
32 more
- 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
- 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
- 2019Causality for Machine Learningcited by 243
- 2018WikiHow: A Large Scale Text Summarization Datasetcited by 204
- 2021How Many Data Points is a Prompt Worth?cited by 198
- 2021TEACh: Task-driven Embodied Agents that Chatcited by 197
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 171
- 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 138
- 2021FILM: Following Instructions in Language with Modular Methodscited by 121
- 2020CausaLM: Causal Model Explanation Through Counterfactual Language Modelscited by 117
- 2020Interventional Few-Shot Learningcited by 112
- 2019Procedure Planning in Instructional Videoscited by 92
- 2021A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Executioncited by 91
- 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
- 2021On Transferability of Prompt Tuning for Natural Language Processingcited by 75
- 2020Reasoning about Goals, Steps, and Temporal Ordering with WikiHowcited by 66
- 2020Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimatescited by 59
- 2022A Causal Lens for Controllable Text Generationcited by 45
- 2020Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructionscited by 36
- 2018Challenges of Using Text Classifiers for Causal Inferencecited by 33
- 2021GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systemscited by 31
- 2022Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal Viewcited by 31
- 2021Goal-Oriented Script Constructioncited by 30
- 2022Ontology-enhanced Prompt-tuning for Few-shot Learningcited by 24
- 2021ProTo: Program-Guided Transformer for Program-Guided Taskscited by 21
- 2020Intent Detection with WikiHowcited by 19
- 2021Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manualscited by 18
- 2020Causal Inference of Script Knowledgecited by 17
- 2018Goal-Oriented Chatbot Dialog Management Bootstrapping with Transfer Learningcited by 11
- 2021Self-Supervised Knowledge Assimilation for Expert-Layman Text Style Transfercited by 5
- 2022An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generationcited by 5
Built on by
Citing papers per year: 2022: 3; 2023: 6; 2024: 13; 2025: 5; 2026: 1.
28 papers.
Sort:
By area:
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoningcited by 175
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?cited by 81
- 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
- 2024A Survey on Robotics with Foundation Models: toward Embodied AIcited by 56
- 2023Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoningcited by 49
- 2024Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustmentcited by 30
- 2023Plan, Posture and Go: Towards Open-World Text-to-Motion Generationcited by 26
- 2024Large Language Models and Causal Inference in Collaboration: A Surveycited by 26
- 2023ThinkBot: Embodied Instruction Following with Thought Chain Reasoningcited by 19
- 2024Correctable Landmark Discovery via Large Models for Vision-Language Navigationcited by 17
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
16 more
- 2024Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videoscited by 15
- 2024P-RAG: Progressive Retrieval Augmented Generation For Planning on Embodied Everyday Taskcited by 15
- 2022Automaton-Based Representations of Task Knowledge from Generative Language Modelscited by 12
- 2024Propose, Assess, Search: Harnessing LLMs for Goal-Oriented Planning in Instructional Videoscited by 12
- 2024FLAP: Flow-Adhering Planning with Constrained Decoding in LLMscited by 11
- 2025Towards Reliable Code-as-Policies: A Neuro-Symbolic Framework for Embodied Task Planningcited by 11
- 2025Hierarchical Planning for Complex Tasks with Knowledge Graph-RAG and Symbolic Verificationcited by 9
- 2023Multimodal Pretrained Models for Verifiable Sequential Decision-Making: Planning, Grounding, and Perceptioncited by 8
- 2024Plan-Grounded Large Language Models for Dual Goal Conversational Settingscited by 8
- 2024Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Followingcited by 7
- 2025What Changed and What Could Have Changed? State-Change Counterfactuals for Procedure-Aware Video Representation Learningcited by 6
- 2023PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planningcited by 4
- 2024What Really is Commonsense Knowledge?cited by 2
- 2025Achieving Scalable Robot Autonomy via neurosymbolic planning using lightweight local LLMcited by 2
- 2025ScEdit: Script-based Assessment of Knowledge Editingcited by 1
- 2026GaLa: Hypergraph-Guided Visual Language Models for Procedural Planningcited by 0
- 2026GaLa: Hypergraph-Guided Visual Language Models for Procedural Planning19 Apr 2026
- 2025Towards Reliable Code-as-Policies: A Neuro-Symbolic Framework for Embodied Task Planning24 Oct 2025
- 2025ScEdit: Script-based Assessment of Knowledge Editing29 May 2025
- 2025Achieving Scalable Robot Autonomy via neurosymbolic planning using lightweight local LLM13 May 2025
- 2025Hierarchical Planning for Complex Tasks with Knowledge Graph-RAG and Symbolic Verification6 Apr 2025
- 2025What Changed and What Could Have Changed? State-Change Counterfactuals for Procedure-Aware Video Representation Learning27 Mar 2025
- 2024What Really is Commonsense Knowledge?6 Nov 2024
- 2024Propose, Assess, Search: Harnessing LLMs for Goal-Oriented Planning in Instructional Videos30 Sep 2024
- 2024P-RAG: Progressive Retrieval Augmented Generation For Planning on Embodied Everyday Task17 Sep 2024
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy23 Jun 2024
- 2024Correctable Landmark Discovery via Large Models for Vision-Language Navigation29 May 2024
- 2024Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Following21 Apr 2024
16 more
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning18 Mar 2024
- 2024Large Language Models and Causal Inference in Collaboration: A Survey14 Mar 2024
- 2024FLAP: Flow-Adhering Planning with Constrained Decoding in LLMs9 Mar 2024
- 2024Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos5 Mar 2024
- 2024Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment5 Mar 2024
- 2024A Survey on Robotics with Foundation Models: toward Embodied AI4 Feb 2024
- 2024Plan-Grounded Large Language Models for Dual Goal Conversational Settings1 Feb 2024
- 2023Plan, Posture and Go: Towards Open-World Text-to-Motion Generation22 Dec 2023
- 2023ThinkBot: Embodied Instruction Following with Thought Chain Reasoning12 Dec 2023
- 2023Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoning5 Oct 2023
- 2023Multimodal Pretrained Models for Verifiable Sequential Decision-Making: Planning, Grounding, and Perception10 Aug 2023
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?31 Jul 2023
- 2023PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning31 May 2023
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models8 Dec 2022
- 2022Automaton-Based Representations of Task Knowledge from Generative Language Models4 Dec 2022
- 2022A Survey of Knowledge Enhanced Pre-trained Language Models11 Nov 2022
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoningcited by 175
- 2023Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoningcited by 49
- 2024Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustmentcited by 30
- 2023ThinkBot: Embodied Instruction Following with Thought Chain Reasoningcited by 19
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning18 Mar 2024
- 2024Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment5 Mar 2024
- 2023ThinkBot: Embodied Instruction Following with Thought Chain Reasoning12 Dec 2023
- 2023Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoning5 Oct 2023
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?cited by 81
- 2022A Survey of Knowledge Enhanced Pre-trained Language Modelscited by 76
- 2024A Survey on Robotics with Foundation Models: toward Embodied AIcited by 56
- 2023Plan, Posture and Go: Towards Open-World Text-to-Motion Generationcited by 26
- 2024Large Language Models and Causal Inference in Collaboration: A Surveycited by 26
- 2024Correctable Landmark Discovery via Large Models for Vision-Language Navigationcited by 17
- 2024Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videoscited by 15
- 2022Automaton-Based Representations of Task Knowledge from Generative Language Modelscited by 12
- 2024Propose, Assess, Search: Harnessing LLMs for Goal-Oriented Planning in Instructional Videoscited by 12
- 2024FLAP: Flow-Adhering Planning with Constrained Decoding in LLMscited by 11
- 2025Towards Reliable Code-as-Policies: A Neuro-Symbolic Framework for Embodied Task Planningcited by 11
- 2025Hierarchical Planning for Complex Tasks with Knowledge Graph-RAG and Symbolic Verificationcited by 9
12 most cited of 19 All 19 (JSON)
- 2025Towards Reliable Code-as-Policies: A Neuro-Symbolic Framework for Embodied Task Planning24 Oct 2025
- 2025ScEdit: Script-based Assessment of Knowledge Editing29 May 2025
- 2025Achieving Scalable Robot Autonomy via neurosymbolic planning using lightweight local LLM13 May 2025
- 2025Hierarchical Planning for Complex Tasks with Knowledge Graph-RAG and Symbolic Verification6 Apr 2025
- 2025What Changed and What Could Have Changed? State-Change Counterfactuals for Procedure-Aware Video Representation Learning27 Mar 2025
- 2024What Really is Commonsense Knowledge?6 Nov 2024
- 2024Propose, Assess, Search: Harnessing LLMs for Goal-Oriented Planning in Instructional Videos30 Sep 2024
- 2024Correctable Landmark Discovery via Large Models for Vision-Language Navigation29 May 2024
- 2024Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Following21 Apr 2024
- 2024Large Language Models and Causal Inference in Collaboration: A Survey14 Mar 2024
- 2024FLAP: Flow-Adhering Planning with Constrained Decoding in LLMs9 Mar 2024
- 2024Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos5 Mar 2024
12 newest of 19 All 19 (JSON)