Learning Neuro-Symbolic Skills for Bilevel Planning
Not on the map. Why?
Abstract (arXiv)
Decision-making is challenging in robotics environments with continuous object-centric states, continuous actions, long horizons, and sparse feedback. Hierarchical approaches, such as task and motion planning (TAMP), address these challenges by decomposing decision-making into two or more levels of abstraction. In a setting where demonstrations and symbolic predicates are given, prior work has shown how to learn symbolic operators and neural samplers for TAMP with manually designed parameterized policies. Our main contribution is a method for learning parameterized polices in combination with operators and samplers. These components are packaged into modular neuro-symbolic skills and sequenced together with search-then-sample TAMP to solve new tasks. In experiments in four robotics domains, we show that our approach -- bilevel planning with neuro-symbolic skills -- can solve a wide range of tasks with varying initial states, goals, and objects, outperforming six baselines and ablations. Video: https://youtu.be/PbFZP8rPuGg Code: https://tinyurl.com/skill-learning
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). Builds on 42 of its 105 references that are in the map. First posted on arXiv 21 Jun 2022.
Builds on
42 of 105 references.
References · 42
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2017Hindsight Experience Replaycited by 1,096
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 734
- 2021Implicit Behavioral Cloningcited by 442
- 2018Data-Efficient Hierarchical Reinforcement Learningcited by 436
- 2016The Option-Critic Architecturecited by 433
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 328
- 2020Integrated Task and Motion Planningcited by 281
- 2016Variational Intrinsic Controlcited by 262
- 2020Accelerating Reinforcement Learning with Learned Skill Priorscited by 220
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
30 more
- 2020OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learningcited by 164
- 2020Parrot: Data-Driven Behavioral Priors for Reinforcement Learningcited by 136
- 2020Learning to Generalize Across Long-Horizon Tasks from Human Demonstrationscited by 114
- 2021Skill Induction and Planning with Latent Languagecited by 99
- 2017Meta Learning Shared Hierarchiescited by 93
- 2021Bottom-Up Skill Discovery from Unsegmented Demonstrations for Long-Horizon Robot Manipulationcited by 82
- 2018SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planningcited by 77
- 2017Near Optimal Behavior via Approximate State Abstractioncited by 63
- 2021Learning Symbolic Operators for Task and Motion Planningcited by 57
- 2018PEORL: Integrating Symbolic Planning and Hierarchical Reinforcement Learning for Robust Decision-Makingcited by 51
- 2017Multi-Level Discovery of Deep Optionscited by 50
- 2020Learning compositional models of robot skills for task and motion planningcited by 47
- 2020Deep Visual Reasoning: Learning to Predict Action Sequences for Task and Motion Planning from an Initial Scene Imagecited by 45
- 2021Learning Neuro-Symbolic Relational Transition Models for Bilevel Planningcited by 43
- 2018Learning Abstract Optionscited by 31
- 2020Understanding the Power and Limitations of Teaching with Imperfect Knowledgecited by 23
- 2020SPOTTER: Extending Symbolic Planning Operators through Targeted Reinforcement Learningcited by 23
- 2021SKID RAW: Skill Discovery from Raw Trajectoriescited by 22
- 2022Leveraging Approximate Symbolic Models for Reinforcement Learning via Skill Diversitycited by 22
- 2022Generalizable Task Planning through Representation Pretrainingcited by 19
- 2021Discovering State and Action Abstractions for Generalized Task and Motion Planningcited by 17
- 2019Generalized Lazy Search for Robot Motion Planning: Interleaving Search and Edge Evaluation via Event-based Togglescited by 16
- 2018Learning Quickly to Plan Quickly Using Modular Meta-Learningcited by 15
- 2021Extended Tree Search for Robot Task and Motion Planningcited by 14
- 2017Independently Controllable Featurescited by 11
- 2019Learning Portable Representations for High-Level Planningcited by 11
- 2021Discovering User-Interpretable Capabilities of Black-Box Planning Agentscited by 10
- 2022Temporal Logic Imitation: Learning Plan-Satisficing Motion Policies from Demonstrationscited by 10
- 2016Do What I Want, Not What I Did: Imitation of Skills by Planning Sequences of Actionscited by 3
- 2019Learning Deep Parameterized Skills from Demonstration for Re-targetable Visuomotor Controlcited by 3
Built on by
Citing papers per year: 2022: 5; 2023: 10; 2024: 16; 2025: 15; 2026: 9.
55 papers.
Sort:
By area:
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2024LoTa-Bench: Benchmarking Language-oriented Task Planners for Embodied Agentscited by 51
- 2024VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planningcited by 37
- 2025Neuro-Symbolic AI in 2024: A Systematic Reviewcited by 36
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2022LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulationcited by 32
- 2023Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentationcited by 29
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learningcited by 28
- 2023Neurosymbolic Reinforcement Learning and Planning: A Surveycited by 24
- 2024Practice Makes Perfect: Planning to Learn Skill Parameter Policiescited by 22
- 2023DiMSam: Diffusion Models as Samplers for Task and Motion Planning under Partial Observabilitycited by 21
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approachescited by 19
38 more
- 2022Learning Efficient Abstract Planning Models that Choose What to Predictcited by 17
- 2023Embodied Lifelong Learning for Task and Motion Planningcited by 17
- 2024Composing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Modelscited by 16
- 2025Synthesizing world models for bilevel planningcited by 13
- 2026LiLo-VLA: Compositional Long-Horizon Manipulation via Linked Object-Centric Policiescited by 12
- 2024From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Modelscited by 11
- 2024Neuro-Symbolic AI: Explainability, Challenges, and Future Trendscited by 10
- 2023Embodied Active Learning of Relational State Abstractions for Bilevel Planningcited by 8
- 2024LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulationcited by 8
- 2025ExoPredicator: Learning Abstract Models of Dynamic Worlds for Robot Planningcited by 8
- 2022Relative Behavioral Attributes: Filling the Gap between Symbolic Goal Specification and Reward Learning from Human Preferencescited by 7
- 2023Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structurescited by 7
- 2024Task and Motion Planning for Execution in the Realcited by 6
- 2024MAPLE: A Framework for Active Preference Learning Guided by Large Language Modelscited by 6
- 2025Neuro-Symbolic Imitation Learning: Discovering Symbolic Abstractions for Skill Learningcited by 4
- 2025Prime the search: Using large language models for guiding geometric task and motion planning by warm-starting tree searchcited by 4
- 2025A Systematic Study of Large Language Models for Task and Motion Planning With PDDLStreamcited by 4
- 2022Learning Temporally Extended Skills in Continuous Domains as Symbolic Actions for Planningcited by 3
- 2023Discovering Predictive Relational Object Symbols with Symbolic Attentive Layerscited by 3
- 2025Curiosity-Driven Imagination: Discovering Plan Operators and Learning Associated Policies for Open-World Adaptationcited by 3
- 2025LodeStar: Long-horizon Dexterity via Synthetic Data Augmentation from Human Demonstrationscited by 3
- 2025SLAP: Shortcut Learning for Abstract Planningcited by 3
- 2025MOSAIC: Skill-Centric Manipulation Planning with Physics Simulationcited by 2
- 2025Few-Shot Neuro-Symbolic Imitation Learning for Long-Horizon Planning and Actingcited by 2
- 2024SYNAPSE: SYmbolic Neural-Aided Preference Synthesis Enginecited by 1
- 2024Learning to Bridge the Gap: Efficient Novelty Recovery with Planning and Reinforcement Learningcited by 1
- 2024Neuro-Symbolic Skill Discovery for Conditional Multi-Level Planningcited by 1
- 2024Learning for Long-Horizon Planning via Neuro-Symbolic Abductive Imitationcited by 1
- 2025Situationally-Aware Dynamics Learningcited by 1
- 2025Finding 3D Scene Analogies with Multimodal Foundation Modelscited by 1
- 2026Novelty Adaptation Through Hybrid Large Language Model (LLM)-Symbolic Planning and LLM-guided Reinforcement Learningcited by 1
- 2023Learning Top-k Subtask Planning Tree based on Discriminative Representation Pre-training for Decision Makingcited by 0
- 2024NSP: A Neuro-Symbolic Natural Language Navigational Plannercited by 0
- 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AIcited by 0
- 2025Task and Skill Planning: Hierarchical Robot Planning with Black-Box Skillscited by 0
- 2025Using Temperature Sampling to Effectively Train Robot Learning Policies on Imbalanced Datasetscited by 0
- 2026Continual learning and refinement of causal models through dynamic predicate inventioncited by 0
- 2026Build on Priors: Vision--Language--Guided Neuro-Symbolic Imitation Learning for Data-Efficient Real-World Robot Manipulationcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Managing Action Preconditions in Neuro-Symbolic RL: Three Placement Strategies for Embodied Agents13 Sep 2026
- 2026What Is Worth Representing? Representational Empowerment for Continual Model Construction2 Sep 2026
- 2026Human2Any: Human-to-Robot Transfer via Constraint-Aware Compositional Planning27 Jun 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning15 May 2026
- 2026Build on Priors: Vision--Language--Guided Neuro-Symbolic Imitation Learning for Data-Efficient Real-World Robot Manipulation4 Apr 2026
- 2026Novelty Adaptation Through Hybrid Large Language Model (LLM)-Symbolic Planning and LLM-guided Reinforcement Learning11 Mar 2026
- 2026LiLo-VLA: Compositional Long-Horizon Manipulation via Linked Object-Centric Policies25 Feb 2026
- 2026Continual learning and refinement of causal models through dynamic predicate invention19 Feb 2026
- 2025SLAP: Shortcut Learning for Abstract Planning2 Nov 2025
- 2025Finding 3D Scene Analogies with Multimodal Foundation Models27 Oct 2025
- 2025Using Temperature Sampling to Effectively Train Robot Learning Policies on Imbalanced Datasets22 Oct 2025
38 more
- 2025A Systematic Study of Large Language Models for Task and Motion Planning With PDDLStream30 Sep 2025
- 2025ExoPredicator: Learning Abstract Models of Dynamic Worlds for Robot Planning30 Sep 2025
- 2025Few-Shot Neuro-Symbolic Imitation Learning for Long-Horizon Planning and Acting29 Aug 2025
- 2025LodeStar: Long-horizon Dexterity via Synthetic Data Augmentation from Human Demonstrations24 Aug 2025
- 2025Prime the search: Using large language models for guiding geometric task and motion planning by warm-starting tree search8 Jun 2025
- 2025Situationally-Aware Dynamics Learning26 May 2025
- 2025Task and Skill Planning: Hierarchical Robot Planning with Black-Box Skills24 Apr 2025
- 2025MOSAIC: Skill-Centric Manipulation Planning with Physics Simulation23 Apr 2025
- 2025Neuro-Symbolic Imitation Learning: Discovering Symbolic Abstractions for Skill Learning27 Mar 2025
- 2025Synthesizing world models for bilevel planning26 Mar 2025
- 2025Curiosity-Driven Imagination: Discovering Plan Operators and Learning Associated Policies for Open-World Adaptation6 Mar 2025
- 2025Neuro-Symbolic AI in 2024: A Systematic Review9 Jan 2025
- 2024From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Models31 Dec 2024
- 2024MAPLE: A Framework for Active Preference Learning Guided by Large Language Models10 Dec 2024
- 2024Learning for Long-Horizon Planning via Neuro-Symbolic Abductive Imitation27 Nov 2024
- 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AI7 Nov 2024
- 2024Neuro-Symbolic AI: Explainability, Challenges, and Future Trends7 Nov 2024
- 2024LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulation1 Nov 2024
- 2024VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning30 Oct 2024
- 2024Neuro-Symbolic Skill Discovery for Conditional Multi-Level Planning13 Oct 2024
- 2024Learning to Bridge the Gap: Efficient Novelty Recovery with Planning and Reinforcement Learning28 Sep 2024
- 2024NSP: A Neuro-Symbolic Natural Language Navigational Planner10 Sep 2024
- 2024Task and Motion Planning for Execution in the Real5 Jun 2024
- 2024Composing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Models20 Apr 2024
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches3 Apr 2024
- 2024SYNAPSE: SYmbolic Neural-Aided Preference Synthesis Engine25 Mar 2024
- 2024Practice Makes Perfect: Planning to Learn Skill Parameter Policies22 Feb 2024
- 2024LoTa-Bench: Benchmarking Language-oriented Task Planners for Embodied Agents13 Feb 2024
- 2023Learning Top-k Subtask Planning Tree based on Discriminative Representation Pre-training for Decision Making18 Dec 2023
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learning24 Oct 2023
- 2023Neurosymbolic Reinforcement Learning and Planning: A Survey2 Sep 2023
- 2023Discovering Predictive Relational Object Symbols with Symbolic Attentive Layers2 Sep 2023
- 2023Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentation24 Aug 2023
- 2023Embodied Lifelong Learning for Task and Motion Planning13 Jul 2023
- 2023DiMSam: Diffusion Models as Samplers for Task and Motion Planning under Partial Observability22 Jun 2023
- 2023Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structures8 Jun 2023
- 2023Text2Motion: From Natural Language Instructions to Feasible Plans21 Mar 2023
- 2023Embodied Active Learning of Relational State Abstractions for Bilevel Planning8 Mar 2023
50 newest of 55 All 55 (JSON)
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2024VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planningcited by 37
- 2025Synthesizing world models for bilevel planningcited by 13
- 2024From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Modelscited by 11
- 2025ExoPredicator: Learning Abstract Models of Dynamic Worlds for Robot Planningcited by 8
- 2026Continual learning and refinement of causal models through dynamic predicate inventioncited by 0
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planningcited by 0
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning15 May 2026
- 2026Continual learning and refinement of causal models through dynamic predicate invention19 Feb 2026
- 2025ExoPredicator: Learning Abstract Models of Dynamic Worlds for Robot Planning30 Sep 2025
- 2025Synthesizing world models for bilevel planning26 Mar 2025
- 2024From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Models31 Dec 2024
- 2024VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning30 Oct 2024
- 2023Text2Motion: From Natural Language Instructions to Feasible Plans21 Mar 2023
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learningcited by 28
- 2025Neuro-Symbolic Imitation Learning: Discovering Symbolic Abstractions for Skill Learningcited by 4
- 2025Few-Shot Neuro-Symbolic Imitation Learning for Long-Horizon Planning and Actingcited by 2
- 2026Build on Priors: Vision--Language--Guided Neuro-Symbolic Imitation Learning for Data-Efficient Real-World Robot Manipulationcited by 0
- 2026Build on Priors: Vision--Language--Guided Neuro-Symbolic Imitation Learning for Data-Efficient Real-World Robot Manipulation4 Apr 2026
- 2025Few-Shot Neuro-Symbolic Imitation Learning for Long-Horizon Planning and Acting29 Aug 2025
- 2025Neuro-Symbolic Imitation Learning: Discovering Symbolic Abstractions for Skill Learning27 Mar 2025
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learning24 Oct 2023
- 2025Neuro-Symbolic AI in 2024: A Systematic Reviewcited by 36
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2022LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulationcited by 32
- 2023Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentationcited by 29
- 2023Neurosymbolic Reinforcement Learning and Planning: A Surveycited by 24
- 2024Practice Makes Perfect: Planning to Learn Skill Parameter Policiescited by 22
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approachescited by 19
- 2022Learning Efficient Abstract Planning Models that Choose What to Predictcited by 17
- 2023Embodied Lifelong Learning for Task and Motion Planningcited by 17
- 2024Composing Pre-Trained Object-Centric Representations for Robotics From "What" and "Where" Foundation Modelscited by 16
- 2026LiLo-VLA: Compositional Long-Horizon Manipulation via Linked Object-Centric Policiescited by 12
- 2024Neuro-Symbolic AI: Explainability, Challenges, and Future Trendscited by 10
12 most cited of 38 All 38 (JSON)
- 2026Managing Action Preconditions in Neuro-Symbolic RL: Three Placement Strategies for Embodied Agents13 Sep 2026
- 2026What Is Worth Representing? Representational Empowerment for Continual Model Construction2 Sep 2026
- 2026Human2Any: Human-to-Robot Transfer via Constraint-Aware Compositional Planning27 Jun 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026Novelty Adaptation Through Hybrid Large Language Model (LLM)-Symbolic Planning and LLM-guided Reinforcement Learning11 Mar 2026
- 2026LiLo-VLA: Compositional Long-Horizon Manipulation via Linked Object-Centric Policies25 Feb 2026
- 2025SLAP: Shortcut Learning for Abstract Planning2 Nov 2025
- 2025Finding 3D Scene Analogies with Multimodal Foundation Models27 Oct 2025
- 2025Using Temperature Sampling to Effectively Train Robot Learning Policies on Imbalanced Datasets22 Oct 2025
- 2025A Systematic Study of Large Language Models for Task and Motion Planning With PDDLStream30 Sep 2025
- 2025Prime the search: Using large language models for guiding geometric task and motion planning by warm-starting tree search8 Jun 2025
- 2025Situationally-Aware Dynamics Learning26 May 2025
12 newest of 38 All 38 (JSON)