Embodied Lifelong Learning for Task and Motion Planning
Not on the map. Why?
Abstract (arXiv)
A robot deployed in a home over long stretches of time faces a true lifelong learning problem. As it seeks to provide assistance to its users, the robot should leverage any accumulated experience to improve its own knowledge and proficiency. We formalize this setting with a novel formulation of lifelong learning for task and motion planning (TAMP), which endows our learner with the compositionality of TAMP systems. Exploiting the modularity of TAMP, we develop a mixture of generative models that produces candidate continuous parameters for a planner. Whereas most existing lifelong learning approaches determine a priori how data is shared across various models, our approach learns shared and non-shared models and determines which to use online during planning based on auxiliary tasks that serve as a proxy for each model's understanding of a state. Our method exhibits substantial improvements (over time and compared to baselines) in planning success on 2D and BEHAVIOR domains.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 13 Jul 2023.
Builds on
24 of 34 references.
References · 24
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2016Learning without Forgettingcited by 2,496
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2018Efficient Lifelong Learning with A-GEMcited by 1,058
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 681
- 2017Variational Continual Learningcited by 339
- 2020Integrated Task and Motion Planningcited by 290
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
- 2016A Deep Hierarchical Approach to Lifelong Learning in Minecraftcited by 90
- 2020Efficient Continual Learning with Modular Networks and Task-Driven Priorscited by 88
- 2021Continual Learning via Local Module Compositioncited by 63
12 more
- 2021Learning Symbolic Operators for Task and Motion Planningcited by 58
- 2022Learning Neuro-Symbolic Skills for Bilevel Planningcited by 58
- 2022Predicate Invention for Bilevel Planningcited by 49
- 2020Learning compositional models of robot skills for task and motion planningcited by 48
- 2021Learning Neuro-Symbolic Relational Transition Models for Bilevel Planningcited by 43
- 2022Modular Lifelong Reinforcement Learning via Neural Compositioncited by 40
- 2020Lifelong Learning of Compositional Structurescited by 35
- 2018Active model learning and diverse action sampling for task and motion planningcited by 28
- 2022How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Compositioncited by 27
- 2021Discovering State and Action Abstractions for Generalized Task and Motion Planningcited by 18
- 2022Representation, learning, and planning algorithms for geometric task and motion planningcited by 8
- 2023Learning Sampling Dictionaries for Efficient and Generalizable Robot Motion Planning with Transformerscited by 8
Built on by
Citing papers per year: 2024: 7; 2025: 6; 2026: 4.
17 papers.
Sort:
By area:
- 2024Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learningcited by 57
- 2025Diffusion Models for Robotic Manipulation: A Surveycited by 41
- 2024MaestroMotif: Skill Design from Artificial Intelligence Feedbackcited by 24
- 2024Practice Makes Perfect: Planning to Learn Skill Parameter Policiescited by 23
- 2025A Survey of Continual Reinforcement Learningcited by 18
- 2025Neural Brain: A Neuroscience-inspired Framework for Embodied Agentscited by 10
- 2025EfficientLLaVA:Generalizable Auto-Pruning for Large Vision-language Modelscited by 7
- 2024Reconstruct before Query: Continual Missing Modality Learning with Decomposed Prompt Collaborationcited by 4
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challengescited by 4
- 2026Kintsugi: Learning Policies by Repairing Executable Knowledge Basescited by 3
- 2024CLIMB: Language-Guided Continual Learning for Task Planning with Iterative Model Buildingcited by 2
- 2024Learning to Bridge the Gap: Efficient Novelty Recovery with Planning and Reinforcement Learningcited by 1
5 more
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptationcited by 1
- 2025Coloring Between the Lines: Personalization in the Null Space of Planning Constraintscited by 1
- 2026Lifelong In-Context Learning with Transformers Requires Parametric Forms of Attentioncited by 1
- 2026Adapting Actively on the Fly: Relevance-Guided Online Meta-Learning with Latent Concepts for Geospatial Discoverycited by 0
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planningcited by 0
- 2026Lifelong In-Context Learning with Transformers Requires Parametric Forms of Attention24 Jun 2026
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning15 May 2026
- 2026Kintsugi: Learning Policies by Repairing Executable Knowledge Bases10 May 2026
- 2026Adapting Actively on the Fly: Relevance-Guided Online Meta-Learning with Latent Concepts for Geospatial Discovery19 Feb 2026
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
- 2025A Survey of Continual Reinforcement Learning27 Jun 2025
- 2025Coloring Between the Lines: Personalization in the Null Space of Planning Constraints21 May 2025
- 2025Neural Brain: A Neuroscience-inspired Framework for Embodied Agents12 May 2025
- 2025Diffusion Models for Robotic Manipulation: A Survey11 Apr 2025
- 2025EfficientLLaVA:Generalizable Auto-Pruning for Large Vision-language Models19 Mar 2025
- 2024MaestroMotif: Skill Design from Artificial Intelligence Feedback11 Dec 2024
- 2024CLIMB: Language-Guided Continual Learning for Task Planning with Iterative Model Building17 Oct 2024
5 more
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation3 Oct 2024
- 2024Learning to Bridge the Gap: Efficient Novelty Recovery with Planning and Reinforcement Learning28 Sep 2024
- 2024Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning1 Jul 2024
- 2024Reconstruct before Query: Continual Missing Modality Learning with Decomposed Prompt Collaboration17 Mar 2024
- 2024Practice Makes Perfect: Planning to Learn Skill Parameter Policies22 Feb 2024
- 2024MaestroMotif: Skill Design from Artificial Intelligence Feedbackcited by 24
- 2024Practice Makes Perfect: Planning to Learn Skill Parameter Policiescited by 23
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challengescited by 4
- 2026Kintsugi: Learning Policies by Repairing Executable Knowledge Basescited by 3
- 2024CLIMB: Language-Guided Continual Learning for Task Planning with Iterative Model Buildingcited by 2
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptationcited by 1
- 2025Coloring Between the Lines: Personalization in the Null Space of Planning Constraintscited by 1
- 2026Lifelong In-Context Learning with Transformers Requires Parametric Forms of Attentioncited by 1
- 2026Adapting Actively on the Fly: Relevance-Guided Online Meta-Learning with Latent Concepts for Geospatial Discoverycited by 0
- 2026Lifelong In-Context Learning with Transformers Requires Parametric Forms of Attention24 Jun 2026
- 2026Kintsugi: Learning Policies by Repairing Executable Knowledge Bases10 May 2026
- 2026Adapting Actively on the Fly: Relevance-Guided Online Meta-Learning with Latent Concepts for Geospatial Discovery19 Feb 2026
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
- 2025Coloring Between the Lines: Personalization in the Null Space of Planning Constraints21 May 2025
- 2024MaestroMotif: Skill Design from Artificial Intelligence Feedback11 Dec 2024
- 2024CLIMB: Language-Guided Continual Learning for Task Planning with Iterative Model Building17 Oct 2024
- 2024Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation3 Oct 2024
- 2024Practice Makes Perfect: Planning to Learn Skill Parameter Policies22 Feb 2024