Learning to Compose Skills
Not on the map. Why?
Abstract (arXiv)
We present a differentiable framework capable of learning a wide variety of compositions of simple policies that we call skills. By recursively composing skills with themselves, we can create hierarchies that display complex behavior. Skill networks are trained to generate skill-state embeddings that are provided as inputs to a trainable composition function, which in turn outputs a policy for the overall task. Our experiments on an environment consisting of multiple collect and evade tasks show that this architecture is able to quickly build complex skills from simpler ones. Furthermore, the learned composition function displays some transfer to unseen combinations of skills, allowing for zero-shot generalizations.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 3; 2024: 1; 2025: 5; 2026: 1.
15 papers.
Sort:
By area:
- 2021Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environmentscited by 24
- 2021Solving Compositional Reinforcement Learning Problems via Task Reductioncited by 19
- 2023Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learningcited by 19
- 2021Learning Multi-Objective Curricula for Robotic Policy Learningcited by 3
- 2025One Rank at a Time: Cascading Error Dynamics in Sequential Learningcited by 3
- 2021Hierarchical Primitive Composition: Simultaneous Activation of Skills with Inconsistent Action Dimensions in Multiple Hierarchiescited by 2
- 2024I Know How: Combining Prior Policies to Solve New Taskscited by 2
- 2025Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibilitycited by 2
- 2023A Constrained-Optimization Approach to the Execution of Prioritized Stacks of Learned Multi-Robot Taskscited by 1
- 2023Towards Zero-Shot Functional Compositionality of Language Modelscited by 1
- 2025On the Parallels Between Evolutionary Theory and the State of AIcited by 1
- 2022Soft Actor-Critic with Inhibitory Networks for Faster Retrainingcited by 0
3 more
- 2025Multi-CALF: A Policy Combination Approach with Statistical Guaranteescited by 0
- 2025Evolutionary Developmental Biology Can Serve as the Conceptual Foundation for a New Design Paradigm in Artificial Intelligencecited by 0
- 2026Hierarchical Skill Retrieval for Data-Efficient Adaptation of Vision-Language-Action Modelscited by 0
- 2026Hierarchical Skill Retrieval for Data-Efficient Adaptation of Vision-Language-Action Models25 Aug 2026
- 2025Evolutionary Developmental Biology Can Serve as the Conceptual Foundation for a New Design Paradigm in Artificial Intelligence15 Jun 2025
- 2025One Rank at a Time: Cascading Error Dynamics in Sequential Learning28 May 2025
- 2025Multi-CALF: A Policy Combination Approach with Statistical Guarantees18 May 2025
- 2025On the Parallels Between Evolutionary Theory and the State of AI13 May 2025
- 2025Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibility19 Feb 2025
- 2024I Know How: Combining Prior Policies to Solve New Tasks14 Jun 2024
- 2023Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learning30 May 2023
- 2023Towards Zero-Shot Functional Compositionality of Language Models6 Mar 2023
- 2023A Constrained-Optimization Approach to the Execution of Prioritized Stacks of Learned Multi-Robot Tasks13 Jan 2023
- 2022Soft Actor-Critic with Inhibitory Networks for Faster Retraining7 Feb 2022
- 2021Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments31 Dec 2021
3 more
- 2021Learning Multi-Objective Curricula for Robotic Policy Learning6 Oct 2021
- 2021Hierarchical Primitive Composition: Simultaneous Activation of Skills with Inconsistent Action Dimensions in Multiple Hierarchies5 Oct 2021
- 2021Solving Compositional Reinforcement Learning Problems via Task Reduction13 Mar 2021
- 2021Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environmentscited by 24
- 2021Solving Compositional Reinforcement Learning Problems via Task Reductioncited by 19
- 2021Learning Multi-Objective Curricula for Robotic Policy Learningcited by 3
- 2025One Rank at a Time: Cascading Error Dynamics in Sequential Learningcited by 3
- 2021Hierarchical Primitive Composition: Simultaneous Activation of Skills with Inconsistent Action Dimensions in Multiple Hierarchiescited by 2
- 2024I Know How: Combining Prior Policies to Solve New Taskscited by 2
- 2025Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibilitycited by 2
- 2023A Constrained-Optimization Approach to the Execution of Prioritized Stacks of Learned Multi-Robot Taskscited by 1
- 2023Towards Zero-Shot Functional Compositionality of Language Modelscited by 1
- 2025On the Parallels Between Evolutionary Theory and the State of AIcited by 1
- 2022Soft Actor-Critic with Inhibitory Networks for Faster Retrainingcited by 0
- 2025Multi-CALF: A Policy Combination Approach with Statistical Guaranteescited by 0
12 most cited of 13 All 13 (JSON)
- 2025Evolutionary Developmental Biology Can Serve as the Conceptual Foundation for a New Design Paradigm in Artificial Intelligence15 Jun 2025
- 2025One Rank at a Time: Cascading Error Dynamics in Sequential Learning28 May 2025
- 2025Multi-CALF: A Policy Combination Approach with Statistical Guarantees18 May 2025
- 2025On the Parallels Between Evolutionary Theory and the State of AI13 May 2025
- 2025Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibility19 Feb 2025
- 2024I Know How: Combining Prior Policies to Solve New Tasks14 Jun 2024
- 2023Towards Zero-Shot Functional Compositionality of Language Models6 Mar 2023
- 2023A Constrained-Optimization Approach to the Execution of Prioritized Stacks of Learned Multi-Robot Tasks13 Jan 2023
- 2022Soft Actor-Critic with Inhibitory Networks for Faster Retraining7 Feb 2022
- 2021Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments31 Dec 2021
- 2021Learning Multi-Objective Curricula for Robotic Policy Learning6 Oct 2021
- 2021Hierarchical Primitive Composition: Simultaneous Activation of Skills with Inconsistent Action Dimensions in Multiple Hierarchies5 Oct 2021
12 newest of 13 All 13 (JSON)