Modular meta-learning
Not on the map. Why?
Abstract (arXiv)
Many prediction problems, such as those that arise in the context of robotics, have a simplifying underlying structure that, if known, could accelerate learning. In this paper, we present a strategy for learning a set of neural network modules that can be combined in different ways. We train different modular structures on a set of related tasks and generalize to new tasks by composing the learned modules in new ways. By reusing modules to generalize we achieve combinatorial generalization, akin to the "infinite use of finite means" displayed in language. Finally, we show this improves performance in two robotics-related problems.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 14; 2023: 9; 2024: 4; 2025: 4; 2026: 2.
51 papers.
Sort:
By area:
- 2022The CLRS Algorithmic Reasoning Benchmarkcited by 103
- 2023Modular Deep Learningcited by 82
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2021Wide Neural Networks Forget Less Catastrophicallycited by 64
- 2024Combining Induction and Transduction for Abstract Reasoningcited by 53
- 2022Modular Lifelong Reinforcement Learning via Neural Compositioncited by 39
- 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 37
- 2021Fast and Slow Learning of Recurrent Independent Mechanismscited by 36
- 2022Continual Learning with Recursive Gradient Optimizationcited by 32
- 2022Combining Modular Skills in Multitask Learningcited by 27
- 2022How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Compositioncited by 27
- 2021Understanding the Dynamics of DNNs Using Graph Modularitycited by 26
38 more
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Predictioncited by 22
- 2022CompoSuite: A Compositional Reinforcement Learning Benchmarkcited by 21
- 2021Learning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 20
- 2021Transformers with Competitive Ensembles of Independent Mechanismscited by 19
- 2023Neural Relational Inference with Fast Modular Meta-learningcited by 16
- 2022On the link between conscious function and general intelligence in humans and machinescited by 15
- 2023AdaptNet: Policy Adaptation for Physics-Based Character Controlcited by 15
- 2021Modular Meta-Learning for Power Control via Random Edge Graph Neural Networkscited by 13
- 2021Quantifying Local Specialization in Deep Neural Networkscited by 10
- 2022Relay Hindsight Experience Replay: Self-Guided Continual Reinforcement Learning for Sequential Object Manipulation Tasks with Sparse Rewardscited by 10
- 2023Mnemosyne: Learning to Train Transformers with Transformerscited by 9
- 2021Compositional Learning-based Planning for Vision POMDPscited by 8
- 2022On the Generalization and Adaption Performance of Causal Modelscited by 8
- 2025Physics of Skill Learningcited by 8
- 2025Beyond Data Filtering: Knowledge Localization for Capability Removal in LLMscited by 8
- 2021Mixture-of-Variational-Experts for Continual Learningcited by 7
- 2022Transfering Hierarchical Structure with Dual Meta Imitation Learningcited by 7
- 2023Egocentric Planning for Scalable Embodied Task Achievementcited by 7
- 2021Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignmentcited by 6
- 2024Breaking Neural Network Scaling Laws with Modularitycited by 5
- 2022Towards Better Generalization with Flexible Representation of Multi-Module Graph Neural Networkscited by 4
- 2024MetaFollower: Adaptable Personalized Autonomous Car Followingcited by 4
- 2022From Multi-label Learning to Cross-Domain Transfer: A Model-Agnostic Approachcited by 3
- 2022Learning Label Modular Prompts for Text Classification in the Wildcited by 3
- 2023Modularity in Deep Learning: A Surveycited by 3
- 2021Hierarchical Primitive Composition: Simultaneous Activation of Skills with Inconsistent Action Dimensions in Multiple Hierarchiescited by 2
- 2021A Simple Approach to Continual Learning by Transferring Skill Parameterscited by 2
- 2022Modular Adaptive Policy Selection for Multi-Task Imitation Learning through Task Divisioncited by 2
- 2023Collective Relational Inference for learning heterogeneous interactionscited by 2
- 2021Skeleton-based Hand-Gesture Recognition with Lightweight Graph Convolutional Networkscited by 1
- 2023Learning to Compose SuperWeights for Neural Parameter Allocation Searchcited by 1
- 2025CARoL: Context-aware Adaptation for Robot Learningcited by 1
- 2021Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 0
- 2021Meta-learning Amidst Heterogeneity and Ambiguitycited by 0
- 2023Meta-Prior: Meta learning for Adaptive Inverse Problem Solverscited by 0
- 2024Scalable Multivariate Fronthaul Quantization for Cell-Free Massive MIMOcited by 0
- 2025Policy Search, Retrieval, and Composition via Task Similarity in Collaborative Agentic Systemscited by 0
- 2026When Search Becomes Memory: Accelerating Robot Design Discovery with Self-Evolving Skillscited by 0
50 most cited of 51 All 51 (JSON)
- 2026Spectral characteristics of autoencoder parameters as a vector representation of data3 Sep 2026
- 2026When Search Becomes Memory: Accelerating Robot Design Discovery with Self-Evolving Skills25 May 2026
- 2025Beyond Data Filtering: Knowledge Localization for Capability Removal in LLMs5 Dec 2025
- 2025CARoL: Context-aware Adaptation for Robot Learning8 Jun 2025
- 2025Policy Search, Retrieval, and Composition via Task Similarity in Collaborative Agentic Systems5 Jun 2025
- 2025Physics of Skill Learning21 Jan 2025
- 2024Combining Induction and Transduction for Abstract Reasoning4 Nov 2024
- 2024Breaking Neural Network Scaling Laws with Modularity9 Sep 2024
- 2024Scalable Multivariate Fronthaul Quantization for Cell-Free Massive MIMO26 Aug 2024
- 2024MetaFollower: Adaptable Personalized Autonomous Car Following23 Jun 2024
- 2023Learning to Compose SuperWeights for Neural Parameter Allocation Search3 Dec 2023
- 2023Meta-Prior: Meta learning for Adaptive Inverse Problem Solvers30 Nov 2023
38 more
- 2023Neural Relational Inference with Fast Modular Meta-learning10 Oct 2023
- 2023Modularity in Deep Learning: A Survey2 Oct 2023
- 2023AdaptNet: Policy Adaptation for Physics-Based Character Control30 Sep 2023
- 2023Egocentric Planning for Scalable Embodied Task Achievement2 Jun 2023
- 2023Collective Relational Inference for learning heterogeneous interactions30 Apr 2023
- 2023Modular Deep Learning22 Feb 2023
- 2023Mnemosyne: Learning to Train Transformers with Transformers2 Feb 2023
- 2022Learning Label Modular Prompts for Text Classification in the Wild30 Nov 2022
- 2022Towards Better Generalization with Flexible Representation of Multi-Module Graph Neural Networks14 Sep 2022
- 2022Relay Hindsight Experience Replay: Self-Guided Continual Reinforcement Learning for Sequential Object Manipulation Tasks with Sparse Rewards1 Aug 2022
- 2022From Multi-label Learning to Cross-Domain Transfer: A Model-Agnostic Approach24 Jul 2022
- 2022How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition15 Jul 2022
- 2022CompoSuite: A Compositional Reinforcement Learning Benchmark8 Jul 2022
- 2022Modular Lifelong Reinforcement Learning via Neural Composition1 Jul 2022
- 2022On the Generalization and Adaption Performance of Causal Models9 Jun 2022
- 2022The CLRS Algorithmic Reasoning Benchmark31 May 2022
- 2022Modular Adaptive Policy Selection for Multi-Task Imitation Learning through Task Division28 Mar 2022
- 2022On the link between conscious function and general intelligence in humans and machines24 Mar 2022
- 2022Combining Modular Skills in Multitask Learning28 Feb 2022
- 2022Continual Learning with Recursive Gradient Optimization29 Jan 2022
- 2022Transfering Hierarchical Structure with Dual Meta Imitation Learning28 Jan 2022
- 2021Compositional Learning-based Planning for Vision POMDPs17 Dec 2021
- 2021Learning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognition6 Dec 2021
- 2021Understanding the Dynamics of DNNs Using Graph Modularity24 Nov 2021
- 2021Mixture-of-Variational-Experts for Continual Learning25 Oct 2021
- 2021Wide Neural Networks Forget Less Catastrophically21 Oct 2021
- 2021A Simple Approach to Continual Learning by Transferring Skill Parameters19 Oct 2021
- 2021Quantifying Local Specialization in Deep Neural Networks13 Oct 2021
- 2021Hierarchical Primitive Composition: Simultaneous Activation of Skills with Inconsistent Action Dimensions in Multiple Hierarchies5 Oct 2021
- 2021Modular Meta-Learning for Power Control via Random Edge Graph Neural Networks4 Aug 2021
- 2021Meta-learning Amidst Heterogeneity and Ambiguity5 Jul 2021
- 2021Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment28 Jun 2021
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images22 Jun 2021
- 2021Fast and Slow Learning of Recurrent Independent Mechanisms18 May 2021
- 2021Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognition12 Apr 2021
- 2021Skeleton-based Hand-Gesture Recognition with Lightweight Graph Convolutional Networks9 Apr 2021
- 2021Transformers with Competitive Ensembles of Independent Mechanisms27 Feb 2021
- 2021Meta-Learning Dynamics Forecasting Using Task Inference20 Feb 2021
50 newest of 51 All 51 (JSON)
- 2024Combining Induction and Transduction for Abstract Reasoningcited by 53
- 2022The CLRS Algorithmic Reasoning Benchmarkcited by 103
- 2023Modular Deep Learningcited by 82
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2021Wide Neural Networks Forget Less Catastrophicallycited by 64
- 2022Modular Lifelong Reinforcement Learning via Neural Compositioncited by 39
- 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 37
- 2021Fast and Slow Learning of Recurrent Independent Mechanismscited by 36
- 2022Continual Learning with Recursive Gradient Optimizationcited by 32
- 2022Combining Modular Skills in Multitask Learningcited by 27
- 2022How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Compositioncited by 27
- 2021Understanding the Dynamics of DNNs Using Graph Modularitycited by 26
- 2021Deep Multi-Task Learning for Joint Localization, Perception, and Predictioncited by 22
12 most cited of 45 All 45 (JSON)
- 2026Spectral characteristics of autoencoder parameters as a vector representation of data3 Sep 2026
- 2025CARoL: Context-aware Adaptation for Robot Learning8 Jun 2025
- 2025Physics of Skill Learning21 Jan 2025
- 2024Breaking Neural Network Scaling Laws with Modularity9 Sep 2024
- 2024Scalable Multivariate Fronthaul Quantization for Cell-Free Massive MIMO26 Aug 2024
- 2024MetaFollower: Adaptable Personalized Autonomous Car Following23 Jun 2024
- 2023Learning to Compose SuperWeights for Neural Parameter Allocation Search3 Dec 2023
- 2023Meta-Prior: Meta learning for Adaptive Inverse Problem Solvers30 Nov 2023
- 2023Neural Relational Inference with Fast Modular Meta-learning10 Oct 2023
- 2023Modularity in Deep Learning: A Survey2 Oct 2023
- 2023AdaptNet: Policy Adaptation for Physics-Based Character Control30 Sep 2023
- 2023Egocentric Planning for Scalable Embodied Task Achievement2 Jun 2023
12 newest of 45 All 45 (JSON)