mlsanityData to 14 Oct 2026

Brain-Inspired Hierarchical Modularity for General Continual Learning

arXiv 2609.25146 ↗First posted 21 Sep 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Continual learning, the ability to learn from sequential experience while retaining and adapting prior knowledge, is central to intelligent systems operating in changing environments. However, conventional continual learning is typically studied with offline task-wise training and clear task boundaries, leaving a substantial gap from general continual learning under online, uncertain, and evolving data streams. In this regime, intelligent systems must separate conflicting experience to reduce interference while integrating compatible experience to promote generalization. Inspired by the organization of the Drosophila learning and memory system, we identify a hierarchical modular principle that coordinates both functions through expert specialization and ensemble integration. We instantiate this principle as lightweight modular adaptation of pretrained foundation models, combining brain-inspired random expansion for expert routing and diversified modular integration across spatial and temporal scales. Across visual recognition, vision-language understanding, ego-exo video understanding, and embodied vision-language-action learning, our method consistently improves learning under online and uncertain data streams, with gains exceeding 50 percentage points over replay-free alternatives in embodied manipulation. These findings support hierarchical modularity as a biologically grounded path for learning from dynamic experience.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 77 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

7 of 77 references.

References · 7

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  5. 2021ImageNet-21K Pretraining for the Massescited by 613
  6. 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applicationscited by 91
  7. 2021Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inferencecited by 67

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learning
  2. 2026Position: Modular Memory is the Key to Continual Learning Agents
  3. 2026Benchmarking World Models for Continual Learning on Compositional Tasks
  4. 2024Hierarchical Orchestra of Policies
  5. 2026Principled Fast and Meta Knowledge Learners for Continual Reinforcement Learning
  6. 2025Multi-Modal Continual Learning via Cross-Modality Adapters and Representation Alignment with Knowledge Preservation
  7. 2026DIMoE-Adapters: Dynamic Expert Evolution for Continual Learning in Vision-Language Models
  8. 2026To Retain or to Adapt? Generalizing Continual Learning