Socialized Division and Collaboration: Rethinking Class-Incremental Learning under Optimization Conflicts
Not on the map. Why?
Abstract (arXiv)
Class-incremental learning is commonly instantiated as a single-model paradigm, where a unified model sequentially adapts to an unbounded stream of sessions. While effective under mild distributional shifts, this formulation becomes strained when successive sessions induce incompatible optimization directions, leading to destructive interference and catastrophic forgetting. We argue that such forgetting reflects a structural limitation of enforcing heterogeneous learning dynamics within a single parameter space. Motivated by social solidarity theory, we propose Socialized Division and Collaboration (SDC) as a reformulation of continual learning that decomposes session learning across specialized models in response to optimization conflicts, while enabling coordinated collaboration. To support this formulation with a principled allocation mechanism, we introduce an energy-based session-model compatibility criterion grounded in Helmholtz free energy, which guides adaptive session allocation and model evolution under conflicting objectives. This framework integrates session assignment, model evolution, and collaborative inference into a unified pipeline, offering an alternative to monolithic continual learning formulations and highlighting a broader design principle for learning under persistent optimization conflicts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
11 of 25 references.
References · 11
- 2017Continual Learning with Deep Generative Replaycited by 1,158
- 2021Learning to Prompt for Continual Learningcited by 944
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 450
- 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 372
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 222
- 2024InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learningcited by 198
- 2023Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimalitycited by 121
- 2023Few-shot Class-incremental Learning for Classification and Object Detection: A Surveycited by 25
- 2025LoRA Subtraction for Drift-Resistant Space in Exemplar-Free Continual Learningcited by 18
- 2025RainbowPrompt: Diversity-Enhanced Prompt-Evolving for Continual Learningcited by 10
- 2024Exemplar Masking for Multimodal Incremental Learningcited by 1
Built on by
Not cited yet.