Structuring Relations Among Learning Paradigms via Protocol--Objective--Resource Reductions
Not on the map. Why?
Abstract (arXiv)
Modern machine learning spans supervised, transfer, continual, meta-learning, and related regimes that often reuse the same hypothesis classes, architectures, and optimizers but differ in information access, objectives, memory, adaptation, and sample accounting. This makes it difficult to determine whether one paradigm is genuinely distinct, a special case of another, or part of a broader structural hierarchy. We introduce a protocol-objective-resource (POR) framework that separates representational capacity from these design choices. A paradigm is specified by an environment class, observation protocol, admissible learners, performance functional, and resource accounting rule. POR reductions combine environment embeddings, learner compilers, threshold maps, and calibrated resource overheads. Our main theorem shows that such reductions imply worst-case complexity domination on embedded comparison classes, transferring upper bounds forward and lower bounds backward; under labeled-example accounting, this yields sample complexity domination. We also show that calibrated nontrivial accuracy regimes are necessary to avoid vacuous comparisons, and that strengthening the objective can strictly increase minimax sample complexity even with unchanged protocols and learner classes. Instantiating the framework for supervised, transfer, continual, and meta-learning yields canonical special-case relations: continual contains transfer, transfer contains supervised, and meta-learning contains supervised under aligned raw-example accounting. We further derive a non-exact episode-to-example reduction for episodic meta-learning and capture within-paradigm refinements such as replay memory and task identifiers. The framework thus provides a unified language for structuring learning paradigms and transferring complexity guarantees across them.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 62 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
25 of 62 references.
References · 25
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2016Learning to learn by gradient descent by gradient descentcited by 620
- 2015The Benefit of Multitask Representation Learningcited by 195
- 2020On the Theory of Transfer Learning: The Importance of Task Diversitycited by 186
- 2020Minimax Lower Bounds for Transfer Learning with Linear and One-hidden Layer Neural Networkscited by 30
13 more
- 2024Towards Robust Graph Incremental Learning on Evolving Graphscited by 18
- 2024MSPipe: Efficient Temporal GNN Training via Staleness-Aware Pipelinecited by 12
- 2024PRES: Toward Scalable Memory-Based Dynamic Graph Neural Networkscited by 10
- 2023On the Limitation and Experience Replay for GNNs in Continual Learningcited by 7
- 2024Temporal-Aware Evaluation and Learning for Temporal Graph Neural Networkscited by 5
- 2024On the Topology Awareness and Generalization Performance of Graph Neural Networkscited by 3
- 2024Improving Implicit Regularization of SGD with Preconditioning for Least Square Problemscited by 3
- 2025A Non-Asymptotic Convergent Analysis for Scored-Based Graph Generative Model via a System of Stochastic Differential Equationscited by 3
- 2024BG-HGNN: Toward Efficient Learning for Complex Heterogeneous Graphscited by 2
- 2025On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networkscited by 2
- 2026Full-Graph vs. Mini-Batch Training: Comprehensive Analysis from a Batch Size and Fan-Out Size Perspectivecited by 2
- 2026When Do Multi-Agent Systems Outperform? Analysing the Learning Efficiency of Agentic Systemscited by 2
- 2026Structuring Semantic Embeddings for Principle Evaluation: A Prototype-Guided Contrastive Learning Approachcited by 1
Built on by
Not cited yet.