Curriculum Learning of Multiple Tasks
Not on the map. Why?
Abstract (arXiv)
Sharing information between multiple tasks enables algorithms to achieve good generalization performance even from small amounts of training data. However, in a realistic scenario of multi-task learning not all tasks are equally related to each other, hence it could be advantageous to transfer information only between the most related tasks. In this work we propose an approach that processes multiple tasks in a sequence with sharing between subsequent tasks instead of solving all tasks jointly. Subsequently, we address the question of curriculum learning of tasks, i.e. finding the best order of tasks to be learned. Our approach is based on a generalization bound criterion for choosing the task order that optimizes the average expected classification performance over all tasks. Our experimental results show that learning multiple related tasks sequentially can be more effective than learning them jointly, the order in which tasks are being solved affects the overall performance, and that our model is able to automatically discover the favourable order of tasks.
Key facts. Cited by 65 papers in the map (data through 13 Oct 2026). First posted on arXiv 3 Dec 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 13; 2023: 14; 2024: 5; 2025: 14; 2026: 9.
65 papers.
Sort:
By area:
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 539
- 2021Curriculum Learning: A Surveycited by 257
- 2025Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learningcited by 71
- 2021Uncertainty-Aware Unsupervised Domain Adaptation in Object Detectioncited by 59
- 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoningcited by 39
- 2023Continual Learning in Linear Classification on Separable Datacited by 33
- 2022The Effect of Task Ordering in Continual Learningcited by 30
- 2021An Analytical Theory of Curriculum Learning in Teacher-Student Networkscited by 27
- 2023ASP: Learn a Universal Neural Solver!cited by 27
- 2024Denoising Task Difficulty-based Curriculum for Training Diffusion Modelscited by 26
- 2023Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputscited by 22
- 2021Medical Image Segmentation with Limited Supervision: A Review of Deep Network Modelscited by 21
38 more
- 2021Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absentcited by 21
- 2023CL-MAE: Curriculum-Learned Masked Autoencoderscited by 21
- 2024CurricuLLM: Automatic Task Curricula Design for Learning Complex Robot Skills using Large Language Modelscited by 20
- 2023Domain Generalization via Balancing Training Difficulty and Model Capabilitycited by 19
- 2025Optimal Task Order for Continual Learning of Multiple Taskscited by 14
- 2025RecGPT Technical Reportcited by 11
- 2023Traffic-Domain Video Question Answering with Automatic Captioningcited by 10
- 2021Coarse-to-Fine Curriculum Learningcited by 9
- 2022Learning Rate Curriculumcited by 9
- 2022When Do Curricula Work in Federated Learning?cited by 9
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detectioncited by 9
- 2022Let the Model Decide its Curriculum for Multitask Learningcited by 8
- 2022MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequencescited by 8
- 2022Curriculum-based Asymmetric Multi-task Reinforcement Learningcited by 8
- 2023RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learningcited by 8
- 2021How to distribute data across tasks for meta-learning?cited by 7
- 2023Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillationcited by 7
- 2023Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimizationcited by 6
- 2022Toddler-Guidance Learning: Impacts of Critical Period on Multimodal AI Agentscited by 5
- 2022CRISP: Curriculum based Sequential Neural Decoders for Polar Code Familycited by 5
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotioncited by 5
- 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervisioncited by 4
- 2025RAVEN++: Pinpointing Fine-Grained Violations in Advertisement Videos with Active Reinforcement Reasoningcited by 4
- 2023DCLP: Neural Architecture Predictor with Curriculum Contrastive Learningcited by 3
- 2024CBM: Curriculum by Maskingcited by 3
- 2025A statistical physics framework for optimal learningcited by 3
- 2025Heterogeneous Adversarial Play in Interactive Environmentscited by 3
- 2022InDistill: Information flow-preserving knowledge distillation for model compressioncited by 2
- 2022Task Phasing: Automated Curriculum Learning from Demonstrationscited by 2
- 2022LightDepth: A Resource Efficient Depth Estimation Approach for Dealing with Ground Truth Sparsity via Curriculum Learningcited by 2
- 2023Confidence-Aware Calibration and Scoring Functions for Curriculum Learningcited by 2
- 2026Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledgecited by 2
- 2021Object Localization Through a Single Multiple-Model Convolutional Neural Network with a Specific Training Approachcited by 1
- 2023Information Maximizing Curriculum: A Curriculum-Based Approach for Imitating Diverse Skillscited by 1
- 2024Sample Efficient Myopic Exploration Through Multitask Reinforcement Learning with Diverse Taskscited by 1
- 2025RDTF: Resource-efficient Dual-mask Training Framework for Multi-frame Animated Sticker Generationcited by 1
- 2025CLPSTNet: A Progressive Multi-Scale Convolutional Steganography Model Integrating Curriculum Learningcited by 1
- 2025STCL:Curriculum learning Strategies for deep learning image steganography modelscited by 1
50 most cited of 65 All 65 (JSON)
- 2026In-context Region-based Drag: Drag Any Region to Any Shape24 Jun 2026
- 2026Convex Dataset Valuation for Post-Training15 May 2026
- 2026ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiring4 May 2026
- 2026Predictive Batch Scheduling: Accelerating Language Model Training Through Loss-Aware Sample Prioritization19 Feb 2026
- 2026Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledge16 Feb 2026
- 2026Interactive LLM-assisted Curriculum Learning for Multi-Task Evolutionary Policy Search11 Feb 2026
- 2026Can Large Language Models Generalize Procedures Across Representations?3 Feb 2026
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection3 Feb 2026
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotion1 Feb 2026
- 2025Characterization of Transfer Using Multi-task Learning Curves31 Dec 2025
- 2025RAVEN++: Pinpointing Fine-Grained Violations in Advertisement Videos with Active Reinforcement Reasoning24 Nov 2025
- 2025Aligning by Misaligning: Boundary-aware Curriculum Learning for Multimodal Alignment11 Nov 2025
38 more
- 2025Heterogeneous Adversarial Play in Interactive Environments21 Oct 2025
- 2025RecGPT Technical Report30 Jul 2025
- 2025A statistical physics framework for optimal learning10 Jul 2025
- 2025Directed Link Prediction using GNN with Local and Global Feature Fusion25 Jun 2025
- 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning31 May 2025
- 2025TSCL:Multi-party loss Balancing scheme for deep learning Image steganography based on Curriculum learning25 Apr 2025
- 2025STCL:Curriculum learning Strategies for deep learning image steganography models24 Apr 2025
- 2025CLPSTNet: A Progressive Multi-Scale Convolutional Steganography Model Integrating Curriculum Learning23 Apr 2025
- 2025RDTF: Resource-efficient Dual-mask Training Framework for Multi-frame Animated Sticker Generation22 Mar 2025
- 2025Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learning10 Mar 2025
- 2025Optimal Task Order for Continual Learning of Multiple Tasks5 Feb 2025
- 2024TPCL: Task Progressive Curriculum Learning for Robust Visual Question Answering26 Nov 2024
- 2024CurricuLLM: Automatic Task Curricula Design for Learning Complex Robot Skills using Large Language Models27 Sep 2024
- 2024CBM: Curriculum by Masking6 Jul 2024
- 2024Denoising Task Difficulty-based Curriculum for Training Diffusion Models15 Mar 2024
- 2024Sample Efficient Myopic Exploration Through Multitask Reinforcement Learning with Diverse Tasks3 Mar 2024
- 2023Domain Generalization via Balancing Training Difficulty and Model Capability2 Sep 2023
- 2023CL-MAE: Curriculum-Learned Masked Autoencoders31 Aug 2023
- 2023Traffic-Domain Video Question Answering with Automatic Captioning18 Jul 2023
- 2023Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs29 Jun 2023
- 2023Stochastic Re-weighted Gradient Descent via Distributionally Robust Optimization15 Jun 2023
- 2023Continual Learning in Linear Classification on Separable Data6 Jun 2023
- 2023Information Maximizing Curriculum: A Curriculum-Based Approach for Imitating Diverse Skills27 Mar 2023
- 2023Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation21 Mar 2023
- 2023ASP: Learn a Universal Neural Solver!1 Mar 2023
- 2023DCLP: Neural Architecture Predictor with Curriculum Contrastive Learning25 Feb 2023
- 2023Maneuver Decision-Making For Autonomous Air Combat Through Curriculum Learning And Reinforcement Learning With Sparse Rewards12 Feb 2023
- 2023Mixed-order self-paced curriculum learning for universal lesion detection9 Feb 2023
- 2023Confidence-Aware Calibration and Scoring Functions for Curriculum Learning29 Jan 2023
- 2023RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning4 Jan 2023
- 2022When Do Curricula Work in Federated Learning?24 Dec 2022
- 2022LightDepth: A Resource Efficient Depth Estimation Approach for Dealing with Ground Truth Sparsity via Curriculum Learning16 Nov 2022
- 2022Curriculum-based Asymmetric Multi-task Reinforcement Learning7 Nov 2022
- 2022MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences23 Oct 2022
- 2022Task Phasing: Automated Curriculum Learning from Demonstrations20 Oct 2022
- 2022CRISP: Curriculum based Sequential Neural Decoders for Polar Code Family1 Oct 2022
- 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervision16 Jun 2022
- 2022The Effect of Task Ordering in Continual Learning26 May 2022
50 newest of 65 All 65 (JSON)
- 2025Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learningcited by 71
- 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoningcited by 39
- 2023Traffic-Domain Video Question Answering with Automatic Captioningcited by 10
- 2025RAVEN++: Pinpointing Fine-Grained Violations in Advertisement Videos with Active Reinforcement Reasoningcited by 4
- 2025RAVEN++: Pinpointing Fine-Grained Violations in Advertisement Videos with Active Reinforcement Reasoning24 Nov 2025
- 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning31 May 2025
- 2025Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learning10 Mar 2025
- 2023Traffic-Domain Video Question Answering with Automatic Captioning18 Jul 2023
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 539
- 2021Curriculum Learning: A Surveycited by 257
- 2021Uncertainty-Aware Unsupervised Domain Adaptation in Object Detectioncited by 59
- 2023Continual Learning in Linear Classification on Separable Datacited by 33
- 2022The Effect of Task Ordering in Continual Learningcited by 30
- 2023ASP: Learn a Universal Neural Solver!cited by 27
- 2023Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputscited by 22
- 2021Medical Image Segmentation with Limited Supervision: A Review of Deep Network Modelscited by 21
- 2021Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absentcited by 21
- 2023CL-MAE: Curriculum-Learned Masked Autoencoderscited by 21
- 2024CurricuLLM: Automatic Task Curricula Design for Learning Complex Robot Skills using Large Language Modelscited by 20
- 2023Domain Generalization via Balancing Training Difficulty and Model Capabilitycited by 19
12 most cited of 54 All 54 (JSON)
- 2026Convex Dataset Valuation for Post-Training15 May 2026
- 2026ARGUS: Policy-Adaptive Ad Governance via Evolving Reinforcement with Adversarial Umpiring4 May 2026
- 2026Predictive Batch Scheduling: Accelerating Language Model Training Through Loss-Aware Sample Prioritization19 Feb 2026
- 2026Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledge16 Feb 2026
- 2026Interactive LLM-assisted Curriculum Learning for Multi-Task Evolutionary Policy Search11 Feb 2026
- 2026Can Large Language Models Generalize Procedures Across Representations?3 Feb 2026
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection3 Feb 2026
- 2026Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotion1 Feb 2026
- 2025Characterization of Transfer Using Multi-task Learning Curves31 Dec 2025
- 2025Aligning by Misaligning: Boundary-aware Curriculum Learning for Multimodal Alignment11 Nov 2025
- 2025Heterogeneous Adversarial Play in Interactive Environments21 Oct 2025
- 2025RecGPT Technical Report30 Jul 2025
12 newest of 54 All 54 (JSON)