Learning the Curriculum with Bayesian Optimization for Task-Specific Word Representation Learning
Not on the map. Why?
Abstract (arXiv)
We use Bayesian optimization to learn curricula for word representation learning, optimizing performance on downstream tasks that depend on the learned representations as features. The curricula are modeled by a linear ranking function which is the scalar product of a learned weight vector and an engineered feature vector that characterizes the different aspects of the complexity of each instance in the training corpus. We show that learning the curriculum improves performance on a variety of downstream tasks over random orders and in comparison to the natural corpus order.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 3; 2024: 5; 2025: 3; 2026: 1.
22 papers.
Sort:
- 2021Curriculum Learning: A Surveycited by 257
- 2021Few-Shot Text Classification with Triplet Networks, Data Augmentation, and Curriculum Learningcited by 35
- 2023Efficient Continual Pre-training for Building Domain Specific Large Language Modelscited by 33
- 2022The Effect of Task Ordering in Continual Learningcited by 30
- 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimizationcited by 15
- 2022PCC: Paraphrasing with Bottom-k Sampling and Cyclic Learning for Curriculum Data Augmentationcited by 14
- 2022Data Selection Curriculum for Neural Machine Translationcited by 11
- 2024From Easy to Hard: Progressive Active Learning Framework for Infrared Small Target Detection with Single Point Supervisioncited by 10
- 2024Effective Generative AI: The Human-Algorithm Centaurcited by 8
- 2023Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systemscited by 6
- 2024A Psychology-based Unified Dynamic Framework for Curriculum Learningcited by 6
- 2022Self-directed Machine Learningcited by 3
10 more
- 2022Using Paraphrases to Study Properties of Contextual Embeddingscited by 3
- 2025Understanding Complexity in VideoQA via Visual Program Generationcited by 3
- 2021Analyzing Curriculum Learning for Sentiment Analysis along Task Difficulty, Pacing and Visualization Axescited by 2
- 2024Understanding the Training Speedup from Sampling with Approximate Lossescited by 2
- 2021Curriculum generation using Autoencoder based continuous optimizationcited by 0
- 2023Divergence-Based Domain Transferability for Zero-Shot Classificationcited by 0
- 2024CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Communitycited by 0
- 2025Prototype-Guided Curriculum Learning for Zero-Shot Learningcited by 0
- 2025Beyond Repetition: Text Simplification and Curriculum Learning for Data-Constrained Pretrainingcited by 0
- 2026Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomycited by 0
- 2026Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomy21 Jul 2026
- 2025Beyond Repetition: Text Simplification and Curriculum Learning for Data-Constrained Pretraining29 Sep 2025
- 2025Prototype-Guided Curriculum Learning for Zero-Shot Learning11 Aug 2025
- 2025Understanding Complexity in VideoQA via Visual Program Generation19 May 2025
- 2024From Easy to Hard: Progressive Active Learning Framework for Infrared Small Target Detection with Single Point Supervision15 Dec 2024
- 2024A Psychology-based Unified Dynamic Framework for Curriculum Learning9 Aug 2024
- 2024CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community9 Jul 2024
- 2024Effective Generative AI: The Human-Algorithm Centaur16 Jun 2024
- 2024Understanding the Training Speedup from Sampling with Approximate Losses10 Feb 2024
- 2023Efficient Continual Pre-training for Building Domain Specific Large Language Models14 Nov 2023
- 2023Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systems27 Sep 2023
- 2023Divergence-Based Domain Transferability for Zero-Shot Classification11 Feb 2023
10 more
- 2022PCC: Paraphrasing with Bottom-k Sampling and Cyclic Learning for Curriculum Data Augmentation17 Aug 2022
- 2022Using Paraphrases to Study Properties of Contextual Embeddings12 Jul 2022
- 2022The Effect of Task Ordering in Continual Learning26 May 2022
- 2022Data Selection Curriculum for Neural Machine Translation25 Mar 2022
- 2022Self-directed Machine Learning4 Jan 2022
- 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimization14 Sep 2021
- 2021Curriculum generation using Autoencoder based continuous optimization16 Jun 2021
- 2021Few-Shot Text Classification with Triplet Networks, Data Augmentation, and Curriculum Learning12 Mar 2021
- 2021Analyzing Curriculum Learning for Sentiment Analysis along Task Difficulty, Pacing and Visualization Axes19 Feb 2021
- 2021Curriculum Learning: A Survey25 Jan 2021
- 2021Curriculum Learning: A Surveycited by 257
- 2021Few-Shot Text Classification with Triplet Networks, Data Augmentation, and Curriculum Learningcited by 35
- 2023Efficient Continual Pre-training for Building Domain Specific Large Language Modelscited by 33
- 2022The Effect of Task Ordering in Continual Learningcited by 30
- 2021Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimizationcited by 15
- 2022PCC: Paraphrasing with Bottom-k Sampling and Cyclic Learning for Curriculum Data Augmentationcited by 14
- 2022Data Selection Curriculum for Neural Machine Translationcited by 11
- 2024From Easy to Hard: Progressive Active Learning Framework for Infrared Small Target Detection with Single Point Supervisioncited by 10
- 2024Effective Generative AI: The Human-Algorithm Centaurcited by 8
- 2023Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systemscited by 6
- 2024A Psychology-based Unified Dynamic Framework for Curriculum Learningcited by 6
- 2022Self-directed Machine Learningcited by 3
12 most cited of 22 All 22 (JSON)
- 2026Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomy21 Jul 2026
- 2025Beyond Repetition: Text Simplification and Curriculum Learning for Data-Constrained Pretraining29 Sep 2025
- 2025Prototype-Guided Curriculum Learning for Zero-Shot Learning11 Aug 2025
- 2025Understanding Complexity in VideoQA via Visual Program Generation19 May 2025
- 2024From Easy to Hard: Progressive Active Learning Framework for Infrared Small Target Detection with Single Point Supervision15 Dec 2024
- 2024A Psychology-based Unified Dynamic Framework for Curriculum Learning9 Aug 2024
- 2024CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community9 Jul 2024
- 2024Effective Generative AI: The Human-Algorithm Centaur16 Jun 2024
- 2024Understanding the Training Speedup from Sampling with Approximate Losses10 Feb 2024
- 2023Efficient Continual Pre-training for Building Domain Specific Large Language Models14 Nov 2023
- 2023Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systems27 Sep 2023
- 2023Divergence-Based Domain Transferability for Zero-Shot Classification11 Feb 2023
12 newest of 22 All 22 (JSON)