Curriculum Learning for Domain Adaptation in Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
We introduce a curriculum learning approach to adapt generic neural machine translation models to a specific domain. Samples are grouped by their similarities to the domain of interest and each group is fed to the training algorithm with a particular schedule. This approach is simple to implement on top of any neural framework or architecture, and consistently outperforms both unadapted and adapted baselines in experiments with two distinct domains and two language pairs.
Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 10; 2023: 15; 2024: 6; 2025: 2; 2026: 5.
59 papers.
Sort:
By area:
- 2021Curriculum Learning: A Surveycited by 259
- 2022Efficient Methods for Natural Language Processing: A Surveycited by 78
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2024Curry-DPO: Enhancing Alignment using Curriculum Learning & Ranked Preferencescited by 39
- 2021The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Modelscited by 36
- 2021Does the Order of Training Samples Matter? Improving Neural Data-to-Text Generation with Curriculum Learningcited by 34
- 2021Prevent the Language Model from being Overconfident in Neural Machine Translationcited by 34
- 2021NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Frameworkcited by 34
- 2021Curriculum learning for language modelingcited by 32
- 2021Meta-Curriculum Learning for Domain Adaptation in Neural Machine Translationcited by 28
- 2021An Analytical Theory of Curriculum Learning in Teacher-Student Networkscited by 27
- 2023CiT: Curation in Training for Effective Vision-Language Datacited by 27
38 more
- 2021Progressive Multi-Granularity Training for Non-Autoregressive Translationcited by 25
- 2021Gradual Fine-Tuning for Low-Resource Domain Adaptationcited by 24
- 2021Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absentcited by 21
- 2021Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translationcited by 15
- 2022DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routingcited by 13
- 2023Curricular Object Manipulation in LiDAR-based Object Detectioncited by 12
- 2021Improving Both Domain Robustness and Domain Adaptability in Machine Translationcited by 11
- 2021Towards User-Driven Neural Machine Translationcited by 10
- 2021Self-Guided Curriculum Learning for Neural Machine Translationcited by 9
- 2022When Do Curricula Work in Federated Learning?cited by 9
- 2021NVIDIA NeMo Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21cited by 8
- 2024To Label or Not to Label: Hybrid Active Learning for Neural Machine Translationcited by 8
- 2023Curriculum-Based Augmented Fourier Domain Adaptation for Robust Medical Image Segmentationcited by 7
- 2021Exploiting Curriculum Learning in Unsupervised Neural Machine Translationcited by 6
- 2023Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systemscited by 6
- 2023Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Modelscited by 6
- 2022Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLUcited by 5
- 2023Mitigating Data Imbalance and Representation Degeneration in Multilingual Machine Translationcited by 5
- 2021Token-wise Curriculum Learning for Neural Machine Translationcited by 4
- 2022Cyclical Curriculum Learningcited by 4
- 2022In-sample Curriculum Learning by Sequence Completion for Natural Language Generationcited by 4
- 2022CLID: Controlled-Length Image Descriptions with Limited Datacited by 4
- 2024Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Taskcited by 4
- 2023Ling-CL: Understanding NLP Models through Linguistic Curriculacited by 3
- 2023Complexity-Guided Curriculum Learning for Text Graphscited by 3
- 2025Teaching with Lies: Curriculum DPO on Synthetic Negatives for Hallucination Detectioncited by 3
- 2023Curriculum Learning for Graph Neural Networks: A Multiview Competence-based Approachcited by 2
- 2023Curriculum Guided Domain Adaptation in the Darkcited by 2
- 2023Harnessing Dataset Cartography for Improved Compositional Generalization in Transformerscited by 2
- 2021Statistical Measures For Defining Curriculum Scoring Functioncited by 1
- 2021Learning Policies for Multilingual Training of Neural Machine Translation Systemscited by 1
- 2022Progressive Sentiment Analysis for Code-Switched Text Datacited by 1
- 2022Confidence-Aware Paced-Curriculum Learning by Label Smoothing for Surgical Scene Understandingcited by 1
- 2023HuCurl: Human-induced Curriculum Discoverycited by 1
- 2023Simple and Effective Input Reformulations for Translationcited by 1
- 2024HW-TSC's Submission to the CCMT 2024 Machine Translation Taskscited by 1
- 2022Finding the Right Recipe for Low Resource Domain Adaptation in Neural Machine Translationcited by 0
- 2023Epi-Curriculum: Episodic Curriculum Learning for Low-Resource Domain Adaptation in Neural Machine Translationcited by 0
50 most cited of 59 All 59 (JSON)
- 2026Dual-Stream Simultaneous Translation via 2D Grid Attention28 Sep 2026
- 2026Towards Eliminating Catastrophic Forgetting in the Curriculum Learning of Math Reasoning Tasks27 Sep 2026
- 2026Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomy21 Jul 2026
- 2026Leveraging Audio-LLMs to Filter Speech-to-Speech Training Data11 Jun 2026
- 2026Data Kernel Perspective Space Performance Guarantees for Synthetic Data from Transformer Models4 Feb 2026
- 2025Teaching with Lies: Curriculum DPO on Synthetic Negatives for Hallucination Detection23 May 2025
- 2025PMG: Progressive Motion Generation via Sparse Anchor Postures Curriculum Learning23 Apr 2025
- 2024TPCL: Task Progressive Curriculum Learning for Robust Visual Question Answering26 Nov 2024
- 2024Machine Translation Advancements of Low-Resource Indian Languages by Transfer Learning24 Sep 2024
- 2024HW-TSC's Submission to the CCMT 2024 Machine Translation Tasks23 Sep 2024
- 2024Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task23 Sep 2024
- 2024To Label or Not to Label: Hybrid Active Learning for Neural Machine Translation14 Mar 2024
38 more
- 2024Curry-DPO: Enhancing Alignment using Curriculum Learning & Ranked Preferences12 Mar 2024
- 2023Complexity-Guided Curriculum Learning for Text Graphs22 Nov 2023
- 2023Simple and Effective Input Reformulations for Translation12 Nov 2023
- 2023Ling-CL: Understanding NLP Models through Linguistic Curricula31 Oct 2023
- 2023Harnessing Dataset Cartography for Improved Compositional Generalization in Transformers18 Oct 2023
- 2023Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Models2 Oct 2023
- 2023Using Weak Supervision and Data Augmentation in Question Answering28 Sep 2023
- 2023Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systems27 Sep 2023
- 2023Epi-Curriculum: Episodic Curriculum Learning for Low-Resource Domain Adaptation in Neural Machine Translation6 Sep 2023
- 2023Curriculum Guided Domain Adaptation in the Dark2 Aug 2023
- 2023Curriculum Learning for Graph Neural Networks: A Multiview Competence-based Approach17 Jul 2023
- 2023HuCurl: Human-induced Curriculum Discovery14 Jul 2023
- 2023Curriculum-Based Augmented Fourier Domain Adaptation for Robust Medical Image Segmentation6 Jun 2023
- 2023Mitigating Data Imbalance and Representation Degeneration in Multilingual Machine Translation22 May 2023
- 2023Curricular Object Manipulation in LiDAR-based Object Detection9 Apr 2023
- 2023CiT: Curation in Training for Effective Vision-Language Data5 Jan 2023
- 2022When Do Curricula Work in Federated Learning?24 Dec 2022
- 2022Confidence-Aware Paced-Curriculum Learning by Label Smoothing for Surgical Scene Understanding22 Dec 2022
- 2022DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing7 Dec 2022
- 2022CLID: Controlled-Length Image Descriptions with Limited Data27 Nov 2022
- 2022In-sample Curriculum Learning by Sequence Completion for Natural Language Generation21 Nov 2022
- 2022Progressive Sentiment Analysis for Code-Switched Text Data25 Oct 2022
- 2022Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLU22 Oct 2022
- 2022Efficient Methods for Natural Language Processing: A Survey31 Aug 2022
- 2022Finding the Right Recipe for Low Resource Domain Adaptation in Neural Machine Translation2 Jun 2022
- 2022Cyclical Curriculum Learning11 Feb 2022
- 2021Improving Both Domain Robustness and Domain Adaptability in Machine Translation15 Dec 2021
- 2021NVIDIA NeMo Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT2116 Nov 2021
- 2021NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework7 Nov 2021
- 2021Exploiting Curriculum Learning in Unsupervised Neural Machine Translation23 Sep 2021
- 2021The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models13 Aug 2021
- 2021Curriculum learning for language modeling4 Aug 2021
- 2021An Analytical Theory of Curriculum Learning in Teacher-Student Networks15 Jun 2021
- 2021Towards User-Driven Neural Machine Translation11 Jun 2021
- 2021Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absent10 Jun 2021
- 2021Progressive Multi-Granularity Training for Non-Autoregressive Translation10 Jun 2021
- 2021Prevent the Language Model from being Overconfident in Neural Machine Translation24 May 2021
- 2021Self-Guided Curriculum Learning for Neural Machine Translation10 May 2021
50 newest of 59 All 59 (JSON)
- 2023CiT: Curation in Training for Effective Vision-Language Datacited by 27
- 2021Curriculum Learning: A Surveycited by 259
- 2022Efficient Methods for Natural Language Processing: A Surveycited by 78
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Modelscited by 36
- 2021Does the Order of Training Samples Matter? Improving Neural Data-to-Text Generation with Curriculum Learningcited by 34
- 2021Prevent the Language Model from being Overconfident in Neural Machine Translationcited by 34
- 2021NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Frameworkcited by 34
- 2021Curriculum learning for language modelingcited by 32
- 2021Meta-Curriculum Learning for Domain Adaptation in Neural Machine Translationcited by 28
- 2021Progressive Multi-Granularity Training for Non-Autoregressive Translationcited by 25
- 2021Gradual Fine-Tuning for Low-Resource Domain Adaptationcited by 24
- 2021Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absentcited by 21
12 most cited of 53 All 53 (JSON)
- 2026Dual-Stream Simultaneous Translation via 2D Grid Attention28 Sep 2026
- 2026Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomy21 Jul 2026
- 2026Leveraging Audio-LLMs to Filter Speech-to-Speech Training Data11 Jun 2026
- 2025PMG: Progressive Motion Generation via Sparse Anchor Postures Curriculum Learning23 Apr 2025
- 2024TPCL: Task Progressive Curriculum Learning for Robust Visual Question Answering26 Nov 2024
- 2024Machine Translation Advancements of Low-Resource Indian Languages by Transfer Learning24 Sep 2024
- 2024HW-TSC's Submission to the CCMT 2024 Machine Translation Tasks23 Sep 2024
- 2024Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task23 Sep 2024
- 2024To Label or Not to Label: Hybrid Active Learning for Neural Machine Translation14 Mar 2024
- 2023Complexity-Guided Curriculum Learning for Text Graphs22 Nov 2023
- 2023Simple and Effective Input Reformulations for Translation12 Nov 2023
- 2023Ling-CL: Understanding NLP Models through Linguistic Curricula31 Oct 2023
12 newest of 53 All 53 (JSON)