Scheduled Multi-Task Learning: From Syntax to Translation
Not on the map. Why?
Abstract (arXiv)
Neural encoder-decoder models of machine translation have achieved impressive results, while learning linguistic knowledge of both the source and target languages in an implicit end-to-end manner. We propose a framework in which our model begins learning syntax and translation interleaved, gradually putting more focus on translation. Using this approach, we achieve considerable improvements in terms of BLEU score on relatively large parallel corpus (WMT14 English to German) and a low-resource (WIT German to English) setup.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 5; 2023: 3; 2024: 1; 2025: 0; 2026: 1.
18 papers.
Sort:
- 2021Syntax-BERT: Improving Pre-trained Transformers with Syntax Treescited by 51
- 2021Improving Multilingual Translation by Representation and Gradient Regularizationcited by 31
- 2021Specializing Multilingual Language Models: An Empirical Studycited by 21
- 2023Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflictscited by 21
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
- 2022Exploring the Role of Task Transferability in Large-Scale Multi-Task Learningcited by 17
- 2021Meta-Learning for Effective Multi-task and Multilingual Modellingcited by 13
- 2021Balancing Average and Worst-case Accuracy in Multitask Learningcited by 10
- 2021Training multi-objective/multi-task collocation physics-informed neural network with student/teachers transfer learningscited by 9
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matchingcited by 9
- 2022Let the Model Decide its Curriculum for Multitask Learningcited by 8
- 2021Not All Linearizations Are Equally Data-Hungry in Sequence Labeling Parsingcited by 7
6 more
- 2022Ultra Fast Speech Separation Model with Teacher Student Learningcited by 3
- 2023Hexatagging: Projective Dependency Parsing as Taggingcited by 3
- 2023Linear-Time Modeling of Linguistic Structure: An Order-Theoretic Perspectivecited by 2
- 2021CUNI systems for WMT21: Multilingual Low-Resource Translation for Indo-European Languages Shared Taskcited by 1
- 2022On Parsing as Taggingcited by 0
- 2026Top-down string-to-dependency Neural Machine Translationcited by 0
- 2026Top-down string-to-dependency Neural Machine Translation30 Mar 2026
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matching10 Dec 2024
- 2023Hexatagging: Projective Dependency Parsing as Tagging8 Jun 2023
- 2023Linear-Time Modeling of Linguistic Structure: An Order-Theoretic Perspective24 May 2023
- 2023Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflicts24 Feb 2023
- 2022On Parsing as Tagging14 Nov 2022
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion16 Oct 2022
- 2022Let the Model Decide its Curriculum for Multitask Learning19 May 2022
- 2022Ultra Fast Speech Separation Model with Teacher Student Learning27 Apr 2022
- 2022Exploring the Role of Task Transferability in Large-Scale Multi-Task Learning23 Apr 2022
- 2021Balancing Average and Worst-case Accuracy in Multitask Learning12 Oct 2021
- 2021CUNI systems for WMT21: Multilingual Low-Resource Translation for Indo-European Languages Shared Task20 Sep 2021
6 more
- 2021Improving Multilingual Translation by Representation and Gradient Regularization10 Sep 2021
- 2021Not All Linearizations Are Equally Data-Hungry in Sequence Labeling Parsing17 Aug 2021
- 2021Training multi-objective/multi-task collocation physics-informed neural network with student/teachers transfer learnings24 Jul 2021
- 2021Specializing Multilingual Language Models: An Empirical Study16 Jun 2021
- 2021Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees7 Mar 2021
- 2021Meta-Learning for Effective Multi-task and Multilingual Modelling25 Jan 2021
- 2021Syntax-BERT: Improving Pre-trained Transformers with Syntax Treescited by 51
- 2021Improving Multilingual Translation by Representation and Gradient Regularizationcited by 31
- 2021Specializing Multilingual Language Models: An Empirical Studycited by 21
- 2023Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflictscited by 21
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
- 2022Exploring the Role of Task Transferability in Large-Scale Multi-Task Learningcited by 17
- 2021Meta-Learning for Effective Multi-task and Multilingual Modellingcited by 13
- 2021Balancing Average and Worst-case Accuracy in Multitask Learningcited by 10
- 2021Training multi-objective/multi-task collocation physics-informed neural network with student/teachers transfer learningscited by 9
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matchingcited by 9
- 2022Let the Model Decide its Curriculum for Multitask Learningcited by 8
- 2021Not All Linearizations Are Equally Data-Hungry in Sequence Labeling Parsingcited by 7
12 most cited of 18 All 18 (JSON)
- 2026Top-down string-to-dependency Neural Machine Translation30 Mar 2026
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matching10 Dec 2024
- 2023Hexatagging: Projective Dependency Parsing as Tagging8 Jun 2023
- 2023Linear-Time Modeling of Linguistic Structure: An Order-Theoretic Perspective24 May 2023
- 2023Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflicts24 Feb 2023
- 2022On Parsing as Tagging14 Nov 2022
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion16 Oct 2022
- 2022Let the Model Decide its Curriculum for Multitask Learning19 May 2022
- 2022Ultra Fast Speech Separation Model with Teacher Student Learning27 Apr 2022
- 2022Exploring the Role of Task Transferability in Large-Scale Multi-Task Learning23 Apr 2022
- 2021Balancing Average and Worst-case Accuracy in Multitask Learning12 Oct 2021
- 2021CUNI systems for WMT21: Multilingual Low-Resource Translation for Indo-European Languages Shared Task20 Sep 2021
12 newest of 18 All 18 (JSON)