mlsanityData to 14 Oct 2026

PAD: Towards Efficient Data Generation for Transfer Learning Using Phrase Alignment

arXiv 2503.18250 ↗First posted 24 Mar 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Transfer learning leverages the abundance of English data to address the scarcity of resources in modeling non-English languages, such as Korean. In this study, we explore the potential of Phrase Aligned Data (PAD) from standardized Statistical Machine Translation (SMT) to enhance the efficiency of transfer learning. Through extensive experiments, we demonstrate that PAD synergizes effectively with the syntactic characteristics of the Korean language, mitigating the weaknesses of SMT and significantly improving model performance. Moreover, we reveal that PAD complements traditional data construction methods and enhances their effectiveness when combined. This innovative approach not only boosts model performance but also suggests a cost-efficient solution for resource-scarce languages.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 19 references that are in the map. First posted on arXiv 24 Mar 2025.

Builds on

11 of 19 references.

References · 11

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  3. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  4. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
  5. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  6. 2021Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Littlecited by 177
  7. 2022mGPT: Few-Shot Learners Go Multilingualcited by 142
  8. 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 125
  9. 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
  10. 2021KLUE: Korean Language Understanding Evaluationcited by 114
  11. 2024Does Incomplete Syntax Influence Korean Language Model? Focusing on Word Order and Case Markerscited by 6

Built on by

Not cited yet.