mlsanityData to 14 Oct 2026

MACT: Model-Agnostic Cross-Lingual Training for Discourse Representation Structure Parsing

arXiv 2406.01052 ↗First posted 3 Jun 2024cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Discourse Representation Structure (DRS) is an innovative semantic representation designed to capture the meaning of texts with arbitrary lengths across languages. The semantic representation parsing is essential for achieving natural language understanding through logical forms. Nevertheless, the performance of DRS parsing models remains constrained when trained exclusively on monolingual data. To tackle this issue, we introduce a cross-lingual training strategy. The proposed method is model-agnostic yet highly effective. It leverages cross-lingual training data and fully exploits the alignments between languages encoded in pre-trained language models. The experiments conducted on the standard benchmarks demonstrate that models trained using the cross-lingual training method exhibit significant improvements in DRS clause and graph parsing in English, German, Italian and Dutch. Comparing our final models to previous works, we achieve state-of-the-art results in the standard benchmarks. Furthermore, the detailed analysis provides deep insights into the performance of the parsers, offering inspiration for future research in DRS parsing. We keep updating new results on benchmarks to the appendix.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 28 of its 58 references that are in the map. First posted on arXiv 3 Jun 2024.

Builds on

28 of 58 references.

References · 28

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  7. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  8. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  9. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
  10. 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 872
  11. 2021Few-shot Learning with Multilingual Language Modelscited by 278
  12. 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 264
16 more
  1. 2021Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuningcited by 146
  2. 2021Composable Sparse Fine-Tuning for Cross-Lingual Transfercited by 144
  3. 2022mGPT: Few-Shot Learners Go Multilingualcited by 142
  4. 2019Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Taskscited by 96
  5. 201975 Languages, 1 Model: Parsing Universal Dependencies Universallycited by 90
  6. 2022Graph Pre-training for AMR Parsing and Generationcited by 55
  7. 2017The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representationscited by 42
  8. 2017Cross-lingual Abstract Meaning Representation Parsingcited by 19
  9. 2021Zero-Shot Cross-lingual Semantic Parsingcited by 19
  10. 2018Exploring Neural Methods for Parsing Discourse Representation Structurescited by 15
  11. 2014Cross-lingual Annotation Projection for Semantic Rolescited by 11
  12. 2018Evaluating Scoped Meaning Representationscited by 11
  13. 2023Pre-Trained Language-Meaning Models for Multilingual Parsing and Generationcited by 10
  14. 2018Parameter sharing between dependency parsers for related languagescited by 5
  15. 2023XSemPLR: Cross-Lingual Semantic Parsing in Multiple Natural Languages and Meaning Representationscited by 5
  16. 2015One model, two languages: training bilingual parsers with harmonized treebankscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.