mlsanityData to 14 Oct 2026

Polyglot Contextual Representations Improve Crosslingual Transfer

arXiv 1902.09697 ↗First posted 26 Feb 2019cs.CLcited by 16

Not on the map. Why?

Abstract (arXiv)

We introduce Rosita, a method to produce multilingual contextual word representations by training a single language model on text from multiple languages. Our method combines the advantages of contextual word representations with those of multilingual representation learning. We produce language models from dissimilar language pairs (English/Arabic and English/Chinese) and use them in dependency parsing, semantic role labeling, and named entity recognition, with comparisons to monolingual and non-contextual variants. Our results provide further evidence for the benefits of polyglot learning, in which representations are shared across multiple languages.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Feb 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 8; 2022: 2; 2023: 1; 2024: 3; 2025: 2.

16 papers.

Sort:

By area:

  1. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
  2. 2023Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinationscited by 63
  3. 2021One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrievalcited by 46
  4. 2021MURAL: Multimodal, Multitask Retrieval Across Languagescited by 44
  5. 2024Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignmentcited by 26
  6. 2021PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretrainingcited by 21
  7. 2021Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triplescited by 13
  8. 2021Soft Layer Selection with Meta-Learning for Zero-Shot Cross-Lingual Transfercited by 5
  9. 2021Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsingcited by 5
  10. 2021On the Relation between Syntactic Divergence and Zero-Shot Performancecited by 4
  11. 2021Cross-lingual Transferring of Pre-trained Contextualized Language Modelscited by 3
  12. 2024Self-Translate-Train: Enhancing Cross-Lingual Transfer of Large Language Models via Inherent Capabilitycited by 3
4 more
  1. 2022A Knowledge-Enhanced Adversarial Model for Cross-lingual Structured Sentiment Analysiscited by 0
  2. 2024A survey of neural-network-based methods utilising comparable data for finding translation equivalentscited by 0
  3. 2025Can MLLMs Generalize to Multi-Party dialog? Exploring Multilingual Response Generation in Complex Scenarioscited by 0
  4. 2025EDU-NER-2025: Named Entity Recognition in Urdu Educational Texts using XLM-RoBERTa with X (formerly Twitter)cited by 0