mlsanityData to 14 Oct 2026

CORI: CJKV Benchmark with Romanization Integration -- A step towards Cross-lingual Transfer Beyond Textual Scripts

arXiv 2404.12618 ↗First posted 19 Apr 2024cs.CL cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Naively assuming English as a source language may hinder cross-lingual transfer for many languages by failing to consider the importance of language contact. Some languages are more well-connected than others, and target languages can benefit from transferring from closely related languages; for many languages, the set of closely related languages does not include English. In this work, we study the impact of source language for cross-lingual transfer, demonstrating the importance of selecting source languages that have high contact with the target language. We also construct a novel benchmark dataset for close contact Chinese-Japanese-Korean-Vietnamese (CJKV) languages to further encourage in-depth studies of language contact. To comprehensively capture contact between these languages, we propose to integrate Romanized transcription beyond textual scripts via Contrastive Learning objectives, leading to enhanced cross-lingual representations and effective zero-shot cross-lingual transfer.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 47 references that are in the map. First posted on arXiv 19 Apr 2024.

Builds on

27 of 47 references.

References · 27

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  6. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
  7. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  8. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
  9. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
  10. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  11. 2020PhoBERT: Pre-trained language models for Vietnamesecited by 149
  12. 2020When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Modelscited by 131
15 more
  1. 2020CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLPcited by 79
  2. 2021ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Informationcited by 65
  3. 2021Consistency Regularization for Cross-Lingual Fine-Tuningcited by 41
  4. 2021Dense Hierarchical Retrieval for Open-Domain Question Answeringcited by 34
  5. 2022Enhancing Cross-lingual Transfer by Manifold Mixupcited by 30
  6. 2020FILTER: An Enhanced Fusion Method for Cross-lingual Language Understandingcited by 29
  7. 2022Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferabilitycited by 26
  8. 2020CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detectioncited by 23
  9. 2023CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Taskscited by 18
  10. 2020Dynamic Semantic Matching and Aggregation Network for Few-shot Intent Detectioncited by 17
  11. 2021Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstructioncited by 13
  12. 2022On the Role of Parallel Data in Cross-lingual Transfer Learningcited by 11
  13. 2023Enhancing Cross-lingual Transfer via Phonemic Transcription Integrationcited by 11
  14. 2023Unifying Speech Enhancement and Separation with Gradient Modulation for End-to-End Noise-Robust Speech Separationcited by 10
  15. 2023Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 3.

4 papers.

  1. 2024Prompting with Phonemes: Enhancing LLMs' Multilinguality for Non-Latin Script Languagescited by 6
  2. 2026Not Truly Multilingual: Script Consistency as a Missing Dimension in VLM Evaluationcited by 0
  3. 2026Beyond 'One Language, One Script': Quantifying Orthographic Bias in Multilingual VLMs with PuMVRcited by 0
  4. 2026CoSE-E: A Benchmark for Code-switched Speech Evaluation in Enterprise Settingscited by 0