mlsanityData to 14 Oct 2026

MultiScript30k: Leveraging Multilingual Embeddings to Extend Cross Script Parallel Data

arXiv 2512.11074 ↗First posted 11 Dec 2025cs.CL cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Multi30k is frequently cited in the multimodal machine translation (MMT) literature, offering parallel text data for training and fine-tuning deep learning models. However, it is limited to four languages: Czech, English, French, and German. This restriction has led many researchers to focus their investigations only on these languages. As a result, MMT research on diverse languages has been stalled because the official Multi30k dataset only represents European languages in Latin scripts. Previous efforts to extend Multi30k exist, but the list of supported languages, represented language families, and scripts is still very short. To address these issues, we propose MultiScript30k, a new Multi30k dataset extension for global languages in various scripts, created by translating the English version of Multi30k (Multi30k-En) using NLLB200-3.3B. The dataset consists of over (30000) sentences and provides translations of all sentences in Multi30k-En into Ar, Es, Uk, ZhHans and ZhHant. Similarity analysis shows that Multi30k extension consistently achieves greater than (0.8) cosine similarity and symmetric KL divergence less than (0.000251) for all languages supported except ZhHant which is comparable to the previous Multi30k extensions ArEnMulti30k and Multi30k-Uk. COMETKiwi scores reveal mixed assessments of MultiScript30k as a translation of Multi30k-En in comparison to the related work. ArEnMulti30k scores nearly equal MultiScript30k-Ar, but Multi30k-Uk scores 6.4% greater than MultiScript30k-Uk per split.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 11 Dec 2025.

Builds on

13 of 22 references.

References · 13

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  4. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  5. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  6. 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
  7. 2023Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Taskcited by 88
  8. 2017Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Descriptioncited by 76
  9. 2019Probing the Need for Visual Context in Multimodal Machine Translationcited by 54
  10. 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translationcited by 21
  11. 2023CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translationcited by 14
  12. 2022Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translationcited by 7
1 more
  1. 2024Towards Zero-Shot Multimodal Machine Translationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.