mlsanityData to 7 Oct 2026

A Corpus for Multilingual Document Classification in Eight Languages

arXiv 1805.09821 ↗First posted 24 May 2018cs.CLcited by 42

Not on the map. Why?

Abstract (arXiv)

Cross-lingual document classification aims at training a document classifier on resources in one language and transferring it to a different language without any additional resources. Several approaches have been proposed in the literature and the current best practice is to evaluate them on a subset of the Reuters Corpus Volume 2. However, this subset covers only few languages (English, German, French and Spanish) and almost all published works focus on the the transfer between English and German. In addition, we have observed that the class prior distributions differ significantly between the languages. We argue that this complicates the evaluation of the multilinguality. In this paper, we propose a new subset of the Reuters corpus with balanced class priors for eight languages. By adding Italian, Russian, Japanese and Chinese, we cover languages which are very different with respect to syntax, morphology, etc. We provide strong baselines for all language transfer directions using multilingual word and sentence embeddings respectively. Our goal is to offer a freely available framework to evaluate cross-lingual document classification, and we hope to foster by these means, research in this important area.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 13; 2022: 13; 2023: 8; 2024: 7; 2025: 1.

42 papers.

Sort:

By area:

  1. 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
  2. 2021A Primer on Pretrained Multilingual Language Modelscited by 49
  3. 2021DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendationcited by 46
  4. 2021Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Modelscited by 41
  5. 2021MarIA: Spanish Language Modelscited by 36
  6. 2024AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Modelscited by 29
  7. 2023Taxi1500: A Multilingual Dataset for Text Classification in 1500 Languagescited by 23
  8. 2022EASE: Entity-Aware Contrastive Learning of Sentence Embeddingcited by 21
  9. 2022Multi Task Learning For Zero Shot Performance Prediction of Multilingual Modelscited by 20
  10. 2021Multilingual and cross-lingual document classification: A meta-learning approachcited by 14
  11. 2023Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corporacited by 12
  12. 2021Spanish Legalese Language Model and Corporacited by 11
30 more
  1. 2021X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answeringcited by 10
  2. 2022Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languagescited by 10
  3. 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
  4. 2021A Dataset and Baselines for Multilingual Reply Suggestioncited by 9
  5. 2021Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modelingcited by 8
  6. 2022Lessons learned from the evaluation of Spanish Language Modelscited by 8
  7. 2023T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classificationcited by 8
  8. 2024Understanding the effects of language-specific class imbalance in multilingual fine-tuningcited by 7
  9. 2022ALBETO and DistilBETO: Lightweight Spanish Language Modelscited by 6
  10. 2022Polyglot Prompt: Multilingual Multitask PrompTrainingcited by 6
  11. 2022Synergy with Translation Artifacts for Training and Inference in Multilingual Taskscited by 6
  12. 2021Lightweight Cross-Lingual Sentence Representation Learningcited by 5
  13. 2022RigoBERTa: A State-of-the-Art Language Model For Spanishcited by 5
  14. 2022Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLUcited by 5
  15. 2024Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasetscited by 5
  16. 2025Document Intelligence in the Era of Large Language Models: A Surveycited by 5
  17. 2022Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representationcited by 4
  18. 2024Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switchingcited by 3
  19. 2024AutoML-guided Fusion of Entity and LLM-based Representations for Document Classificationcited by 3
  20. 2021Improving Low-resource Reading Comprehension via Cross-lingual Transposition Rethinkingcited by 2
  21. 2021A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classificationcited by 2
  22. 2022Unsupervised Reinforcement Adaptation for Class-Imbalanced Text Classificationcited by 2
  23. 2022Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twittercited by 2
  24. 2021Combining Deep Generative Models and Multi-lingual Pretraining for Semi-supervised Document Classificationcited by 1
  25. 2022EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learningcited by 1
  26. 2023Are the Best Multilingual Document Embeddings simply Based on Sentence Embeddings?cited by 1
  27. 2023FewShotTextGCN: K-hop neighborhood regularization for few-shot learning on graphscited by 0
  28. 2023A General-Purpose Multilingual Document Encodercited by 0
  29. 2023Leveraging Closed-Access Multilingual Embedding for Automatic Sentence Alignment in Low Resource Languagescited by 0
  30. 2024UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understandingcited by 0