mlsanityData to 7 Oct 2026

WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization

arXiv 2010.03093 ↗First posted 7 Oct 2020cs.CLcited by 154

Not on the map. Why?

Abstract (arXiv)

We introduce WikiLingua, a large-scale, multilingual dataset for the evaluation of crosslingual abstractive summarization systems. We extract article and summary pairs in 18 languages from WikiHow, a high quality, collaborative resource of how-to guides on a diverse set of topics written by human authors. We create gold-standard article-summary alignments across languages by aligning the images that are used to describe each how-to step in an article. As a set of baselines for further studies, we evaluate the performance of existing cross-lingual abstractive summarization methods on our dataset. We further propose a method for direct crosslingual summarization (i.e., without requiring translation at inference time) by leveraging synthetic data and Neural Machine Translation as a pre-training step. Our method significantly outperforms the baseline approaches, while being more cost efficient during inference.

Key facts. Cited by 154 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Oct 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 23; 2022: 39; 2023: 32; 2024: 31; 2025: 20; 2026: 9.

154 papers.

Sort:

By area:

  1. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  2. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  3. 2023A Survey of Large Language Modelscited by 2,537
  4. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  5. 2023PaLM 2 Technical Reportcited by 1,154
  6. 2023Scaling Data-Constrained Language Modelscited by 391
  7. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
  8. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  9. 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
  10. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
  11. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  12. 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
38 more
  1. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  2. 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
  3. 2024ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabiccited by 87
  4. 2023TrueTeacher: Learning Factual Consistency Evaluation with Large Language Modelscited by 82
  5. 2021Scalable and Efficient MoE Training for Multitask Multilingual Modelscited by 76
  6. 2021AraT5: Text-to-Text Transformers for Arabic Language Generationcited by 63
  7. 2022Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generationcited by 62
  8. 2021DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoderscited by 50
  9. 2021Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarizationcited by 50
  10. 2022IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languagescited by 42
  11. 2023SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluationcited by 42
  12. 2021MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairscited by 41
  13. 2021CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairscited by 39
  14. 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 39
  15. 2022Two-stage LLM Fine-tuning with Less Specialization and More Generalizationcited by 39
  16. 2022A Survey on Cross-Lingual Summarizationcited by 38
  17. 2022NusaCrowd: Open Source Initiative for Indonesian NLP Resourcescited by 38
  18. 2022ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generationcited by 37
  19. 2022Models and Datasets for Cross-Lingual Summarisationcited by 36
  20. 2022GEMv2: Multilingual NLG Benchmarking in a Single Line of Codecited by 36
  21. 2021Goal-Oriented Script Constructioncited by 30
  22. 2022Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarizationcited by 29
  23. 2025How Reliable is Multilingual LLM-as-a-Judge?cited by 29
  24. 2023Efficiently Adapting Pretrained Language Models To New Languagescited by 28
  25. 2024Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once?cited by 28
  26. 2023Revisiting non-English Text Simplification: A Unified Multilingual Benchmarkcited by 27
  27. 2024Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignmentcited by 26
  28. 2022ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarizationcited by 25
  29. 2024MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignmentcited by 25
  30. 2021ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language Generationcited by 23
  31. 2021MTG: A Benchmark Suite for Multilingual Text Generationcited by 22
  32. 2021Improving Neural Cross-Lingual Summarization via Employing Optimal Transport Distance for Knowledge Distillationcited by 22
  33. 2023Why Does Zero-Shot Cross-Lingual Generation Fail? An Explanation and a Solutioncited by 22
  34. 2021nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models?cited by 21
  35. 2022GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminatorcited by 20
  36. 2024Data Contamination Report from the 2024 CONDA Shared Taskcited by 19
  37. 2021Automatic Construction of Evaluation Suites for Natural Language Generation Datasetscited by 18
  38. 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Datacited by 17

50 most cited of 154 All 154 (JSON)