mlsanityData to 7 Oct 2026

Indian Language Summarization using Pretrained Sequence-to-Sequence Models

arXiv 2303.14461 ↗First posted 25 Mar 2023cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

The ILSUM shared task focuses on text summarization for two major Indian languages- Hindi and Gujarati, along with English. In this task, we experiment with various pretrained sequence-to-sequence models to find out the best model for each of the languages. We present a detailed overview of the models and our approaches in this paper. We secure the first rank across all three sub-tasks (English, Hindi and Gujarati). This paper also extensively analyzes the impact of k-fold cross-validation while experimenting with limited data size, and we also perform various experiments with a combination of the original and a filtered version of the data to determine the efficacy of the pretrained models.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 25 Mar 2023.

Builds on

16 of 27 references.

References · 16

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  4. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  5. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  6. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  7. 2015Teaching Machines to Read and Comprehendcited by 1,039
  8. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  9. 2020AdapterHub: A Framework for Adapting Transformerscited by 441
  10. 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 394
  11. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  12. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
4 more
  1. 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 221
  2. 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
  3. 2021Pretrained Language Models for Text Generation: A Surveycited by 95
  4. 2022To Adapt or to Fine-tune: A Case Study on Abstractive Summarizationcited by 2

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 0; 2025: 1.

4 papers.

  1. 2023PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in Indiacited by 11
  2. 2023MILDSum: A Novel Benchmark Dataset for Multilingual Summarization of Indian Legal Case Judgmentscited by 10
  3. 2023Automatic Data Retrieval for Cross Lingual Summarizationcited by 0
  4. 2025ReGal: A First Look at PPO-based Legal AI for Judgment Prediction and Summarization in Indiacited by 0