Implementing Deep Learning-Based Approaches for Article Summarization in Indian Languages
Not on the map. Why?
Abstract (arXiv)
The research on text summarization for low-resource Indian languages has been limited due to the availability of relevant datasets. This paper presents a summary of various deep-learning approaches used for the ILSUM 2022 Indic language summarization datasets. The ISUM 2022 dataset consists of news articles written in Indian English, Hindi, and Gujarati respectively, and their ground-truth summarizations. In our work, we explore different pre-trained seq2seq models and fine-tune those with the ILSUM 2022 datasets. In our case, the fine-tuned SoTA PEGASUS model worked the best for English, the fine-tuned IndicBART model with augmented data for Hindi, and again fine-tuned PEGASUS model along with a translation mapping-based approach for Gujarati. Our scores on the obtained inferences were evaluated using ROUGE-1, ROUGE-2, and ROUGE-4 as the evaluation metrics.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 12 Dec 2022.
Builds on
24 of 43 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
12 more
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2020Extractive Summarization as Text Matchingcited by 189
- 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
- 2019Fine-tune BERT for Extractive Summarizationcited by 122
- 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 90
- 2021IndicBART: A Pre-trained Model for Indic Natural Language Generationcited by 39
- 2019Neural Extractive Text Summarization with Syntactic Compressioncited by 36
- 2020Stopwords in Technical Language Processingcited by 29
- 2019Effects of padding on LSTMs and CNNscited by 22
- 2020A Cascade Approach to Neural Abstractive Summarization with Content Selection and Fusioncited by 9
- 2021Counterfactual Maximum Likelihood Estimation for Training Deep Networkscited by 5
- 2021Understanding How Encoder-Decoder Architectures Attendcited by 2
Built on by
Citing papers per year: 2023: 1.
1 paper.