# Unsupervised Abstractive Summarization of Bengali Text Documents

arXiv: https://arxiv.org/abs/2102.04490 · HTML: https://mlsanity.com/paper/2102.04490/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 32 references that are in the map.
- First posted on arXiv 26 Jan 2021.

## Builds on (most cited first, 7 of 7)

- [Neural Machine Translation by Jointly Learning to Align and Translate](https://mlsanity.com/paper/1409.0473/) (2014)
- [Effective Approaches to Attention-based Neural Machine Translation](https://mlsanity.com/paper/1508.04025/) (2015)
- [Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyond](https://mlsanity.com/paper/1602.06023/) (2016)
- [A Neural Attention Model for Abstractive Sentence Summarization](https://mlsanity.com/paper/1509.00685/) (2015)
- [A Deep Reinforced Model for Abstractive Summarization](https://mlsanity.com/paper/1705.04304/) (2017)
- [Language as a Latent Variable: Discrete Generative Models for Sentence Compression](https://mlsanity.com/paper/1609.07317/) (2016)
- [Extract with Order for Coherent Multi-Document Summarization](https://mlsanity.com/paper/1706.06542/) (2017)

## Built on by (most cited first, 9 of 9)

- [BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP](https://mlsanity.com/paper/2309.13173/) (2023)
- [XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags](https://mlsanity.com/paper/2406.03776/) (2024)
- [Bangla Natural Language Processing: A Comprehensive Analysis of Classical, Machine Learning, and Deep Learning Based Methods](https://mlsanity.com/paper/2105.14875/) (2021)
- [eC-Tab2Text: Aspect-Based Text Generation from e-Commerce Product Tables](https://mlsanity.com/paper/2502.14820/) (2025)
- [BanglaSummEval: Reference-Free Factual Consistency Evaluation for Bangla Summarization](https://mlsanity.com/paper/2602.16843/) (2026)
- [An Overview of Indian Language Datasets used for Text Summarization](https://mlsanity.com/paper/2203.16127/) (2022)
- [GAE-ISumm: Unsupervised Graph-Based Summarization of Indian Languages](https://mlsanity.com/paper/2212.12937/) (2022)
- [A Novel Word Pair-based Gaussian Sentence Similarity Algorithm For Bengali Extractive Text Summarization](https://mlsanity.com/paper/2411.17181/) (2024)
- [SinBrief: A Hybrid Framework for Abstractive Text Summarisation of Sinhala Legal Documents](https://mlsanity.com/paper/2609.32397/) (2026)

## Abstract (arXiv)

Abstractive summarization systems generally rely on large collections of document-summary pairs. However, the performance of abstractive systems remains a challenge due to the unavailability of parallel data for low-resource languages like Bengali. To overcome this problem, we propose a graph-based unsupervised abstractive summarization system in the single-document setting for Bengali text documents, which requires only a Part-Of-Speech (POS) tagger and a pre-trained language model trained on Bengali texts. We also provide a human-annotated dataset with document-summary pairs to evaluate our abstractive model and to support the comparison of future abstractive summarization systems of the Bengali Language. We conduct experiments on this dataset and compare our system with several well-established unsupervised extractive summarization systems. Our unsupervised abstractive summarization model outperforms the baselines without being exposed to any human-annotated reference summaries.