# A Generative Approach to Titling and Clustering Wikipedia Sections

arXiv: https://arxiv.org/abs/2005.11216 · HTML: https://mlsanity.com/paper/2005.11216/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 May 2020.

## Built on by (most cited first, 2 of 2)

- [WikiDes: A Wikipedia-Based Dataset for Generating Short Descriptions from Paragraphs](https://mlsanity.com/paper/2209.13101/) (2022)
- [Descartes: Generating Short Descriptions of Wikipedia Articles](https://mlsanity.com/paper/2205.10012/) (2022)

## Abstract (arXiv)

We evaluate the performance of transformer encoders with various decoders for information organization through a new task: generation of section headings for Wikipedia articles. Our analysis shows that decoders containing attention mechanisms over the encoder output achieve high-scoring results by generating extractive text. In contrast, a decoder without attention better facilitates semantic encoding and can be used to generate section embeddings. We additionally introduce a new loss function, which further encourages the decoder to generate high-quality embeddings.