# Overview and Results: CL-SciSumm Shared Task 2019

arXiv: https://arxiv.org/abs/1907.09854 · HTML: https://mlsanity.com/paper/1907.09854/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Jul 2019.

## Built on by (most cited first, 7 of 7)

- [MS2: Multi-Document Summarization of Medical Studies](https://mlsanity.com/paper/2104.06486/) (2021)
- [CSFCube -- A Test Collection of Computer Science Research Articles for Faceted Query by Example](https://mlsanity.com/paper/2103.12906/) (2021)
- [X-SCITLDR: Cross-Lingual Extreme Summarization of Scholarly Documents](https://mlsanity.com/paper/2205.15051/) (2022)
- [Towards AI-Assisted Research Writing: Benchmarking LLMs for AI/ML Introduction Generation](https://mlsanity.com/paper/2508.14273/) (2025)
- [Generalising Multilingual Concept-to-Text NLG with Language Agnostic Delexicalisation](https://mlsanity.com/paper/2105.03432/) (2021)
- [Generating Summaries for Scientific Paper Review](https://mlsanity.com/paper/2109.14059/) (2021)
- [VerbCL: A Dataset of Verbatim Quotes for Highlight Extraction in Case Law](https://mlsanity.com/paper/2108.10120/) (2021)

## Abstract (arXiv)

The CL-SciSumm Shared Task is the first medium-scale shared task on scientific document summarization in the computational linguistics~(CL) domain. In 2019, it comprised three tasks: (1A) identifying relationships between citing documents and the referred document, (1B) classifying the discourse facets, and (2) generating the abstractive summary. The dataset comprised 40 annotated sets of citing and reference papers of the CL-SciSumm 2018 corpus and 1000 more from the SciSummNet dataset. All papers are from the open access research papers in the CL domain. This overview describes the participation and the official results of the CL-SciSumm 2019 Shared Task, organized as a part of the 42nd Annual Conference of the Special Interest Group in Information Retrieval (SIGIR), held in Paris, France in July 2019. We compare the participating systems in terms of two evaluation metrics and discuss the use of ROUGE as an evaluation metric. The annotated dataset used for this shared task and the scripts used for evaluation can be accessed and used by the community at: https://github.com/WING-NUS/scisumm-corpus.