mlsanityData to 7 Oct 2026

Responsible AI Considerations in Text Summarization Research: A Review of Current Practices

arXiv 2311.11103 ↗First posted 18 Nov 2023cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

AI and NLP publication venues have increasingly encouraged researchers to reflect on possible ethical considerations, adverse impacts, and other responsible AI issues their work might engender. However, for specific NLP tasks our understanding of how prevalent such issues are, or when and why these issues are likely to arise, remains limited. Focusing on text summarization -- a common NLP task largely overlooked by the responsible AI community -- we examine research and reporting practices in the current literature. We conduct a multi-round qualitative analysis of 333 summarization papers from the ACL Anthology published between 2020-2022. We focus on how, which, and when responsible AI issues are covered, which relevant stakeholders are considered, and mismatches between stated and realized research goals. We also discuss current evaluation practices and consider how authors discuss the limitations of both prior work and their own work. Overall, we find that relatively few papers engage with possible stakeholders or contexts of use, which limits their consideration of potential downstream adverse impacts or other responsible AI issues. Based on our findings, we make recommendations on concrete practices and research directions.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 31 of its 71 references that are in the map. First posted on arXiv 18 Nov 2023.

Builds on

31 of 71 references.

References · 31

  1. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  2. 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
  3. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 578
  4. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  5. 2017Why We Need New Evaluation Metrics for NLGcited by 232
  6. 2020Factual Error Correction for Abstractive Summarization Modelscited by 108
  7. 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
  8. 2020Multi-Fact Correction in Abstractive Text Summarizationcited by 66
  9. 2021Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarizationcited by 46
  10. 2021Leveraging Pretrained Models for Automatic Summarization of Doctor-Patient Conversationscited by 42
  11. 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
  12. 2022Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implicationscited by 32
19 more
  1. 2021Focus Attention: Promoting Faithfulness and Diversity in Summarizationcited by 30
  2. 2021Does Pretraining for Summarization Require Knowledge Transfer?cited by 30
  3. 2021CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue Summarizationcited by 27
  4. 2023AHA!: Facilitating AI Impact Assessment by Generating Examples of Harmscited by 26
  5. 2021EmailSum: Abstractive Email Thread Summarizationcited by 24
  6. 2022Graph Enhanced Contrastive Learning for Radiology Findings Summarizationcited by 24
  7. 2021Unpacking the Expressed Consequences of AI Research in Broader Impact Statementscited by 22
  8. 2022HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarizationcited by 22
  9. 2021CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notescited by 18
  10. 2020Dialect Diversity in Text Summarization on Twittercited by 17
  11. 2021AI Ethics Statements -- Analysis and lessons learnt from NeurIPS Broader Impact Statementscited by 16
  12. 2021StreamHover: Livestream Transcript Summarization and Annotationcited by 15
  13. 2020Metrics also Disagree in the Low Scoring Range: Revisiting Summarization Evaluation Metricscited by 13
  14. 2021MultiOpEd: A Corpus of Multi-Perspective News Editorialscited by 13
  15. 2021Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarizationcited by 11
  16. 2021Fairness for Whom? Understanding the Reader's Perception of Fairness in Text Summarizationcited by 8
  17. 2018A Survey on Neural Network-Based Summarization Methodscited by 6
  18. 2023Encoded Summarization: Summarizing Documents into Continuous Vector Space for Legal Case Retrievalcited by 6
  19. 2021How to Write a Bias Statement: Recommendations for Submissions to the Workshop on Gender Bias in NLPcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.