mlsanityData to 7 Oct 2026

From Lengthy to Lucid: A Systematic Literature Review on NLP Techniques for Taming Long Sentences

arXiv 2312.05172 ↗First posted 8 Dec 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Long sentences have been a persistent issue in written communication for many years since they make it challenging for readers to grasp the main points or follow the initial intention of the writer. This survey, conducted using the PRISMA guidelines, systematically reviews two main strategies for addressing the issue of long sentences: a) sentence compression and b) sentence splitting. An increased trend of interest in this area has been observed since 2005, with significant growth after 2017. Current research is dominated by supervised approaches for both sentence compression and splitting. Yet, there is a considerable gap in weakly and self-supervised techniques, suggesting an opportunity for further research, especially in domains with limited data. We also observe that despite their potential, Large Language Models (LLMs) have not yet been widely explored in this area. In this survey, we categorize and group the most representative methods into a comprehensive taxonomy. We also conduct a comparative evaluation analysis of these methods on common sentence compression and splitting datasets. Finally, we discuss the challenges and limitations of current methods, providing valuable insights for future research directions. This survey is meant to serve as a comprehensive resource for addressing the complexities of long sentences. We aim to enable researchers to make further advancements in the field until long sentences are no longer a barrier to effective communication.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 151 references that are in the map. First posted on arXiv 8 Dec 2023.

Builds on

40 of 151 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  5. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  6. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  7. 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 394
  8. 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 292
  9. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  10. 2022Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluationcited by 141
  11. 2017Online and Linear-Time Attention by Enforcing Monotonic Alignmentscited by 85
  12. 2019BottleSum: Unsupervised and Self-supervised Sentence Summarization using the Information Bottleneck Principlecited by 39
28 more
  1. 2018Learning To Split and Rephrase From Wikipedia Edit Historycited by 38
  2. 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
  3. 2016Language as a Latent Variable: Discrete Generative Models for Sentence Compressioncited by 28
  4. 2019SEQ^3: Differentiable Sequence-to-Sequence-to-Sequence Autoencoder for Unsupervised Abstractive Sentence Compressioncited by 27
  5. 2016Improving sentence compression by learning to predict gazecited by 24
  6. 2017Split and Rephrasecited by 24
  7. 2020Discrete Optimization for Unsupervised Sentence Summarization with Word-Level Extractioncited by 23
  8. 2019Simple Unsupervised Summarization by Contextual Matchingcited by 18
  9. 2021BiSECT: Learning to Split and Rephrase Sentences with Bitextscited by 18
  10. 2022Efficient Unsupervised Sentence Compression by Fine-tuning Transformers with Reinforcement Learningcited by 18
  11. 2017Selective Encoding for Abstractive Sentence Summarizationcited by 17
  12. 2018Split and Rephrase: Better Evaluation and a Stronger Baselinecited by 15
  13. 2018Unsupervised Sentence Compression using Denoising Auto-Encoderscited by 15
  14. 2022Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillationcited by 14
  15. 2019Contrastive Attention Mechanism for Abstractive Sentence Summarizationcited by 13
  16. 2022A Character-Level Length-Control Algorithm for Non-Autoregressive Sentence Summarizationcited by 13
  17. 2022Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarizationcited by 12
  18. 2019Explicit Sentence Compression for Neural Machine Translationcited by 11
  19. 2019MinWikiSplit: A Sentence Splitting Corpus with Minimal Propositionscited by 8
  20. 2020Small but Mighty: New Benchmarks for Split and Rephrasecited by 8
  21. 2020Syntactically Look-Ahead Attention Network for Sentence Compressioncited by 6
  22. 2014Sentence Compression as Tree Transductioncited by 5
  23. 2022Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarizationcited by 5
  24. 2020A Token-wise CNN-based Method for Sentence Compressioncited by 3
  25. 2020Fact-aware Sentence Split and Rephrase with Permutation Invariant Trainingcited by 2
  26. 2021With Measured Words: Simple Sentence Selection for Black-Box Optimization of Sentence Compression Algorithmscited by 2
  27. 2020Sentence Compression as Deletion with Contextual Embeddingscited by 1
  28. 2023The Fewer Splits are Better: Deconstructing Readability in Sentence Splittingcited by 1

Built on by

Not cited yet.