mlsanityData to 14 Oct 2026

Generating Summaries with Controllable Readability Levels

arXiv 2310.10623 ↗First posted 16 Oct 2023cs.CL cs.AI cs.LGcited by 24

Not on the map. Why?

Abstract (arXiv)

Readability refers to how easily a reader can understand a written text. Several factors affect the readability level, such as the complexity of the text, its subject matter, and the reader's background knowledge. Generating summaries based on different readability levels is critical for enabling knowledge consumption by diverse audiences. However, current text generation approaches lack refined control, resulting in texts that are not customized to readers' proficiency levels. In this work, we bridge this gap and study techniques to generate summaries at specified readability levels. Unlike previous methods that focus on a specific readability level (e.g., lay summarization), we generate summaries with fine-grained control over their readability. We develop three text generation techniques for controlling readability: (1) instruction-based readability control, (2) reinforcement learning to minimize the gap between requested and observed readability and (3) a decoding approach that uses lookahead to estimate the readability of upcoming decoding steps. We show that our generation methods significantly improve readability control on news summarization (CNN/DM dataset), as measured by various readability metrics and human judgement, establishing strong baselines for controllable readability in summarization.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 47 of its 90 references that are in the map. First posted on arXiv 16 Oct 2023.

Builds on

47 of 90 references.

References · 47

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  7. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  8. 2015Teaching Machines to Read and Comprehendcited by 1,049
  9. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  10. 2022News Summarization and Evaluation in the Era of GPT-3cited by 327
  11. 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
  12. 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 248
35 more
  1. 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 154
  2. 2017Controllable Abstractive Summarizationcited by 110
  3. 2020CTRLsum: Towards Generic Controllable Text Summarizationcited by 98
  4. 2017Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotationcited by 79
  5. 2019Controllable Sentence Simplificationcited by 78
  6. 2019Better Rewards Yield Better Summaries: Learning to Summarise Without Referencescited by 77
  7. 2022Gradient-Based Constrained Sampling from Language Modelscited by 64
  8. 2020Felix: Flexible Text Editing Through Tagging and Insertioncited by 58
  9. 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 55
  10. 2020Controllable Text Simplification with Explicit Paraphrasingcited by 53
  11. 2021Paragraph-level Simplification of Medical Textscited by 53
  12. 2021Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarizationcited by 51
  13. 2023ChatGPT vs Human-authored Text: Insights into Controllable Text Summarization and Sentence Style Transfercited by 50
  14. 2019Supervised and Unsupervised Neural Approaches to Text Readabilitycited by 46
  15. 2020Automated Lay Language Summarization of Biomedical Scientific Reviewscited by 46
  16. 2020Expertise Style Transfer: A New Task Towards Better Communication between Experts and Laymencited by 45
  17. 2021Keep it Simple: Unsupervised Simplification of Multi-Paragraph Textcited by 45
  18. 2022Rainier: Reinforced Knowledge Introspector for Commonsense Question Answeringcited by 43
  19. 2021MReD: A Meta-Review Dataset for Structure-Controllable Text Generationcited by 42
  20. 2020Iterative Edit-Based Unsupervised Sentence Simplificationcited by 33
  21. 2019Controlling Text Complexity in Neural Machine Translationcited by 32
  22. 2023Faithfulness-Aware Decoding Strategies for Abstractive Summarizationcited by 31
  23. 2022DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generationcited by 30
  24. 2020TextGAIL: Generative Adversarial Imitation Learning for Text Generationcited by 28
  25. 2021Trends, Limitations and Open Challenges in Automatic Readability Assessment Researchcited by 28
  26. 2022Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processingcited by 23
  27. 2018Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generationcited by 21
  28. 2022Readability Controllable Biomedical Document Summarizationcited by 19
  29. 2021Evaluating the Tradeoff Between Abstractiveness and Factuality in Abstractive Summarizationcited by 16
  30. 2023APPLS: Evaluating Evaluation Metrics for Plain Language Summarizationcited by 15
  31. 2022MACSum: Controllable Summarization with Mixed Attributescited by 13
  32. 2021HydraSum: Disentangling Stylistic Features in Text Summarization using Multi-Decoder Modelscited by 12
  33. 2023Learning to Paraphrase Sentences to Different Complexity Levelscited by 11
  34. 2017Steering Output Style and Topic in Neural Response Generationcited by 10
  35. 2022Uniform Complexity for Text Generationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 13; 2025: 5; 2026: 4.

24 papers.

Sort:

By area:

  1. 2024Break the Sequential Dependency of LLM Inference Using Lookahead Decodingcited by 298
  2. 2023Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarizationcited by 69
  3. 2024RAG-RLRC-LaySum at BioLaySumm: Integrating Retrieval-Augmented Generation and Readability Control for Layman Summarization of Biomedical Textscited by 23
  4. 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
  5. 2024From Tarzan to Tolkien: Controlling the Language Proficiency Level of LLMs for Content Generationcited by 15
  6. 2024Enhancing Systematic Decompositional Natural Language Inference Using Informal Logiccited by 12
  7. 2024Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewardscited by 12
  8. 2024RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation Frameworkcited by 11
  9. 2024ReadCtrl: Personalizing text generation with readability-controlled instruction learningcited by 10
  10. 2024Measuring and Modifying the Readability of English Texts with GPT-4cited by 10
  11. 2024Evaluating the Smooth Control of Attribute Intensity in Text Generation with LLMscited by 7
  12. 2024Speechworthy Instruction-tuned Language Modelscited by 7
12 more
  1. 2024Free-text Rationale Generation under Readability Level Controlcited by 4
  2. 2025MODS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collectionscited by 4
  3. 2024Multi-Facet Blending for Faceted Query-by-Example Retrievalcited by 2
  4. 2025Beyond One-Size-Fits-All Summarization: Customizing Summaries for Diverse Userscited by 2
  5. 2025RephQA: Evaluating Readability of Large Language Models in Public Health Question Answeringcited by 2
  6. 2026Classroom AI: Large Language Models as Grade-Specific Teacherscited by 2
  7. 2024Exploring Iterative Controllable Summarization with Large Language Modelscited by 1
  8. 2025Introducing Spotlight: A Novel Approach for Generating Captivating Key Information from Documentscited by 1
  9. 2026Unsupervised Text Style Transfer for Controllable Intensitycited by 1
  10. 2025PG-CE: A Progressive Generation Dataset with Constraint Enhancement for Controllable Text Generationcited by 0
  11. 2026Iterative Prompt Refinement for Dyslexia-Friendly Text Summarization Using GPT-4ocited by 0
  12. 2026Can LLMs Control Readability? A Multi-Dimensional Evaluation Framework for CEFR-Controlled Arabic Generationcited by 0