SummIt: Iterative Text Summarization via ChatGPT
Not on the map. Why?
Abstract (arXiv)
Text summarization systems have made significant progress in recent years, but typically generate summaries in one single step. However, the one-shot summarization setting is sometimes inadequate, as the generated summary may contain hallucinations or overlook essential details related to the reader's interests. This paper addresses this limitation by proposing SummIt, an iterative text summarization framework based on large language models like ChatGPT. Our framework enables the model to refine the generated summary iteratively through self-evaluation and feedback, resembling humans' iterative process when drafting and revising summaries. Furthermore, we explore the potential benefits of integrating knowledge and topic extractors into the framework to enhance summary faithfulness and controllability. We automatically evaluate the performance of our framework on three benchmark summarization datasets. We also conduct a human evaluation to validate the effectiveness of the iterative refinements and identify a potential issue of over-correction.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). Builds on 34 of its 46 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
34 of 46 references.
References · 34
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
- 2015Teaching Machines to Read and Comprehendcited by 1,039
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
- 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 578
- 2019Text Summarization with Pretrained Encoderscited by 553
22 more
- 2023Benchmarking Large Language Models for News Summarizationcited by 444
- 2023GPTScore: Evaluate as You Desirecited by 357
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
- 2022Generating Sequences by Learning to Self-Correctcited by 271
- 2020Extractive Summarization as Text Matchingcited by 189
- 2020Graph-Bert: Only Attention is Needed for Learning Graph Representationscited by 176
- 2020Evaluating Factuality in Generation with Dependency-level Entailmentcited by 122
- 2016Neural Summarization by Extracting Sentences and Wordscited by 114
- 2023RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputscited by 104
- 2022PEER: A Collaborative Language Modelcited by 86
- 2019Parallel Iterative Edit Models for Local Sequence Transductioncited by 81
- 2020Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Rewardcited by 66
- 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 58
- 2021FRUIT: Faithfully Reflecting Updated Information in Textcited by 39
- 2022On Improving Summarization Factual Consistency from Natural Language Feedbackcited by 38
- 2020Text Editing by Commandcited by 33
- 2022Learning to Model Editing Processescited by 30
- 2022HEGEL: Hypergraph Transformer for Long Document Summarizationcited by 28
- 2022NEWTS: A Corpus for News Topic-Focused Summarizationcited by 27
- 2023DiffuSum: Generation Enhanced Extractive Summarization with Diffusioncited by 25
- 2022Improving the Faithfulness of Abstractive Summarization via Entity Coverage Controlcited by 21
- 2020Fact-based Text Editingcited by 14
Built on by
Citing papers per year: 2023: 11; 2024: 22; 2025: 17; 2026: 3.
53 papers.
Sort:
By area:
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2023Self-Verification Improves Few-Shot Clinical Information Extractioncited by 52
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2025Large Language Models Hallucination: A Comprehensive Surveycited by 45
- 2023LeanContext: Cost-Efficient Domain-Specific Question Answering Using LLMscited by 40
- 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challengescited by 37
- 2024HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieved Knowledge in RAG Systemscited by 37
- 2023On Context Utilization in Summarization with Large Language Modelscited by 30
- 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluationcited by 26
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agencycited by 18
- 2023Tree Prompting: Efficient Task Adaptation without Fine-Tuningcited by 17
38 more
- 2024Abstractive Text Summarization: State of the Art, Challenges, and Improvementscited by 17
- 2025Build the web for agents, not agents for the webcited by 17
- 2024Prompt Chaining or Stepwise Prompt? Refinement in Text Summarizationcited by 16
- 2023OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarizationcited by 15
- 2024Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settingscited by 14
- 2024A Comparative Study of Quality Evaluation Methods for Text Summarizationcited by 13
- 2023FollowEval: A Multi-Dimensional Benchmark for Assessing the Instruction-Following Capability of Large Language Modelscited by 12
- 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Languagecited by 12
- 2025HyGen: Efficient LLM Serving via Elastic Online-Offline Request Co-locationcited by 10
- 2025Knowledge is Power: Harnessing Large Language Models for Enhanced Cognitive Diagnosiscited by 10
- 2024DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Modelcited by 8
- 2024What's Wrong? Refining Meeting Summaries with LLM Feedbackcited by 8
- 2023PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry Generationcited by 6
- 2023XATU: A Fine-grained Instruction-based Benchmark for Explainable Text Updatescited by 6
- 2024ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue Summarizationcited by 6
- 2025Exploring Large Language Models for Semantic Analysis and Categorization of Android Malwarecited by 6
- 2025Wi-Chat: Large Language Model Powered Wi-Fi Sensingcited by 6
- 2024Analyzing Regional Impacts of Climate Change using Natural Language Processing Techniquescited by 5
- 2025Token-Level Precise Attack on RAG: Searching for the Best Alternatives to Mislead Generationcited by 5
- 2024AlignSum: Data Pyramid Hierarchical Fine-tuning for Aligning with Human Summarization Preferencecited by 4
- 2024DomainSum: A Hierarchical Benchmark for Fine-Grained Domain Shift in Abstractive Text Summarizationcited by 4
- 2025ReFeed: Multi-dimensional Summarization Refinement with Reflective Reasoning on Feedbackcited by 4
- 2025QA-prompting: Improving Summarization with Large Language Models using Question-Answeringcited by 4
- 2023Beyond Text: Unveiling Multimodal Proficiency of Large Language Models with MultiAPI Benchmarkcited by 3
- 2023Risk Aware Benchmarking of Large Language Modelscited by 2
- 2024LaMSUM: Amplifying Voices Against Harassment through LLM Guided Extractive Summarization of User Incident Reportscited by 2
- 2025Controllable Abstraction in Summary Generation for Large Language Models via Prompt Engineeringcited by 2
- 2026MMViR: A Multi-Modal and Multi-Granularity Representation for Long-range Video Understandingcited by 2
- 2023Metric Ensembles For Hallucination Detectioncited by 1
- 2024Unveiling the Magic: Investigating Attention Distillation in Retrieval-augmented Generationcited by 1
- 2024Exploring Iterative Controllable Summarization with Large Language Modelscited by 1
- 2025Semantic Captioning: Benchmark Dataset and Graph-Aware Few-Shot In-Context Learning for SQL2Textcited by 1
- 2025Conditional Multi-Stage Failure Recovery for Embodied Agentscited by 1
- 2025Generating Query-Relevant Document Summaries via Reinforcement Learningcited by 1
- 2026LongSumEval: Question-Answering Based Evaluation and Feedback-Driven Refinement for Long Document Summarizationcited by 1
- 2024MARS: Multilingual Aspect-centric Review Summarisationcited by 0
- 2025Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understandingcited by 0
- 2025Generating Fine Details of Entity Interactionscited by 0
50 most cited of 53 All 53 (JSON)
- 2026LongSumEval: Question-Answering Based Evaluation and Feedback-Driven Refinement for Long Document Summarization28 Apr 2026
- 2026LLMs Should Incorporate Explicit Mechanisms for Human Empathy12 Apr 2026
- 2026MMViR: A Multi-Modal and Multi-Granularity Representation for Long-range Video Understanding9 Jan 2026
- 2025Chain of Summaries: Summarization Through Iterative Questioning12 Nov 2025
- 2025Controllable Abstraction in Summary Generation for Large Language Models via Prompt Engineering17 Oct 2025
- 2025Large Language Models Hallucination: A Comprehensive Survey5 Oct 2025
- 2025Generating Query-Relevant Document Summaries via Reinforcement Learning11 Aug 2025
- 2025Token-Level Precise Attack on RAG: Searching for the Best Alternatives to Mislead Generation5 Aug 2025
- 2025Conditional Multi-Stage Failure Recovery for Embodied Agents8 Jul 2025
- 2025Build the web for agents, not agents for the web12 Jun 2025
- 2025Leveraging Self-Attention for Input-Dependent Soft Prompting in LLMs5 Jun 2025
- 2025QA-prompting: Improving Summarization with Large Language Models using Question-Answering20 May 2025
38 more
- 2025Generating Fine Details of Entity Interactions11 Apr 2025
- 2025Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understanding1 Apr 2025
- 2025ReFeed: Multi-dimensional Summarization Refinement with Reflective Reasoning on Feedback27 Mar 2025
- 2025Wi-Chat: Large Language Model Powered Wi-Fi Sensing18 Feb 2025
- 2025Knowledge is Power: Harnessing Large Language Models for Enhanced Cognitive Diagnosis8 Feb 2025
- 2025HyGen: Efficient LLM Serving via Elastic Online-Offline Request Co-location15 Jan 2025
- 2025Exploring Large Language Models for Semantic Analysis and Categorization of Android Malware8 Jan 2025
- 2025Semantic Captioning: Benchmark Dataset and Graph-Aware Few-Shot In-Context Learning for SQL2Text6 Jan 2025
- 2024Exploring Iterative Controllable Summarization with Large Language Models19 Nov 2024
- 2024HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieved Knowledge in RAG Systems5 Nov 2024
- 2024DomainSum: A Hierarchical Benchmark for Fine-Grained Domain Shift in Abstractive Text Summarization21 Oct 2024
- 2024ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue Summarization17 Oct 2024
- 2024Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settings17 Oct 2024
- 2024MARS: Multilingual Aspect-centric Review Summarisation13 Oct 2024
- 2024AlignSum: Data Pyramid Hierarchical Fine-tuning for Aligning with Human Summarization Preference1 Oct 2024
- 2024Abstractive Text Summarization: State of the Art, Challenges, and Improvements4 Sep 2024
- 2024What's Wrong? Refining Meeting Summaries with LLM Feedback16 Jul 2024
- 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluation8 Jul 2024
- 2024A Comparative Study of Quality Evaluation Methods for Text Summarization30 Jun 2024
- 2024When Search Engine Services meet Large Language Models: Visions and Challenges28 Jun 2024
- 2024LaMSUM: Amplifying Voices Against Harassment through LLM Guided Extractive Summarization of User Incident Reports22 Jun 2024
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models17 Jun 2024
- 2024Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization1 Jun 2024
- 2024DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model8 Apr 2024
- 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Language7 Apr 2024
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey21 Mar 2024
- 2024Unveiling the Magic: Investigating Attention Distillation in Retrieval-augmented Generation19 Feb 2024
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency13 Feb 2024
- 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challenges13 Jan 2024
- 2024Analyzing Regional Impacts of Climate Change using Natural Language Processing Techniques11 Jan 2024
- 2023OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarization7 Dec 2023
- 2023Beyond Text: Unveiling Multimodal Proficiency of Large Language Models with MultiAPI Benchmark21 Nov 2023
- 2023FollowEval: A Multi-Dimensional Benchmark for Assessing the Instruction-Following Capability of Large Language Models16 Nov 2023
- 2023Tree Prompting: Efficient Task Adaptation without Fine-Tuning21 Oct 2023
- 2023On Context Utilization in Summarization with Large Language Models16 Oct 2023
- 2023Metric Ensembles For Hallucination Detection16 Oct 2023
- 2023Risk Aware Benchmarking of Large Language Models11 Oct 2023
- 2023XATU: A Fine-grained Instruction-based Benchmark for Explainable Text Updates20 Sep 2023
50 newest of 53 All 53 (JSON)
- 2024HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieved Knowledge in RAG Systemscited by 37
- 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Languagecited by 12
- 2025Token-Level Precise Attack on RAG: Searching for the Best Alternatives to Mislead Generationcited by 5
- 2024Unveiling the Magic: Investigating Attention Distillation in Retrieval-augmented Generationcited by 1
- 2025Token-Level Precise Attack on RAG: Searching for the Best Alternatives to Mislead Generation5 Aug 2025
- 2024HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieved Knowledge in RAG Systems5 Nov 2024
- 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Language7 Apr 2024
- 2024Unveiling the Magic: Investigating Attention Distillation in Retrieval-augmented Generation19 Feb 2024
- 2025Build the web for agents, not agents for the webcited by 17
- 2025Conditional Multi-Stage Failure Recovery for Embodied Agentscited by 1
- 2025Conditional Multi-Stage Failure Recovery for Embodied Agents8 Jul 2025
- 2025Build the web for agents, not agents for the web12 Jun 2025
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2025Large Language Models Hallucination: A Comprehensive Surveycited by 45
- 2023LeanContext: Cost-Efficient Domain-Specific Question Answering Using LLMscited by 40
- 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challengescited by 37
- 2023On Context Utilization in Summarization with Large Language Modelscited by 30
- 2024PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluationcited by 26
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agencycited by 18
- 2023Tree Prompting: Efficient Task Adaptation without Fine-Tuningcited by 17
- 2024Abstractive Text Summarization: State of the Art, Challenges, and Improvementscited by 17
- 2024Prompt Chaining or Stepwise Prompt? Refinement in Text Summarizationcited by 16
12 most cited of 42 All 42 (JSON)
- 2026LongSumEval: Question-Answering Based Evaluation and Feedback-Driven Refinement for Long Document Summarization28 Apr 2026
- 2026LLMs Should Incorporate Explicit Mechanisms for Human Empathy12 Apr 2026
- 2025Chain of Summaries: Summarization Through Iterative Questioning12 Nov 2025
- 2025Controllable Abstraction in Summary Generation for Large Language Models via Prompt Engineering17 Oct 2025
- 2025Large Language Models Hallucination: A Comprehensive Survey5 Oct 2025
- 2025Generating Query-Relevant Document Summaries via Reinforcement Learning11 Aug 2025
- 2025Leveraging Self-Attention for Input-Dependent Soft Prompting in LLMs5 Jun 2025
- 2025QA-prompting: Improving Summarization with Large Language Models using Question-Answering20 May 2025
- 2025Generating Fine Details of Entity Interactions11 Apr 2025
- 2025Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understanding1 Apr 2025
- 2025ReFeed: Multi-dimensional Summarization Refinement with Reflective Reasoning on Feedback27 Mar 2025
- 2025Wi-Chat: Large Language Model Powered Wi-Fi Sensing18 Feb 2025
12 newest of 42 All 42 (JSON)