Decoupling Generation and Selection for Budget-Constrained Faithful Summarization
Not on the map. Why?
Abstract (arXiv)
Abstractive summarization models remain vulnerable to factual inconsistency, redundancy, and weak length control. We propose a modular generation-and-selection framework for sentence-budget-constrained summarization. A pretrained generator produces multiple candidate summaries, which are decomposed into sentence-level candidates. A combinatorial selector then constructs the final summary by balancing relevance, factuality, and redundancy under an explicit budget. The framework supports MMR, ILP, and a DPP-inspired log-determinant objective without retraining the generator. Experiments on CNN/DailyMail, Multi-News, FaithBench, and TofuEval show consistent improvements in factuality and source-grounding metrics, especially for multi-document summarization, at the cost of lower reference-overlap scores. Human evaluation further indicates higher perceived consistency, relevance, clarity, and conciseness, with a small reduction in coherence. These results show that decoupling generation from selection provides a model-agnostic mechanism for improving factual grounding. Code is available at https://anonymous.4open.science/r/bcfs-D05E/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 60 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
33 of 60 references.
References · 33
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
- 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
- 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
- 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
- 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
- 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
- 2021SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarizationcited by 132
- 2022Evaluating the Factual Consistency of Large Language Models Through News Summarizationcited by 92
21 more
- 2023On Learning to Summarize with Large Language Models as Referencescited by 80
- 2023Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarizationcited by 69
- 2024TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarizationcited by 66
- 2024FABLES: Evaluating faithfulness and content selection in book-length summarizationcited by 65
- 2022SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarizationcited by 61
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
- 2023Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articlescited by 45
- 2022Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infillingcited by 38
- 2024Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Biascited by 28
- 2024FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMscited by 24
- 2024On Positional Bias of Faithfulness for Long-form Summarizationcited by 22
- 2024SMART: Submodular Data Mixture Strategy for Instruction Tuningcited by 17
- 2024Improving Faithfulness of Large Language Models in Summarization via Sliding Generation and Self-Consistencycited by 14
- 2023Do Multi-Document Summarization Models Synthesize?cited by 11
- 2023Lightweight reranking for language model generationscited by 10
- 2024Tell me what I need to know: Exploring LLM-based (Personalized) Abstractive Multi-Source Meeting Summarizationcited by 9
- 2025Dynamic Attention-Guided Context Decoding for Mitigating Context Faithfulness Hallucinations in Large Language Modelscited by 9
- 2023Improving Factuality of Abstractive Summarization without Sacrificing Summary Qualitycited by 7
- 2024Mitigating Hallucination in Abstractive Summarization with Domain-Conditional Mutual Informationcited by 6
- 2025FaithLens: Detecting and Explaining Faithfulness Hallucinationcited by 3
- 2025Reranking-based Generation for Unbiased Perspective Summarizationcited by 2
Built on by
Not cited yet.