mlsanityData to 14 Oct 2026

Decoupling Generation and Selection for Budget-Constrained Faithful Summarization

arXiv 2608.03655 ↗First posted 4 Aug 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Abstractive summarization models remain vulnerable to factual inconsistency, redundancy, and weak length control. We propose a modular generation-and-selection framework for sentence-budget-constrained summarization. A pretrained generator produces multiple candidate summaries, which are decomposed into sentence-level candidates. A combinatorial selector then constructs the final summary by balancing relevance, factuality, and redundancy under an explicit budget. The framework supports MMR, ILP, and a DPP-inspired log-determinant objective without retraining the generator. Experiments on CNN/DailyMail, Multi-News, FaithBench, and TofuEval show consistent improvements in factuality and source-grounding metrics, especially for multi-document summarization, at the cost of lower reference-overlap scores. Human evaluation further indicates higher perceived consistency, relevance, clarity, and conciseness, with a small reduction in coherence. These results show that decoupling generation from selection provides a model-agnostic mechanism for improving factual grounding. Code is available at https://anonymous.4open.science/r/bcfs-D05E/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 60 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

33 of 60 references.

References · 33

  1. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
  4. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  5. 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
  6. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
  7. 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
  8. 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
  9. 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
  10. 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
  11. 2021SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarizationcited by 132
  12. 2022Evaluating the Factual Consistency of Large Language Models Through News Summarizationcited by 92
21 more
  1. 2023On Learning to Summarize with Large Language Models as Referencescited by 80
  2. 2023Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarizationcited by 69
  3. 2024TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarizationcited by 66
  4. 2024FABLES: Evaluating faithfulness and content selection in book-length summarizationcited by 65
  5. 2022SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarizationcited by 61
  6. 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
  7. 2023Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articlescited by 45
  8. 2022Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infillingcited by 38
  9. 2024Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Biascited by 28
  10. 2024FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMscited by 24
  11. 2024On Positional Bias of Faithfulness for Long-form Summarizationcited by 22
  12. 2024SMART: Submodular Data Mixture Strategy for Instruction Tuningcited by 17
  13. 2024Improving Faithfulness of Large Language Models in Summarization via Sliding Generation and Self-Consistencycited by 14
  14. 2023Do Multi-Document Summarization Models Synthesize?cited by 11
  15. 2023Lightweight reranking for language model generationscited by 10
  16. 2024Tell me what I need to know: Exploring LLM-based (Personalized) Abstractive Multi-Source Meeting Summarizationcited by 9
  17. 2025Dynamic Attention-Guided Context Decoding for Mitigating Context Faithfulness Hallucinations in Large Language Modelscited by 9
  18. 2023Improving Factuality of Abstractive Summarization without Sacrificing Summary Qualitycited by 7
  19. 2024Mitigating Hallucination in Abstractive Summarization with Domain-Conditional Mutual Informationcited by 6
  20. 2025FaithLens: Detecting and Explaining Faithfulness Hallucinationcited by 3
  21. 2025Reranking-based Generation for Unbiased Perspective Summarizationcited by 2

Built on by

Not cited yet.