LOOMSUM: Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarization
Not on the map. Why?
Abstract (arXiv)
Long documents often distribute important information across extensive narrative passages and multiple tables, making faithful summarization particularly challenging. Existing methods may generate individually supported quantitative facts and analytical statements yet associate them incorrectly, producing quantitatively plausible yet analytically unfaithful summaries. In this work, we propose LOOMSUM, a training-free framework that extracts source-grounded atomic evidence, explicitly links table-derived facts with supporting narrative analyses, and plans the discourse structure before generation. We also introduce Table-Grounded Faithfulness (TGF), a claim-level metric that separately evaluates Numeric Grounding, Analysis Support, and Relation Consistency. Experiments on the text--table summarization benchmarks FINDSum and USTT show that LOOMSUM improves analytical faithfulness while maintaining strong summarization quality. Human evaluation finds positive component-level associations with the corresponding human judgments. Our Relation Consistency metric further shows stronger agreement with human relation judgments than generic factuality metrics, indicating that explicit cross-modal linking helps reduce errors in which supported quantities are paired with incorrect narrative interpretations. Together, these findings show that faithful long text--table summarization requires not only grounding individual facts, but also preserving the relations between them.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 38 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
27 of 38 references.
References · 27
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
- 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
- 2018Bottom-Up Abstractive Summarizationcited by 177
- 2018Fast Abstractive Summarization with Reinforce-Selected Sentence Rewritingcited by 158
- 2019Handling Divergent Reference Texts when Evaluating Table-to-Text Generationcited by 119
- 2020Logical Natural Language Generation from Open-Domain Tablescited by 90
15 more
- 2024FineSurE: Fine-grained Summarization Evaluation using LLMscited by 83
- 2020Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraintscited by 48
- 2021Data-to-text Generation with Macro Planningcited by 34
- 2023Less is More for Long Document Summary Evaluation by LLMscited by 28
- 2023Long Text and Multi-Table Summarization: Dataset and Methodcited by 23
- 2024On Positional Bias of Faithfulness for Long-form Summarizationcited by 22
- 2025Beyond Factual Accuracy: Evaluating Coverage of Diverse Factual Information in Long-form Text Generationcited by 15
- 2025Agent-as-Judge for Factual Summarization of Long Narrativescited by 9
- 2026Beyond Accuracy: Measuring Bias Acknowledgment in Chain-of-Thought Reasoning for Responsible AI Evaluationcited by 9
- 2024Characterizing Multimodal Long-form Summarization: A Case Study on Financial Reportscited by 5
- 2025TracSum: A New Benchmark for Aspect-Based Summarization with Sentence-Level Traceability in Medical Domaincited by 4
- 2025ARC: Argument Representation and Coverage Analysis for Zero-Shot Long Document Summarization with Instruction Following LLMscited by 3
- 2025Re-FRAME the Meeting Summarization SCOPE: Fact-Based Summarization and Personalization via Questionscited by 3
- 2026The Moving Target: A Longitudinal Audit of Trust-Benchmark Score Drift Across Open-Source Chat LLM Release Linescited by 2
- 2023RTSUM: Relation Triple-based Interpretable Summarization with Multi-level Salience Visualizationcited by 1
Built on by
Not cited yet.