Long Text and Multi-Table Summarization: Dataset and Method
Not on the map. Why?
Abstract (arXiv)
Automatic document summarization aims to produce a concise summary covering the input document's salient information. Within a report document, the salient information can be scattered in the textual and non-textual content. However, existing document summarization datasets and methods usually focus on the text and filter out the non-textual content. Missing tabular data can limit produced summaries' informativeness, especially when summaries require covering quantitative descriptions of critical metrics in tables. Existing datasets and methods cannot meet the requirements of summarizing long text and multiple tables in each report. To deal with the scarcity of available data, we propose FINDSum, the first large-scale dataset for long text and multi-table summarization. Built on 21,125 annual reports from 3,794 companies, it has two subsets for summarizing each company's results of operations and liquidity. To summarize the long text and dozens of tables in each report, we present three types of summarization methods. Besides, we propose a set of evaluation metrics to assess the usage of numerical information in produced summaries. Dataset analyses and experimental results indicate the importance of jointly considering input textual and tabular data when summarizing report documents.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 8 Feb 2023.
Builds on
23 of 41 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2020Rethinking Attention with Performerscited by 1,601
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
- 2015Sequence Level Training with Recurrent Neural Networkscited by 576
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
11 more
- 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
- 2021Efficient Attentions for Long Document Summarizationcited by 345
- 2018Generating Wikipedia by Summarizing Long Sequencescited by 335
- 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 294
- 2017Challenges in Data-to-Document Generationcited by 226
- 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
- 2021Data-to-text Generation with Macro Planningcited by 34
- 2021DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarizationcited by 34
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
- 2021A Survey on Multi-modal Summarizationcited by 26
- 2019A Hierarchical Model for Data-to-Text Generationcited by 20
Built on by
Citing papers per year: 2023: 2; 2024: 10; 2025: 9; 2026: 2.
23 papers.
Sort:
By area:
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlookcited by 20
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
- 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
- 2025RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarkingcited by 18
- 2024TQA-Bench: Evaluating LLMs for Multi-Table Question Answeringcited by 17
- 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigationcited by 12
- 2024Low-Resource Court Judgment Summarization for Common Law Systemscited by 11
- 2024Select and Summarize: Scene Saliency for Movie Script Summarizationcited by 10
- 2024MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checkingcited by 10
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
- 2024QFMTS: Generating Query-Focused Summaries over Multi-Table Inputscited by 9
11 more
- 2023Input Reconstruction Attack against Vertical Federated Large Language Modelscited by 5
- 2025Document Intelligence in the Era of Large Language Models: A Surveycited by 5
- 2025Bridging Language Models and Financial Analysiscited by 4
- 2025Extract, Match, and Score: An Evaluation Paradigm for Long Question-context-answer Triplets in Financial Analysiscited by 3
- 2025SGSimEval: A Comprehensive Multifaceted and Similarity-Enhanced Benchmark for Automatic Survey Generation Systemscited by 3
- 2023READ: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modelingcited by 2
- 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferencescited by 0
- 2024Reasoning-Aware Query-Focused Summarization over Multi-Table Datacited by 0
- 2025Legal Document Summarization: Enhancing Judicial Efficiency through Automation Detectioncited by 0
- 2026LOOMSUM: Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarizationcited by 0
- 2026Preserving What Matters: Semantic Scaffolds Beyond Saturation in Summarization Evaluationcited by 0
- 2026Preserving What Matters: Semantic Scaffolds Beyond Saturation in Summarization Evaluation18 Sep 2026
- 2026LOOMSUM: Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarization31 Aug 2026
- 2025Document Intelligence in the Era of Large Language Models: A Survey15 Oct 2025
- 2025SGSimEval: A Comprehensive Multifaceted and Similarity-Enhanced Benchmark for Automatic Survey Generation Systems15 Aug 2025
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges31 Jul 2025
- 2025Legal Document Summarization: Enhancing Judicial Efficiency through Automation Detection25 Jul 2025
- 2025RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarking2 Apr 2025
- 2025Extract, Match, and Score: An Evaluation Paradigm for Long Question-context-answer Triplets in Financial Analysis20 Mar 2025
- 2025Bridging Language Models and Financial Analysis14 Mar 2025
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlook14 Mar 2025
- 2025FinMTEB: Finance Massive Text Embedding Benchmark16 Feb 2025
- 2024Reasoning-Aware Query-Focused Summarization over Multi-Table Data12 Dec 2024
11 more
- 2024TQA-Bench: Evaluating LLMs for Multi-Table Question Answering29 Nov 2024
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documents8 Nov 2024
- 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigation27 Sep 2024
- 2024MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checking18 Jul 2024
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP29 Jun 2024
- 2024QFMTS: Generating Query-Focused Summaries over Multi-Table Inputs8 May 2024
- 2024Select and Summarize: Scene Saliency for Movie Script Summarization4 Apr 2024
- 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferences31 Mar 2024
- 2024Low-Resource Court Judgment Summarization for Common Law Systems7 Mar 2024
- 2023READ: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modeling12 Dec 2023
- 2023Input Reconstruction Attack against Vertical Federated Large Language Models7 Nov 2023
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlookcited by 20
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
- 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
- 2024TQA-Bench: Evaluating LLMs for Multi-Table Question Answeringcited by 17
- 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigationcited by 12
- 2024Low-Resource Court Judgment Summarization for Common Law Systemscited by 11
- 2024Select and Summarize: Scene Saliency for Movie Script Summarizationcited by 10
- 2024MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checkingcited by 10
- 2024QFMTS: Generating Query-Focused Summaries over Multi-Table Inputscited by 9
- 2023Input Reconstruction Attack against Vertical Federated Large Language Modelscited by 5
- 2025Document Intelligence in the Era of Large Language Models: A Surveycited by 5
12 most cited of 20 All 20 (JSON)
- 2026Preserving What Matters: Semantic Scaffolds Beyond Saturation in Summarization Evaluation18 Sep 2026
- 2026LOOMSUM: Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarization31 Aug 2026
- 2025Document Intelligence in the Era of Large Language Models: A Survey15 Oct 2025
- 2025SGSimEval: A Comprehensive Multifaceted and Similarity-Enhanced Benchmark for Automatic Survey Generation Systems15 Aug 2025
- 2025Legal Document Summarization: Enhancing Judicial Efficiency through Automation Detection25 Jul 2025
- 2025Extract, Match, and Score: An Evaluation Paradigm for Long Question-context-answer Triplets in Financial Analysis20 Mar 2025
- 2025Bridging Language Models and Financial Analysis14 Mar 2025
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlook14 Mar 2025
- 2025FinMTEB: Finance Massive Text Embedding Benchmark16 Feb 2025
- 2024TQA-Bench: Evaluating LLMs for Multi-Table Question Answering29 Nov 2024
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documents8 Nov 2024
- 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigation27 Sep 2024
12 newest of 20 All 20 (JSON)