mlsanityData to 14 Oct 2026

Long Text and Multi-Table Summarization: Dataset and Method

arXiv 2302.03815 ↗First posted 8 Feb 2023cs.CL cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

Automatic document summarization aims to produce a concise summary covering the input document's salient information. Within a report document, the salient information can be scattered in the textual and non-textual content. However, existing document summarization datasets and methods usually focus on the text and filter out the non-textual content. Missing tabular data can limit produced summaries' informativeness, especially when summaries require covering quantitative descriptions of critical metrics in tables. Existing datasets and methods cannot meet the requirements of summarizing long text and multiple tables in each report. To deal with the scarcity of available data, we propose FINDSum, the first large-scale dataset for long text and multi-table summarization. Built on 21,125 annual reports from 3,794 companies, it has two subsets for summarizing each company's results of operations and liquidity. To summarize the long text and dozens of tables in each report, we present three types of summarization methods. Besides, we propose a set of evaluation metrics to assess the usage of numerical information in produced summaries. Dataset analyses and experimental results indicate the importance of jointly considering input textual and tabular data when summarizing report documents.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 8 Feb 2023.

Builds on

23 of 41 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2020Longformer: The Long-Document Transformercited by 3,413
  6. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  7. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  8. 2020Rethinking Attention with Performerscited by 1,601
  9. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  10. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
  11. 2015Sequence Level Training with Recurrent Neural Networkscited by 576
  12. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
11 more
  1. 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
  2. 2021Efficient Attentions for Long Document Summarizationcited by 345
  3. 2018Generating Wikipedia by Summarizing Long Sequencescited by 335
  4. 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 294
  5. 2017Challenges in Data-to-Document Generationcited by 226
  6. 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
  7. 2021Data-to-text Generation with Macro Planningcited by 34
  8. 2021DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarizationcited by 34
  9. 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
  10. 2021A Survey on Multi-modal Summarizationcited by 26
  11. 2019A Hierarchical Model for Data-to-Text Generationcited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 10; 2025: 9; 2026: 2.

23 papers.

Sort:

By area:

  1. 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
  2. 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlookcited by 20
  3. 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
  4. 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
  5. 2025RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarkingcited by 18
  6. 2024TQA-Bench: Evaluating LLMs for Multi-Table Question Answeringcited by 17
  7. 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigationcited by 12
  8. 2024Low-Resource Court Judgment Summarization for Common Law Systemscited by 11
  9. 2024Select and Summarize: Scene Saliency for Movie Script Summarizationcited by 10
  10. 2024MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checkingcited by 10
  11. 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
  12. 2024QFMTS: Generating Query-Focused Summaries over Multi-Table Inputscited by 9
11 more
  1. 2023Input Reconstruction Attack against Vertical Federated Large Language Modelscited by 5
  2. 2025Document Intelligence in the Era of Large Language Models: A Surveycited by 5
  3. 2025Bridging Language Models and Financial Analysiscited by 4
  4. 2025Extract, Match, and Score: An Evaluation Paradigm for Long Question-context-answer Triplets in Financial Analysiscited by 3
  5. 2025SGSimEval: A Comprehensive Multifaceted and Similarity-Enhanced Benchmark for Automatic Survey Generation Systemscited by 3
  6. 2023READ: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modelingcited by 2
  7. 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferencescited by 0
  8. 2024Reasoning-Aware Query-Focused Summarization over Multi-Table Datacited by 0
  9. 2025Legal Document Summarization: Enhancing Judicial Efficiency through Automation Detectioncited by 0
  10. 2026LOOMSUM: Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarizationcited by 0
  11. 2026Preserving What Matters: Semantic Scaffolds Beyond Saturation in Summarization Evaluationcited by 0