mlsanityData to 7 Oct 2026

ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcripts

arXiv 2210.12467 ↗First posted 22 Oct 2022cs.CLcited by 59

Not on the map. Why?

Abstract (arXiv)

Despite tremendous progress in automatic summarization, state-of-the-art methods are predominantly trained to excel in summarizing short newswire articles, or documents with strong layout biases such as scientific articles or government reports. Efficient techniques to summarize financial documents, including facts and figures, have largely been unexplored, majorly due to the unavailability of suitable datasets. In this work, we present ECTSum, a new dataset with transcripts of earnings calls (ECTs), hosted by publicly traded companies, as documents, and short experts-written telegram-style bullet point summaries derived from corresponding Reuters articles. ECTs are long unstructured documents without any prescribed length limit or format. We benchmark our dataset with state-of-the-art summarizers across various metrics evaluating the content quality and factual consistency of the generated summaries. Finally, we present a simple-yet-effective approach, ECT-BPS, to generate a set of bullet points that precisely capture the important facts discussed in the calls.

Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 22 Oct 2022.

Builds on

29 of 47 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2020Longformer: The Long-Document Transformercited by 3,362
  6. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  7. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  8. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  9. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
  10. 2019Text Summarization with Pretrained Encoderscited by 553
  11. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
  12. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
17 more
  1. 2021Efficient Attentions for Long Document Summarizationcited by 342
  2. 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 292
  3. 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
  4. 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
  5. 2020Extractive Summarization as Text Matchingcited by 189
  6. 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
  7. 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
  8. 2019BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarizationcited by 155
  9. 2019BillSum: A Corpus for Automatic Summarization of US Legislationcited by 117
  10. 2020What Have We Achieved on Text Summarization?cited by 65
  11. 2019Sentence Centrality Revisited for Unsupervised Summarizationcited by 64
  12. 2021Aspect-Controllable Opinion Summarizationcited by 47
  13. 2022Don't Say What You Don't Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Searchcited by 23
  14. 2022Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluationcited by 23
  15. 2019Modeling financial analysts' decision making via the pragmatics and semantics of earnings callscited by 17
  16. 2020Read what you need: Controllable Aspect-based Opinion Summarization of Tourist Reviewscited by 9
  17. 2021MTLTS: A Multi-Task Framework To Obtain Trustworthy Summaries From Crisis-Related Microblogscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 22; 2025: 21; 2026: 11.

59 papers.

Sort:

By area:

  1. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
  2. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 140
  3. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  4. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
  5. 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 80
  6. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
  7. 2023LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyondcited by 37
  8. 2024Open-FinLLMs: Open Multimodal Large Language Models for Financial Applicationscited by 36
  9. 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
  10. 2025Demystifying Domain-adaptive Post-training for Financial LLMscited by 24
  11. 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 21
  12. 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
38 more
  1. 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
  2. 2025MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Applicationcited by 14
  3. 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigationcited by 12
  4. 2023Financial Numeric Extreme Labelling: A Dataset and Benchmarking for XBRL Taggingcited by 11
  5. 2024SubjECTive-QA: Measuring Subjectivity in Earnings Call Transcripts' QA Through Six-Dimensional Feature Analysiscited by 8
  6. 2025Template-Based Financial Report Generation in Agentic and Decomposed Information Retrievalcited by 8
  7. 2024No Language is an Island: Unifying Chinese and English in Financial Large Language Models, Instruction Data, and Benchmarkscited by 7
  8. 2025STEER-ME: Assessing the Microeconomic Reasoning of Large Language Modelscited by 7
  9. 2024From Facts to Insights: A Study on the Generation and Evaluation of Analytical Reports for Deciphering Earnings Callscited by 6
  10. 2025Document Summarization with Conformal Importance Guaranteescited by 6
  11. 2024D'olares or Dollars? Unraveling the Bilingual Prowess of Financial LLMs Between Spanish and Englishcited by 5
  12. 2025Summarizing Speech: A Comprehensive Surveycited by 5
  13. 2024'Finance Wizard' at the FinLLM Challenge Task: Financial Text Summarizationcited by 4
  14. 2025Bridging Language Models and Financial Analysiscited by 4
  15. 2025Finance Language Model Evaluation (FLaME)cited by 4
  16. 2025FinDebate: Multi-Agent Collaborative Intelligence for Financial Analysiscited by 4
  17. 2026From Feedback Loops to Policy Updates: Reinforcement Fine-Tuning for LLM-Based Alpha Factor Discoverycited by 4
  18. 2024Instruction-Guided Bullet Point Summarization of Long Financial Earnings Call Transcriptscited by 3
  19. 2024DeFine: Decision-Making with Analogical Reasoning over Factor Profilescited by 3
  20. 2024StructTest: Benchmarking LLMs' Reasoning through Compositional Structured Outputscited by 3
  21. 2025Language Modeling for the Future of Finance: A Survey into Metrics, Tasks, and Data Opportunitiescited by 3
  22. 2025FinNLI: Novel Dataset for Multi-Genre Financial Natural Language Inference Benchmarkingcited by 3
  23. 2025FinTagging: Benchmarking LLMs for Extracting and Structuring Financial Informationcited by 3
  24. 2024Long Dialog Summarization: An Analysiscited by 2
  25. 2024CTISum: A New Benchmark Dataset For Cyber Threat Intelligence Summarizationcited by 2
  26. 2025The Impact and Feasibility of Self-Confidence Shaping for AI-Assisted Decision-Makingcited by 2
  27. 2025FinAudio: A Benchmark for Audio Large Language Models in Financial Applicationscited by 2
  28. 2025M3FinMeeting: A Multilingual, Multi-Sector, and Multi-Task Financial Meeting Understanding Evaluation Datasetcited by 2
  29. 2026The CLEF-2026 FinMMEval Lab: Multilingual and Multimodal Evaluation of Financial AI Systemscited by 2
  30. 2026From Token to Token Pair: Efficient Prompt Compression for Large Language Models in Clinical Predictioncited by 2
  31. 2024CAP: Data Contamination Detection via Consistency Amplificationcited by 1
  32. 2025FinBloom: Knowledge Grounding Large Language Model with Real-time Financial Datacited by 1
  33. 2026Lessons from the Field: An Adaptable Lifecycle Approach to Applied Dialogue Summarizationcited by 1
  34. 2026A Large-Scale Multi-Dimensional Empirical Study of LLMs for Conversation Summarizationcited by 1
  35. 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferencescited by 0
  36. 2024Beyond Turing Test: Can GPT-4 Sway Experts' Decisions?cited by 0
  37. 2024Rehearsing Answers to Probable Questions with Perspective-Takingcited by 0
  38. 2025Large Language Models Acing Chartered Accountancycited by 0

50 most cited of 59 All 59 (JSON)