mlsanityData to 14 Oct 2026

Instruction-Guided Bullet Point Summarization of Long Financial Earnings Call Transcripts

arXiv 2405.06669 ↗First posted 3 May 2024cs.CL cs.CE cs.IRcited by 3

Not on the map. Why?

Abstract (arXiv)

While automatic summarization techniques have made significant advancements, their primary focus has been on summarizing short news articles or documents that have clear structural patterns like scientific articles or government reports. There has not been much exploration into developing efficient methods for summarizing financial documents, which often contain complex facts and figures. Here, we study the problem of bullet point summarization of long Earning Call Transcripts (ECTs) using the recently released ECTSum dataset. We leverage an unsupervised question-based extractive module followed by a parameter efficient instruction-tuned abstractive module to solve this task. Our proposed model FLAN-FinBPS achieves new state-of-the-art performances outperforming the strongest baseline with 14.88% average ROUGE score gain, and is capable of generating factually consistent bullet point summaries that capture the important facts discussed in the ECTs.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 3 May 2024.

Builds on

18 of 31 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  7. 2020Longformer: The Long-Document Transformercited by 3,413
  8. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  9. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  10. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
  11. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
  12. 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
6 more
  1. 2020Extractive Summarization as Text Matchingcited by 189
  2. 2017Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a surveycited by 91
  3. 2019Sentence Centrality Revisited for Unsupervised Summarizationcited by 65
  4. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  5. 2021Aspect-Controllable Opinion Summarizationcited by 47
  6. 2020Read what you need: Controllable Aspect-based Opinion Summarization of Tourist Reviewscited by 9

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.