mlsanityData to 14 Oct 2026

Multi-Domain Transformer-Based Counterfactual Augmentation for Earnings Call Analysis

arXiv 2112.00963 ↗First posted 2 Dec 2021cs.LG cs.AI cs.CEcited by 1

Not on the map. Why?

Abstract (arXiv)

Earnings call (EC), as a periodic teleconference of a publicly-traded company, has been extensively studied as an essential market indicator because of its high analytical value in corporate fundamentals. The recent emergence of deep learning techniques has shown great promise in creating automated pipelines to benefit the EC-supported financial applications. However, these methods presume all included contents to be informative without refining valuable semantics from long-text transcript and suffer from EC scarcity issue. Meanwhile, these black-box methods possess inherent difficulties in providing human-understandable explanations. To this end, in this paper, we propose a Multi-Domain Transformer-Based Counterfactual Augmentation, named MTCA, to address the above problems. Specifically, we first propose a transformer-based EC encoder to attentively quantify the task-inspired significance of critical EC content for market inference. Then, a multi-domain counterfactual learning framework is developed to evaluate the gradient-based variations after we perturb limited EC informative texts with plentiful cross-domain documents, enabling MTCA to perform unsupervised data augmentation. As a bonus, we discover a way to use non-training data as instance-based explanations for which we show the result with case studies. Extensive experiments on the real-world financial datasets demonstrate the effectiveness of interpretable MTCA for improving the volatility evaluation ability of the state-of-the-art by 14.2% in accuracy.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 2 Dec 2021.

Builds on

15 of 33 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2020Longformer: The Long-Document Transformercited by 3,413
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  7. 2019Attention is not Explanationcited by 929
  8. 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 341
  9. 2020Sparse Sinkhorn Attentioncited by 251
  10. 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
  11. 2021R-Drop: Regularized Dropout for Neural Networkscited by 202
  12. 2019Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphologycited by 200
3 more
  1. 2020Counterfactual Data Augmentation using Locally Factored Dynamicscited by 93
  2. 2020Robustness to Spurious Correlations in Text Classification via Automatically Generated Counterfactualscited by 67
  3. 2019On the computation of counterfactual explanations -- A surveycited by 33

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.