Multi-Domain Transformer-Based Counterfactual Augmentation for Earnings Call Analysis
Not on the map. Why?
Abstract (arXiv)
Earnings call (EC), as a periodic teleconference of a publicly-traded company, has been extensively studied as an essential market indicator because of its high analytical value in corporate fundamentals. The recent emergence of deep learning techniques has shown great promise in creating automated pipelines to benefit the EC-supported financial applications. However, these methods presume all included contents to be informative without refining valuable semantics from long-text transcript and suffer from EC scarcity issue. Meanwhile, these black-box methods possess inherent difficulties in providing human-understandable explanations. To this end, in this paper, we propose a Multi-Domain Transformer-Based Counterfactual Augmentation, named MTCA, to address the above problems. Specifically, we first propose a transformer-based EC encoder to attentively quantify the task-inspired significance of critical EC content for market inference. Then, a multi-domain counterfactual learning framework is developed to evaluate the gradient-based variations after we perturb limited EC informative texts with plentiful cross-domain documents, enabling MTCA to perform unsupervised data augmentation. As a bonus, we discover a way to use non-training data as instance-based explanations for which we show the result with case studies. Extensive experiments on the real-world financial datasets demonstrate the effectiveness of interpretable MTCA for improving the volatility evaluation ability of the state-of-the-art by 14.2% in accuracy.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 2 Dec 2021.
Builds on
15 of 33 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2019Attention is not Explanationcited by 929
- 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 341
- 2020Sparse Sinkhorn Attentioncited by 251
- 2019Interpretable Counterfactual Explanations Guided by Prototypescited by 223
- 2021R-Drop: Regularized Dropout for Neural Networkscited by 202
- 2019Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphologycited by 200
Built on by
Citing papers per year: 2022: 1.
1 paper.