mlsanityData to 7 Oct 2026

Multimodal Generative Models for Bankruptcy Prediction Using Textual Data

arXiv 2211.08405 ↗First posted 26 Oct 2022q-fin.RM cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Textual data from financial filings, e.g., the Management's Discussion & Analysis (MDA) section in Form 10-K, has been used to improve the prediction accuracy of bankruptcy models. In practice, however, we cannot obtain the MDA section for all public companies, which limits the use of MDA data in traditional bankruptcy models, as they need complete data to make predictions. The two main reasons for the lack of MDA are: (i) not all companies are obliged to submit the MDA and (ii) technical problems arise when crawling and scrapping the MDA section. To solve this limitation, this research introduces the Conditional Multimodal Discriminative (CMMD) model that learns multimodal representations that embed information from accounting, market, and textual data modalities. The CMMD model needs a sample with all data modalities for model training. At test time, the CMMD model only needs access to accounting and market modalities to generate multimodal representations, which are further used to make bankruptcy predictions and to generate words from the missing MDA modality. With this novel methodology, it is realistic to use textual data in bankruptcy prediction models, since accounting and market data are available for all companies, unlike textual data. The empirical results of this research show that if financial regulators, or investors, were to use traditional models using MDA data, they would only be able to make predictions for 60% of the companies. Furthermore, the classification performance of our proposed methodology is superior to that of a large number of traditional classifier models, taking into account all the companies in our sample.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 69 references that are in the map. First posted on arXiv 26 Oct 2022.

Builds on

12 of 69 references.

References · 12

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  5. 2016Variational Inference: A Review for Statisticianscited by 1,466
  6. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  7. 2016Tutorial on Variational Autoencoderscited by 404
  8. 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
  9. 2016Joint Multimodal Learning with Deep Generative Modelscited by 87
  10. 2021Generalized Multimodal ELBOcited by 86
  11. 2016Deep Variational Canonical Correlation Analysiscited by 44
  12. 2021Discriminative Multimodal Learning via Conditional Priors in Generative Modelscited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.