mlsanityData to 7 Oct 2026

Multi-Task Learning for Features Extraction in Financial Annual Reports

arXiv 2404.05281 ↗First posted 8 Apr 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

For assessing various performance indicators of companies, the focus is shifting from strictly financial (quantitative) publicly disclosed information to qualitative (textual) information. This textual data can provide valuable weak signals, for example through stylistic features, which can complement the quantitative data on financial performance or on Environmental, Social and Governance (ESG) criteria. In this work, we use various multi-task learning methods for financial text classification with the focus on financial sentiment, objectivity, forward-looking sentence prediction and ESG-content detection. We propose different methods to combine the information extracted from training jointly on different tasks; our best-performing method highlights the positive effect of explicitly adding auxiliary task predictions as features for the final target task during the multi-task training. Next, we use these classifiers to extract textual features from annual reports of FTSE350 companies and investigate the link between ESG quantitative scores and these features.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 37 references that are in the map. First posted on arXiv 8 Apr 2024.

Builds on

14 of 37 references.

References · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  5. 2017A Survey on Multi-Task Learningcited by 838
  6. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
  7. 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 367
  8. 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 235
  9. 2018Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Taskscited by 214
  10. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  11. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  12. 2020Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?cited by 127
2 more
  1. 2020Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimatescited by 59
  2. 2020Multi-task learning for natural language processing in the 2020s: where are we going?cited by 27

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.