A Unified Framework for Modeling Heterogeneous Financial Data via Dual-Granularity Prompting
Not on the map. Why?
Abstract (arXiv)
Recent industrial credit scoring models remain heavily reliant on manually tuned statistical learning methods. Despite their potential, deep learning architectures have struggled to consistently outperform traditional statistical models in industrial credit scoring, largely due to the complexity of heterogeneous financial data and the challenge of modeling evolving creditworthiness. To bridge this gap, we introduce FinLangNet, a novel framework that reformulates credit scoring as a multi-scale sequential learning problem. FinLangNet processes heterogeneous financial data through a dual-module architecture that combines tabular feature extraction with temporal sequence modeling, generating probability distributions of users' future financial behaviors across multiple time horizons. A key innovation is our dual-prompt mechanism within the sequential module, which introduces learnable prompts operating at both feature-level granularity for capturing fine-grained temporal patterns and user-level granularity for aggregating holistic risk profiles. Notably, real world deployment yielded a 6.3 pp improvement in KS, along with a 9.9% reduction in bad debt rate.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 53 references that are in the map. First posted on arXiv 19 Apr 2024.
Builds on
17 of 53 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2021Revisiting Deep Learning Models for Tabular Datacited by 725
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2018Multivariate LSTM-FCNs for Time Series Classificationcited by 120
5 more
- 2017Multivariate Time Series Classification with WEASEL+MUSEcited by 53
- 2020Transparency, Auditability and eXplainability of Machine Learning Models in Credit Scoringcited by 26
- 2023Sequential Multi-Dimensional Self-Supervised Learning for Clinical Time Seriescited by 16
- 2024A Single Graph Convolution Is All You Need: Efficient Grayscale Image Classificationcited by 2
- 2023DeRisk: An Effective Deep Learning Framework for Credit Risk Prediction over Real-World Financial Datacited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.