Multimodal Banking Dataset: Understanding Client Needs through Event Sequences
Not on the map. Why?
Abstract (arXiv)
Financial organizations collect a huge amount of temporal (sequential) data about clients, which is typically collected from multiple sources (modalities). Despite the urgent practical need, developing deep learning techniques suitable to handle such data is limited by the absence of large open-source multi-source real-world datasets of event sequences. To fill this gap, which is mainly caused by security reasons, we present the first industrial-scale publicly available multimodal banking dataset, MBD, that contains information on more than 2M corporate clients of a large bank. Clients are represented by several data sources: 950M bank transactions, 1B geo position events, 5M embeddings of dialogues with technical support, and monthly aggregated purchases of four bank products. All entries are properly anonymized from real proprietary bank data, and the experiments confirm that our anonymization still saves all significant information for introduced downstream tasks. Moreover, we introduce a novel multimodal benchmark suggesting several important practical tasks, such as future purchase prediction and modality matching. The benchmark incorporates our MBD and two public financial datasets. We provide numerical results for the state-of-the-art event sequence modeling techniques including large language models and demonstrate the superiority of fusion baselines over single-modal techniques for each task. Thus, MBD provides a valuable resource for future research in financial applications of multimodal event sequence analysis. HuggingFace Link: https://huggingface.co/datasets/ai-lab/MBD Github Link: https://github.com/Dzhambo/MBD
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 23 of its 61 references that are in the map. First posted on arXiv 26 Sep 2024.
Builds on
23 of 61 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2022Multimodal Learning with Transformers: A Surveycited by 399
- 2020Tabular Transformers for Modeling Multivariate Time Seriescited by 77
- 2015SEISMIC: A Self-Exciting Point Process Model for Predicting Tweet Popularitycited by 76
- 2023Event Stream GPT: A Data Pre-processing and Modeling Library for Generative, Pre-trained Transformers over Continuous-time Sequences of Complex Eventscited by 46
- 2020CoLES: Contrastive Learning for Event Sequences with Self-Supervisioncited by 32
- 2021LightAutoML: AutoML Solution for a Large Financial Services Ecosystemcited by 32
- 2019E.T.-RNN: Applying Deep Learning to Credit Loan Applicationscited by 26
- 2024Language Modeling on Tabular Data: A Survey of Foundations, Techniques and Evolutioncited by 19
11 more
- 2017A Dirichlet Mixture Model of Hawkes Processes for Event Sequence Clusteringcited by 16
- 2023FATA-Trans: Field And Time-Aware Transformer for Sequential Tabular Datacited by 14
- 2024Towards a Foundation Purchasing Model: Pretrained Generative Autoregression on Transaction Sequencescited by 11
- 2020Survey on Visual Analysis of Event Sequence Datacited by 10
- 2024SeqNAS: Neural Architecture Search for Event Sequence Classificationcited by 8
- 2020Analyzing and Predicting Purchase Intent in E-commerce: Anonymous vs. Identified Customerscited by 7
- 2020Gradient-based adversarial attacks on categorical sequence models via traversing an embedded worldcited by 5
- 2024Learning Transactions Representations for Information Management in Banks: Mastering Local, Global, and External Knowledgecited by 5
- 2019Learning Latent Representations of Bank Customers With The Variational Autoencodercited by 4
- 2022A Survey of Approaches for Event Sequence Analysis and Visualization using the ESeVis Frameworkcited by 3
- 2022The Long Tail of Context: Does it Exist and Matter?cited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 4.
9 papers.
- 2024EBES: Easy Benchmarking for Event Sequencescited by 6
- 2025LATTE: Learning Aligned Transactions and Textual Embeddings for Bank Clientscited by 2
- 2025Open Banking Foundational Model: Learning Language Representations from Few Financial Transactionscited by 2
- 2025Enhancing Temporal Awareness in LLMs for Temporal Point Processescited by 1
- 2026Embedding-Aware Feature Discovery: Bridging Latent Representations and Interpretable Features in Event Sequencescited by 1
- 2025How to model Human Actions distribution with Event Sequence Datacited by 0
- 2026MortarBench: Evaluating Mortgage Loan Origination Agentscited by 0
- 2026A Foundation Model for Multimodal Event Sequences in Financial Applicationscited by 0
- 2026FINESSE: An Agent-Based Simulator and Benchmark Dataset for Multimodal Financial Event Sequencescited by 0
- 2026FINESSE: An Agent-Based Simulator and Benchmark Dataset for Multimodal Financial Event Sequences9 Sep 2026
- 2026A Foundation Model for Multimodal Event Sequences in Financial Applications10 Jul 2026
- 2026MortarBench: Evaluating Mortgage Loan Origination Agents17 Jun 2026
- 2026Embedding-Aware Feature Discovery: Bridging Latent Representations and Interpretable Features in Event Sequences16 Mar 2026
- 2025Enhancing Temporal Awareness in LLMs for Temporal Point Processes29 Dec 2025
- 2025Open Banking Foundational Model: Learning Language Representations from Few Financial Transactions15 Nov 2025
- 2025How to model Human Actions distribution with Event Sequence Data7 Oct 2025
- 2025LATTE: Learning Aligned Transactions and Textual Embeddings for Bank Clients7 Aug 2025
- 2024EBES: Easy Benchmarking for Event Sequences4 Oct 2024