mlsanityData to 7 Oct 2026

TIMeSynC: Temporal Intent Modelling with Synchronized Context Encodings for Financial Service Applications

arXiv 2410.12825 ↗First posted 1 Oct 2024q-fin.GN cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Users engage with financial services companies through multiple channels, often interacting with mobile applications, web platforms, call centers, and physical locations to service their accounts. The resulting interactions are recorded at heterogeneous temporal resolutions across these domains. This multi-channel data can be combined and encoded to create a comprehensive representation of the customer's journey for accurate intent prediction. This demands sequential learning solutions. NMT transformers achieve state-of-the-art sequential representation learning by encoding context and decoding for the next best action to represent long-range dependencies. However, three major challenges exist while combining multi-domain sequences within an encoder-decoder transformers architecture for intent prediction applications: a) aligning sequences with different sampling rates b) learning temporal dynamics across multi-variate, multi-domain sequences c) combining dynamic and static sequences. We propose an encoder-decoder transformer model to address these challenges for contextual and sequential intent prediction in financial servicing applications. Our experiments show significant improvement over the existing tabular method.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 1 Oct 2024.

Builds on

17 of 27 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2018Self-Attentive Sequential Recommendationcited by 1,169
  4. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,085
  5. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  6. 2021Revisiting Deep Learning Models for Tabular Datacited by 725
  7. 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
  8. 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
  9. 2017Recurrent Neural Networks with Top-k Gains for Session-based Recommendationscited by 165
  10. 2019Behavior Sequence Transformer for E-commerce Recommendation in Alibabacited by 128
  11. 2021Sequential Recommendation with Graph Neural Networkscited by 89
  12. 2020Tabular Transformers for Modeling Multivariate Time Seriescited by 77
5 more
  1. 2023TableGPT: Towards Unifying Tables, Nature Language and Commands into One GPTcited by 57
  2. 2023TabuLa: Harnessing Language Models for Tabular Data Synthesiscited by 42
  3. 2023FATA-Trans: Field And Time-Aware Transformer for Sequential Tabular Datacited by 14
  4. 2023One Transformer for All Time Series: Representing and Training with Time-Dependent Heterogeneous Tabular Datacited by 12
  5. 2021Transformers with multi-modal features and post-fusion context for e-commerce session-based recommendationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.