From Clicks to Intent: Cross-Platform Session Embeddings with LLM-Distilled Taxonomy for Financial Services Recommendations
Not on the map. Why?
Abstract (arXiv)
Sequential user behavior modeling is widely adopted in industrial recommender systems; however, significant gaps remain in financial services, where pre-login web interactions and authenticated in-app experiences differ drastically. Specifically, pre-login web users typically explore new products, whereas logged-in app users focus on account servicing. Due to the challenge of cross-channel entity resolution (e.g., matching anonymous web sessions to authenticated mobile accounts), web-based intent signals remain underutilized for post-authentication personalization. Existing methods for capturing web-based intent are often ad-hoc and narrow, lacking the flexibility to support both quantitative downstream recommendations and qualitative understanding at scale. In this work, we propose a scalable and dual-purpose intent prediction framework for web-based interactions and demonstrate its applicability for personalization. Our approach transforms raw web clickstreams into two outputs: a self-supervised Transformer encodes multi-modal clickstreams into a compact session embedding, while an LLM-based taxonomy generation and distillation pipeline produces interpretable intent labels. Our system demonstrates that self-supervised clickstream representations combined with LLM-distilled taxonomies can jointly serve quantitative tasks and qualitative understanding in production: on the mobile homepage tile ranking task, the session embedding improves macro Recall@1 by 1.88% and reduces Log Loss by 13.38% over production baselines. On the user conversion prediction task, the embedding outperforms the LLM labels by 4.3% on micro F1, while the distillation layer delivers interpretable labels at ultra-low latency with only a 7% performance drop.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
19 of 28 references.
References · 19
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 737
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2021Want To Reduce Labeling Cost? GPT-3 Can Helpcited by 196
- 2019Behavior Sequence Transformer for E-commerce Recommendation in Alibabacited by 130
- 2019Multi-Interest Network with Dynamic Routing for Recommendation at Tmallcited by 114
- 2018Learning Tree-based Deep Model for Recommender Systemscited by 99
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 91
- 2025Organize the Web: Constructing Domains Enhances Pre-Training Data Curationcited by 76
7 more
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 70
- 2023Goal-Driven Explainable Clustering via Language Descriptionscited by 58
- 2018TaxoGen: Unsupervised Topic Taxonomy Construction by Adaptive Term Embedding and Clusteringcited by 49
- 2023Using Large Language Models to Generate, Validate, and Apply User Intent Taxonomiescited by 34
- 2024Taxonomy-Guided Zero-Shot Recommendations with LLMscited by 15
- 2024TRACE: Transformer-based user Representations from Attributed Clickstream Event sequencescited by 3
- 2024TIMeSynC: Temporal Intent Modelling with Synchronized Context Encodings for Financial Service Applicationscited by 2
Built on by
Not cited yet.