# Hierarchically Fusing Long and Short-Term User Interests for Click-Through Rate Prediction in Product Search

arXiv: https://arxiv.org/abs/2304.02089 · HTML: https://mlsanity.com/paper/2304.02089/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 34 references that are in the map.
- First posted on arXiv 4 Apr 2023.

## Builds on (most cited first, 17 of 17)

- [On the Properties of Neural Machine Translation: Encoder-Decoder Approaches](https://mlsanity.com/paper/1409.1259/) (2014)
- [Wide & Deep Learning for Recommender Systems](https://mlsanity.com/paper/1606.07792/) (2016)
- [DeepFM: A Factorization-Machine based Neural Network for CTR Prediction](https://mlsanity.com/paper/1703.04247/) (2017)
- [Deep Interest Network for Click-Through Rate Prediction](https://mlsanity.com/paper/1706.06978/) (2017)
- [Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering](https://mlsanity.com/paper/1602.01585/) (2016)
- [Deep Interest Evolution Network for Click-Through Rate Prediction](https://mlsanity.com/paper/1809.03672/) (2018)
- [Towards Causal Representation Learning](https://mlsanity.com/paper/2102.11107/) (2021)
- [Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning](https://mlsanity.com/paper/2103.00113/) (2021)
- [Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Things](https://mlsanity.com/paper/2011.08612/) (2020)
- [Embedding-based Product Retrieval in Taobao Search](https://mlsanity.com/paper/2106.09297/) (2021)
- [FM2: Field-matrixed Factorization Machines for Recommender Systems](https://mlsanity.com/paper/2102.12994/) (2021)
- [SAR-Net: A Scenario-Aware Ranking Network for Personalized Fair Recommendation in Hundreds of Travel Scenarios](https://mlsanity.com/paper/2110.06475/) (2021)
- [Disentangling Long and Short-Term Interests for Recommendation](https://mlsanity.com/paper/2202.13090/) (2022)
- [A Transformer-based Embedding Model for Personalized Product Search](https://mlsanity.com/paper/2005.08936/) (2020)
- [A Zero Attention Model for Personalized Product Search](https://mlsanity.com/paper/1908.11322/) (2019)
- [Attentive Long Short-Term Preference Modeling for Personalized Product Search](https://mlsanity.com/paper/1811.10155/) (2018)
- [Deep Interest Highlight Network for Click-Through Rate Prediction in Trigger-Induced Recommendation](https://mlsanity.com/paper/2202.08959/) (2022)

## Built on by (most cited first, 3 of 3)

- [An Enhanced Batch Query Architecture in Real-time Recommendation](https://mlsanity.com/paper/2409.00400/) (2024)
- [DELTA: Dynamic Embedding Learning with Truncated Conscious Attention for CTR Prediction](https://mlsanity.com/paper/2305.04891/) (2023)
- [Interest Entanglement: The Hidden Barrier to Blind Super-Resolution Optimization](https://mlsanity.com/paper/2606.22353/) (2026)

## Abstract (arXiv)

Estimating Click-Through Rate (CTR) is a vital yet challenging task in personalized product search. However, existing CTR methods still struggle in the product search settings due to the following three challenges including how to more effectively extract users' short-term interests with respect to multiple aspects, how to extract and fuse users' long-term interest with short-term interests, how to address the entangling characteristic of long and short-term interests. To resolve these challenges, in this paper, we propose a new approach named Hierarchical Interests Fusing Network (HIFN), which consists of four basic modules namely Short-term Interests Extractor (SIE), Long-term Interests Extractor (LIE), Interests Fusion Module (IFM) and Interests Disentanglement Module (IDM). Specifically, SIE is proposed to extract user's short-term interests by integrating three fundamental interests encoders within it namely query-dependent, target-dependent and causal-dependent interest encoder, respectively, followed by delivering the resultant representation to the module LIE, where it can effectively capture user long-term interests by devising an attention mechanism with respect to the short-term interests from SIE module. In IFM, the achieved long and short-term interests are further fused in an adaptive manner, followed by concatenating it with original raw context features for the final prediction result. Last but not least, considering the entangling characteristic of long and short-term interests, IDM further devises a self-supervised framework to disentangle long and short-term interests. Extensive offline and online evaluations on a real-world e-commerce platform demonstrate the superiority of HIFN over state-of-the-art methods.
