From Feature Interaction to Feature Transport - A Unified Block for Scalable Recommendation Models
Not on the map. Why?
Abstract (arXiv)
Unified recommendation models aim to jointly model non-sequential multi-field features and sequential user behaviors, but existing interaction-centric designs mainly focus on mixing heterogeneous tokens within each layer. We argue that scalable unified recommendation also requires controlling how intent information is carried, filtered, and preserved across stacked blocks. Inspired by flow-based representation dynamics, we introduce feature transport, a view that treats deep unified recommendation as a discrete context-conditioned representation evolution process. We propose CRAFT, a Contextual Residual Adaptive Feature Transport block, which summarizes non-sequential features into a reliability-aware contextual field and uses it to generate residual displacement and memory-preserving signals for intent and sequence representations. In this way, non-sequential context acts as an active controller of representation evolution rather than a passive object of interaction. In the TAAC2026 advertising recommendation competition, CRAFT achieves a test AUC of 0.838090, surpassing the previous leaderboard-best score of 0.83798. Scaling experiments further show that CRAFT benefits from both depth and width expansion: stacking CRAFT to six blocks improves test AUC to 0.838148, while increasing the hidden dimension reaches 0.838106. These results demonstrate the effectiveness, scalability, and generalization potential of the feature transport paradigm. Source code: https://github.com/AshleyLuo001/CRAFT
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 34 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
25 of 34 references.
References · 25
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 544
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2017Deep & Cross Network for Ad Click Predictionscited by 393
- 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 338
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
- 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
13 more
- 2017Neural Factorization Machines for Sparse Predictive Analyticscited by 183
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 177
- 2016Product-based Neural Networks for User Response Predictioncited by 145
- 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
- 2025LONGER: Scaling Up Long Sequence Modeling in Industrial Recommenderscited by 47
- 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenderscited by 42
- 2025OneTrans: Unified Feature Interaction and Sequence Modeling with One Transformer in Industrial Recommendercited by 35
- 2024TWIN V2: Scaling Ultra-Long User Behavior Sequence Modeling for Enhanced CTR Prediction at Kuaishoucited by 30
- 2023On the Embedding Collapse when Scaling up Recommendation Modelscited by 29
- 2023Hiformer: Heterogeneous Feature Interactions Learning with Transformers for Recommender Systemscited by 14
- 2024LiRank: Industrial Large Scale Ranking Models at LinkedIncited by 12
- 2025Scaling Recommender Transformers to One Billion Parameterscited by 9
- 2026TokenFormer: Unify the Multi-Field and Sequential Recommendation Worldscited by 3
Built on by
Not cited yet.