mlsanityData to 14 Oct 2026

From Feature Interaction to Feature Transport - A Unified Block for Scalable Recommendation Models

arXiv 2609.01655 ↗First posted 31 Aug 2026cs.IR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Unified recommendation models aim to jointly model non-sequential multi-field features and sequential user behaviors, but existing interaction-centric designs mainly focus on mixing heterogeneous tokens within each layer. We argue that scalable unified recommendation also requires controlling how intent information is carried, filtered, and preserved across stacked blocks. Inspired by flow-based representation dynamics, we introduce feature transport, a view that treats deep unified recommendation as a discrete context-conditioned representation evolution process. We propose CRAFT, a Contextual Residual Adaptive Feature Transport block, which summarizes non-sequential features into a reliability-aware contextual field and uses it to generate residual displacement and memory-preserving signals for intent and sequence representations. In this way, non-sequential context acts as an active controller of representation evolution rather than a passive object of interaction. In the TAAC2026 advertising recommendation competition, CRAFT achieves a test AUC of 0.838090, surpassing the previous leaderboard-best score of 0.83798. Scaling experiments further show that CRAFT benefits from both depth and width expansion: stacking CRAFT to six blocks improves test AUC to 0.838148, while increasing the hidden dimension reaches 0.838106. These results demonstrate the effectiveness, scalability, and generalization potential of the feature transport paradigm. Source code: https://github.com/AshleyLuo001/CRAFT

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 34 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

25 of 34 references.

References · 25

  1. 2018Self-Attentive Sequential Recommendationcited by 1,184
  2. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  3. 2016Wide & Deep Learning for Recommender Systemscited by 747
  4. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  5. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
  6. 2017Deep Interest Network for Click-Through Rate Predictioncited by 544
  7. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  8. 2017Deep & Cross Network for Ad Click Predictionscited by 393
  9. 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 338
  10. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
  11. 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
  12. 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
13 more
  1. 2017Neural Factorization Machines for Sparse Predictive Analyticscited by 183
  2. 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 177
  3. 2016Product-based Neural Networks for User Response Predictioncited by 145
  4. 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
  5. 2025LONGER: Scaling Up Long Sequence Modeling in Industrial Recommenderscited by 47
  6. 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenderscited by 42
  7. 2025OneTrans: Unified Feature Interaction and Sequence Modeling with One Transformer in Industrial Recommendercited by 35
  8. 2024TWIN V2: Scaling Ultra-Long User Behavior Sequence Modeling for Enhanced CTR Prediction at Kuaishoucited by 30
  9. 2023On the Embedding Collapse when Scaling up Recommendation Modelscited by 29
  10. 2023Hiformer: Heterogeneous Feature Interactions Learning with Transformers for Recommender Systemscited by 14
  11. 2024LiRank: Industrial Large Scale Ranking Models at LinkedIncited by 12
  12. 2025Scaling Recommender Transformers to One Billion Parameterscited by 9
  13. 2026TokenFormer: Unify the Multi-Field and Sequential Recommendation Worldscited by 3

Built on by

Not cited yet.