mlsanityData to 14 Oct 2026

Deferred is Better: A Framework for Multi-Granularity Deferred Interaction of Heterogeneous Features

arXiv 2603.12586 ↗First posted 13 Mar 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Click-through rate (CTR) prediction models estimates the probability of a user-item click by modeling interactions across a vast feature space. A fundamental yet often overlooked challenge is the inherent heterogeneity of these features: their sparsity and information content vary dramatically. For instance, categorical features like item IDs are extremely sparse, whereas numerical features like item price are relatively dense. Prevailing CTR models have largely ignored this heterogeneity, employing a uniform feature interaction strategy that inputs all features into the interaction layers simultaneously. This approach is suboptimal, as the premature introduction of low-information features can inject significant noise and mask the signals from information-rich features, which leads to model collapse and hinders the learning of robust representations. To address the above challenge, we propose a Multi-Granularity Information-Aware Deferred Interaction Network (MGDIN), which adaptively defers the introduction of features into the feature interaction process. MGDIN's core mechanism operates in two stages: First, it employs a multi-granularity feature grouping strategy to partition the raw features into distinct groups with more homogeneous information density in different granularities, thereby mitigating the effects of extreme individual feature sparsity and enabling the model to capture feature interactions from diverse perspectives. Second, a delayed interaction mechanism is implemented through a hierarchical masking strategy, which governs when and how each group participates by masking low-information groups in the early layers and progressively unmasking them as the network deepens. This deferred introduction allows the model to establish a robust understanding based on high-information features before gradually incorporating sparser information from other groups...

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

19 of 30 references.

References · 19

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
  3. 2017Deep & Cross Network for Ad Click Predictionscited by 393
  4. 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 338
  5. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
  6. 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
  7. 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 177
  8. 2017Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networkscited by 126
  9. 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
  10. 2023PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Informationcited by 60
  11. 2025MTGR: Industrial-Scale Generative Recommendation Framework in Meituancited by 49
  12. 2021MaskNet: Introducing Feature-Wise Multiplication to CTR Ranking Models by Instance-Guided Maskcited by 48
7 more
  1. 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenderscited by 42
  2. 2025OneTrans: Unified Feature Interaction and Sequence Modeling with One Transformer in Industrial Recommendercited by 35
  3. 2023EulerNet: Adaptive Feature Interaction Learning via Euler's Formula for CTR Predictioncited by 26
  4. 2017Field-aware Factorization Machines in a Real-world Online Advertising Systemcited by 21
  5. 2023Towards Deeper, Lighter and Interpretable Cross Network for CTR Predictioncited by 20
  6. 2023Hiformer: Heterogeneous Feature Interactions Learning with Transformers for Recommender Systemscited by 14
  7. 2024A Collaborative Ensemble Framework for CTR Predictioncited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024RAT: Retrieval-Augmented Transformer for Click-Through Rate Prediction
  2. 2023AdaEnsemble: Learning Adaptively Sparse Structured Ensemble Network for Click-Through Rate Prediction
  3. 2023UFIN: Universal Feature Interaction Network for Multi-Domain Click-Through Rate Prediction
  4. 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Prediction
  5. 2025DGenCTR: Towards a Universal Generative Paradigm for Click-Through Rate Prediction via Discrete Diffusion
  6. 2023FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Prediction
  7. 2025Enhancing CTR Prediction with De-correlated Expert Networks
  8. 2026PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert