mlsanityData to 7 Oct 2026

Scaled Supervision is an Implicit Lipschitz Regularizer

arXiv 2503.14813 ↗First posted 19 Mar 2025cs.LG cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

In modern social media, recommender systems (RecSys) rely on the click-through rate (CTR) as the standard metric to evaluate user engagement. CTR prediction is traditionally framed as a binary classification task to predict whether a user will interact with a given item. However, this approach overlooks the complexity of real-world social modeling, where the user, item, and their interactive features change dynamically in fast-paced online environments. This dynamic nature often leads to model instability, reflected in overfitting short-term fluctuations rather than higher-level interactive patterns. While overfitting calls for more scaled and refined supervisions, current solutions often rely on binary labels that overly simplify fine-grained user preferences through the thresholding process, which significantly reduces the richness of the supervision. Therefore, we aim to alleviate the overfitting problem by increasing the supervision bandwidth in CTR training. Specifically, (i) theoretically, we formulate the impact of fine-grained preferences on model stability as a Lipschitz constrain; (ii) empirically, we discover that scaling the supervision bandwidth can act as an implicit Lipschitz regularizer, stably optimizing existing CTR models to achieve better generalizability. Extensive experiments show that this scaled supervision significantly and consistently improves the optimization process and the performance of existing CTR models, even without the need for additional hyperparameter tuning.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 85 references that are in the map. First posted on arXiv 19 Mar 2025.

Builds on

29 of 85 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  4. 2019When Does Label Smoothing Help?cited by 985
  5. 2016Wide & Deep Learning for Recommender Systemscited by 745
  6. 2019Graph Neural Networks for Social Recommendationcited by 711
  7. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
  8. 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
  9. 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 336
  10. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 329
  11. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 326
  12. 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 319
17 more
  1. 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 277
  2. 2017Neural Factorization Machines for Sparse Predictive Analyticscited by 183
  3. 2020The Lipschitz Constant of Self-Attentioncited by 171
  4. 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 137
  5. 2019Knowledge Graph Convolutional Networks for Recommender Systemscited by 121
  6. 2019Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Predictioncited by 54
  7. 2019Adaptive Factorization Network: Learning Adaptive-Order Feature Interactionscited by 48
  8. 2023FinalMLP: An Enhanced Two-Stream MLP Model for CTR Predictioncited by 37
  9. 2024ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLUcited by 32
  10. 2023ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Predictioncited by 27
  11. 2023EulerNet: Adaptive Feature Interaction Learning via Euler's Formula for CTR Predictioncited by 26
  12. 2022Beyond Uniform Lipschitz Condition in Differentially Private Optimizationcited by 19
  13. 2022Label-invariant Augmentation for Semi-Supervised Graph Classificationcited by 18
  14. 2023Mitigating Transformer Overconfidence via Lipschitz Regularizationcited by 15
  15. 2022Boosting Graph Neural Networks via Adaptive Knowledge Distillationcited by 14
  16. 2024Enhancing CTR Prediction through Sequential Recommendation Pre-training: Introducing the SRP4CTR Frameworkcited by 7
  17. 2024ESP-PCT: Enhanced VR Semantic Performance through Efficient Compression of Temporal and Spatial Redundancies in Point Cloud Transformerscited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.