mlsanityData to 14 Oct 2026

Beyond KAN: Introducing KarSein for Adaptive High-Order Feature Interaction Modeling in CTR Prediction

arXiv 2408.08713 ↗First posted 16 Aug 2024cs.LG cs.AI cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

Modeling high-order feature interactions is crucial for click-through rate (CTR) prediction, yet traditional approaches typically predefine a maximum interaction order and exhaustively enumerate feature combinations up to that order. This paradigm depends heavily on prior domain knowledge to delimit the interaction space and incurs substantial computational overhead. As a result, conventional CTR models face a persistent tension between enriching representations with complex high-order interactions and keeping computation tractable. To address this dual challenge, this study introduces the Kolmogorov-Arnold Represented Sparse Efficient Interaction Network (KarSein). Drawing inspiration from the learnable activation mechanism in the Kolmogorov-Arnold Network (KAN), KarSein leverages this mechanism to adaptively transform low-order basic features into high-order feature interactions, offering a novel approach to feature interaction modeling. KarSein extends the capabilities of KAN by introducing a more efficient architecture that significantly reduces computational costs while accommodating two-dimensional embedding vectors as feature inputs. Furthermore, it overcomes the limitation of KAN's its inability to spontaneously capture multiplicative relationships among features. Extensive experiments highlight the superiority of KarSein, demonstrating its ability to surpass not only the vanilla implementation of KAN in CTR prediction tasks but also other baseline methods. Remarkably, KarSein achieves exceptional predictive accuracy while maintaining a highly compact parameter size and minimal computational overhead. Moreover, KarSein exhibits strong interpretability and structural sparsity. As the first systematic adaptation of KAN to CTR prediction, KarSein offers a practical, parameter-efficient, and interpretable alternative for modeling complex feature interactions in CTR prediction.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 68 references that are in the map. First posted on arXiv 16 Aug 2024.

Builds on

35 of 68 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2017Squeeze-and-Excitation Networkscited by 4,789
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  5. 2017Neural Collaborative Filteringcited by 1,111
  6. 2016Wide & Deep Learning for Recommender Systemscited by 747
  7. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
  8. 2024KAN: Kolmogorov-Arnold Networkscited by 649
  9. 2017Deep & Cross Network for Ad Click Predictionscited by 393
  10. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  11. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
  12. 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
23 more
  1. 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
  2. 2017Neural Factorization Machines for Sparse Predictive Analyticscited by 183
  3. 2016Product-based Neural Networks for User Response Predictioncited by 145
  4. 2017Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networkscited by 126
  5. 2020Neural Collaborative Filtering vs. Matrix Factorization Revisitedcited by 123
  6. 2019FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Predictioncited by 83
  7. 2018Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertisingcited by 59
  8. 2019Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Predictioncited by 54
  9. 2022BARS: Towards Open Benchmarking for Recommender Systemscited by 54
  10. 2019Adaptive Factorization Network: Learning Adaptive-Order Feature Interactionscited by 48
  11. 2022Causal Inference in Recommender Systems: A Survey and Future Directionscited by 44
  12. 2023FinalMLP: An Enhanced Two-Stream MLP Model for CTR Predictioncited by 37
  13. 2022Click-Through Rate Prediction in Online Advertising: A Literature Reviewcited by 31
  14. 2023EulerNet: Adaptive Feature Interaction Learning via Euler's Formula for CTR Predictioncited by 26
  15. 2020Detecting Beneficial Feature Interactions for Recommender Systemscited by 22
  16. 2023Rethinking Cross-Domain Sequential Recommendation under Open-World Assumptionscited by 20
  17. 2022Enhancing CTR Prediction with Context-Aware Feature Representation Learningcited by 17
  18. 2024Kolmogorov-Arnold Networks (KAN) for Time Series Classification and Robust Analysiscited by 16
  19. 2021User Response Prediction in Online Advertisingcited by 15
  20. 2022Detecting Arbitrary Order Beneficial Feature Interactions for Recommender Systemscited by 6
  21. 2024A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systemscited by 4
  22. 2024Causal Disentanglement for Regulating Social Influence Bias in Social Recommendationcited by 2
  23. 2022Directed Acyclic Graph Factorization Machines for CTR Prediction via Knowledge Distillationcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.