mlsanityData to 7 Oct 2026

Robust Interaction-Based Relevance Modeling for Online e-Commerce Search

arXiv 2406.02135 ↗First posted 4 Jun 2024cs.IR cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Semantic relevance calculation is crucial for e-commerce search engines, as it ensures that the items selected closely align with customer intent. Inadequate attention to this aspect can detrimentally affect user experience and engagement. Traditional text-matching techniques are prevalent but often fail to capture the nuances of search intent accurately, so neural networks now have become a preferred solution to processing such complex text matching. Existing methods predominantly employ representation-based architectures, which strike a balance between high traffic capacity and low latency. However, they exhibit significant shortcomings in generalization and robustness when compared to interaction-based architectures. In this work, we introduce a robust interaction-based modeling paradigm to address these shortcomings. It encompasses 1) a dynamic length representation scheme for expedited inference, 2) a professional terms recognition method to identify subjects and core attributes from complex sentence structures, and 3) a contrastive adversarial training protocol to bolster the model's robustness and matching capabilities. Extensive offline evaluations demonstrate the superior robustness and effectiveness of our approach, and online A/B testing confirms its ability to improve relevance in the same exposure position, resulting in more clicks and conversions. To the best of our knowledge, this method is the first interaction-based approach for large e-commerce search relevance calculation. Notably, we have deployed it for the entire search traffic on alibaba.com, the largest B2B e-commerce platform in the world.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 26 of its 46 references that are in the map. First posted on arXiv 4 Jun 2024.

Builds on

26 of 46 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  5. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  6. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  7. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  8. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  9. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  10. 2019Passage Re-ranking with BERTcited by 629
  11. 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
  12. 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 261
14 more
  1. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
  2. 2019Multi-Stage Document Ranking with BERTcited by 200
  3. 2021Whitening Sentence Representations for Better Semantics and Faster Retrievalcited by 198
  4. 2019StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understandingcited by 108
  5. 2020Automated Concatenation of Embeddings for Structured Predictioncited by 86
  6. 2016Text Matching as Image Recognitioncited by 59
  7. 2015Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrievalcited by 54
  8. 2016Match-SRNN: Modeling the Recursive Matching Structure with Spatial RNNcited by 27
  9. 2014Semantic Modelling with Long-Short-Term Memory for Information Retrievalcited by 17
  10. 2018Heated-Up Softmax Embeddingcited by 15
  11. 2020Structure-Level Knowledge Distillation For Multilingual Sequence Labelingcited by 13
  12. 2022A Multi-task Learning Framework for Product Ranking with BERTcited by 7
  13. 2020BERT2DNN: BERT Distillation with Massive Unlabeled Data for Online E-Commerce Searchcited by 6
  14. 2021Simple Contrastive Representation Adversarial Learning for NLP Taskscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.