Robust Interaction-Based Relevance Modeling for Online e-Commerce Search
Not on the map. Why?
Abstract (arXiv)
Semantic relevance calculation is crucial for e-commerce search engines, as it ensures that the items selected closely align with customer intent. Inadequate attention to this aspect can detrimentally affect user experience and engagement. Traditional text-matching techniques are prevalent but often fail to capture the nuances of search intent accurately, so neural networks now have become a preferred solution to processing such complex text matching. Existing methods predominantly employ representation-based architectures, which strike a balance between high traffic capacity and low latency. However, they exhibit significant shortcomings in generalization and robustness when compared to interaction-based architectures. In this work, we introduce a robust interaction-based modeling paradigm to address these shortcomings. It encompasses 1) a dynamic length representation scheme for expedited inference, 2) a professional terms recognition method to identify subjects and core attributes from complex sentence structures, and 3) a contrastive adversarial training protocol to bolster the model's robustness and matching capabilities. Extensive offline evaluations demonstrate the superior robustness and effectiveness of our approach, and online A/B testing confirms its ability to improve relevance in the same exposure position, resulting in more clicks and conversions. To the best of our knowledge, this method is the first interaction-based approach for large e-commerce search relevance calculation. Notably, we have deployed it for the entire search traffic on alibaba.com, the largest B2B e-commerce platform in the world.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 26 of its 46 references that are in the map. First posted on arXiv 4 Jun 2024.
Builds on
26 of 46 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2019Passage Re-ranking with BERTcited by 629
- 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
- 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 261
14 more
- 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
- 2019Multi-Stage Document Ranking with BERTcited by 200
- 2021Whitening Sentence Representations for Better Semantics and Faster Retrievalcited by 198
- 2019StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understandingcited by 108
- 2020Automated Concatenation of Embeddings for Structured Predictioncited by 86
- 2016Text Matching as Image Recognitioncited by 59
- 2015Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrievalcited by 54
- 2016Match-SRNN: Modeling the Recursive Matching Structure with Spatial RNNcited by 27
- 2014Semantic Modelling with Long-Short-Term Memory for Information Retrievalcited by 17
- 2018Heated-Up Softmax Embeddingcited by 15
- 2020Structure-Level Knowledge Distillation For Multilingual Sequence Labelingcited by 13
- 2022A Multi-task Learning Framework for Product Ranking with BERTcited by 7
- 2020BERT2DNN: BERT Distillation with Massive Unlabeled Data for Online E-Commerce Searchcited by 6
- 2021Simple Contrastive Representation Adversarial Learning for NLP Taskscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025InfoGain-RAG: Boosting Retrieval-Augmented Generation via Document Information Gain-based Reranking and Filteringcited by 8
- 2025ADORE: Autonomous Domain-Oriented Relevance Engine for E-commercecited by 2
- 2026K-CARE: Knowledge-driven Symmetrical Contextual Anchoring and Analogical Prototype Reasoning for E-commerce Relevancecited by 1
- 2026K-CARE: Knowledge-driven Symmetrical Contextual Anchoring and Analogical Prototype Reasoning for E-commerce Relevance28 Apr 2026
- 2025ADORE: Autonomous Domain-Oriented Relevance Engine for E-commerce2 Dec 2025
- 2025InfoGain-RAG: Boosting Retrieval-Augmented Generation via Document Information Gain-based Reranking and Filtering16 Sep 2025