Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising
Not on the map. Why?
Abstract (arXiv)
The advancement of the communication technology and the popularity of the smart phones foster the booming of video ads. Baidu, as one of the leading search engine companies in the world, receives billions of search queries per day. How to pair the video ads with the user search is the core task of Baidu video advertising. Due to the modality gap, the query-to-video retrieval is much more challenging than traditional query-to-document retrieval and image-to-image search. Traditionally, the query-to-video retrieval is tackled by the query-to-title retrieval, which is not reliable when the quality of tiles are not high. With the rapid progress achieved in computer vision and natural language processing in recent years, content-based search methods becomes promising for the query-to-video retrieval. Benefited from pretraining on large-scale datasets, some visionBERT methods based on cross-modal attention have achieved excellent performance in many vision-language tasks not only in academia but also in industry. Nevertheless, the expensive computation cost of cross-modal attention makes it impractical for large-scale search in industrial applications. In this work, we present a tree-based combo-attention network (TCAN) which has been recently launched in Baidu's dynamic video advertising platform. It provides a practical solution to deploy the heavy cross-modal attention for the large-scale query-to-video search. After launching tree-based combo-attention network, click-through rate gets improved by 2.29% and conversion rate get improved by 2.63%.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 84 references that are in the map. First posted on arXiv 19 Sep 2022.
Builds on
32 of 84 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016Layer Normalizationcited by 5,579
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2016Understanding deep learning requires rethinking generalizationcited by 1,657
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
20 more
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
- 2019VideoBERT: A Joint Model for Video and Language Representation Learningcited by 702
- 2015BinaryConnect: Training Deep Neural Networks with binary weights during propagationscited by 571
- 2016Learning Structured Sparsity in Deep Neural Networkscited by 538
- 2018Stacked Cross Attention for Image-Text Matchingcited by 414
- 2016Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activationscited by 413
- 2018Model compression via distillation and quantizationcited by 287
- 2017Modulating early visual processing by languagecited by 167
- 2017Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graphcited by 103
- 2018Learning Tree-based Deep Model for Recommender Systemscited by 99
- 2016End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answeringcited by 60
- 2019Joint Optimization of Tree-based Index and Deep Model for Recommender Systemscited by 37
- 2020Learning Optimal Tree Models Under Beam Searchcited by 26
- 2015Multimodal Convolutional Neural Networks for Matching Image and Sentencecited by 25
- 2016Recurrent Neural Networks With Limited Numerical Precisioncited by 12
- 2020Deep Retrieval: Learning A Retrievable Structure for Large-Scale Recommendationscited by 11
- 2013Coding for Random Projectionscited by 8
- 2018Sign-Full Random Projectionscited by 7
- 2016Binarized Neural Networks on the ImageNet Classification Taskcited by 2
Built on by
Citing papers per year: 2022: 1.
1 paper.