Intuitive Access to Smartphone Settings Using Relevance Model Trained by Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
The more new features that are being added to smartphones, the harder it becomes for users to find them. This is because the feature names are usually short, and there are just too many to remember. In such a case, the users may want to ask contextual queries that describe the features they are looking for, but the standard term frequency-based search cannot process them. This paper presents a novel retrieval system for mobile features that accepts intuitive and contextual search queries. We trained a relevance model via contrastive learning from a pre-trained language model to perceive the contextual relevance between query embeddings and indexed mobile features. Also, to make it run efficiently on-device using minimal resources, we applied knowledge distillation to compress the model without degrading much performance. To verify the feasibility of our method, we collected test queries and conducted comparative experiments with the currently deployed search baselines. The results show that our system outperforms the others on contextual sentence queries and even on usual keyword-based queries.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 15 Jul 2023.
Builds on
19 of 31 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2019Relational Knowledge Distillationcited by 873
- 2016Sequence-Level Knowledge Distillationcited by 761
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
- 2017Efficient Natural Language Response Suggestion for Smart Replycited by 228
- 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
7 more
- 2021Towards Understanding Knowledge Distillationcited by 158
- 2018Large scale distributed neural network training through online distillationcited by 144
- 2018Training Millions of Personalized Dialogue Agentscited by 126
- 2017End-to-End Neural Ad-hoc Ranking with Kernel Poolingcited by 85
- 2016Learning to Match Using Local and Distributed Representations of Text for Web Searchcited by 68
- 2017Neural Ranking Models with Weak Supervisioncited by 61
- 2017Neural Models for Information Retrievalcited by 29
Built on by
Not cited yet.