Efficient Natural Language Response Suggestion for Smart Reply
Not on the map. Why?
Abstract (arXiv)
This paper presents a computationally efficient machine-learned method for natural language response suggestion. Feed-forward neural networks using n-gram embedding features encode messages into vectors which are optimized to give message-response pairs a high dot-product value. An optimized search finds response suggestions. The method is evaluated in a large-scale commercial e-mail application, Inbox by Gmail. Compared to a sequence-to-sequence approach, the new system achieves the same quality at a small fraction of the computational requirements and latency.
Key facts. Cited by 228 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 40; 2023: 37; 2024: 48; 2025: 40; 2026: 33.
228 papers.
Sort:
By area:
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
- 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 175
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
- 2021TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learningcited by 116
- 2021CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIPcited by 88
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2021PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrievalcited by 50
- 2021LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrievalcited by 44
38 more
- 2021A Statutory Article Retrieval Dataset in Frenchcited by 40
- 2024GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuningcited by 40
- 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systemscited by 39
- 2025A Survey of Multimodal Retrieval-Augmented Generationcited by 37
- 2022SemEval-2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embeddingcited by 36
- 2023Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Modelscited by 35
- 2022Speaking Multiple Languages Affects the Moral Bias of Language Modelscited by 34
- 2024The Chronicles of RAG: The Retriever, the Chunk and the Generatorcited by 34
- 2022UCTopic: Unsupervised Contrastive Learning for Phrase Representations and Topic Miningcited by 33
- 2023QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operationscited by 30
- 2022Non-Contrastive Learning Meets Language-Image Pre-Trainingcited by 25
- 2021A Proposed Conceptual Framework for a Representational Approach to Information Retrievalcited by 24
- 2022LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrievalcited by 24
- 2022Decoupled Context Processing for Context Augmented Language Modelingcited by 24
- 2021Artificial intelligence in communication impacts language and social relationshipscited by 22
- 2024Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERTcited by 21
- 2023Improving Hateful Meme Detection through Retrieval-Guided Contrastive Learningcited by 20
- 2021DialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddingscited by 19
- 2022Exploring Dual Encoder Architectures for Question Answeringcited by 19
- 2022E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generationcited by 19
- 2024Pooling And Attention: What Are Effective Designs For LLM-Based Embedding Models?cited by 19
- 2022Noise-Robust De-Duplication at Scalecited by 17
- 2023Extreme Multi-Label Skill Extraction Training using Large Language Modelscited by 17
- 2021Learning to Select External Knowledge with Multi-Scale Negative Samplingcited by 16
- 2022Few-Shot Learning with Siamese Networks and Label Tuningcited by 15
- 2022DeepJoin: Joinable Table Discovery with Pre-trained Language Modelscited by 15
- 2023One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Supportcited by 15
- 2024PIRB: A Comprehensive Benchmark of Polish Dense and Hybrid Text Retrieval Methodscited by 14
- 2024MeanCache: User-Centric Semantic Caching for LLM Web Servicescited by 14
- 2022Retweet-BERT: Political Leaning Detection Using Language Features and Information Diffusion on Social Networkscited by 13
- 2022RedHOT: A Corpus of Annotated Medical Questions, Experiences, and Claims on Social Mediacited by 13
- 2022Specialized Document Embeddings for Aspect-based Similarity of Research Paperscited by 12
- 2022Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Poolingcited by 12
- 2024Deep Learning-based Computational Job Market Analysis: A Survey on Skill Extraction and Classification from Job Postingscited by 12
- 2022Training Effective Neural Sentence Encoders from Automatically Mined Paraphrasescited by 11
- 2023Social-LLM: Modeling User Behavior at Scale using Language Models and Social Network Datacited by 11
- 2024Generative Dense Retrieval: Memory Can Be a Burdencited by 11
- 2021Unsupervised Contextual Paraphrase Generation using Lexical Control and Reinforcement Learningcited by 10
50 most cited of 228 All 228 (JSON)
- 2026RPTune: Learned Context Curation for LLM Catalog Search1 Oct 2026
- 2026Automated Regulatory Compliance Question Answering in Financial Services with Domain-Adapted Retrieval-Augmented Generation24 Sep 2026
- 2026Graded-Relevance Composed Multimodal Retrieval for E-commerce Visual Search at Scale21 Sep 2026
- 2026Semantic Candidate-Job Matching: A Comparative Evaluation of Dense Embedding Models in Hybrid Retrieval20 Sep 2026
- 2026Glyph: A Multi-Strategy Agentic System for Column Description and Sensitivity-Ontology Tagging of Enterprise Data Catalogs9 Sep 2026
- 2026Multi-Functional Embedding Models for Funder Name Disambiguation in Scientific Publication Records9 Sep 2026
- 2026Embedding Models for Stance-Aware Argument Retrieval28 Aug 2026
- 2026RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature27 Aug 2026
- 2026Counterfactual Bias Testing for Application Tracking System27 Aug 2026
- 2026EVL-MCoT: Enhanced Vision-Language Multi-CoT for Harmful Meme Detection24 Jul 2026
- 2026RAGAL: A Frugal, Fully Local Retrieval-Augmented Assistant for Technical Support at a Government Agency21 Jul 2026
- 2026STEP: Career-Path Recommendation via Temporal and Educational Trajectory Modeling13 Jul 2026
38 more
- 2026Field Order Should Not Matter: Permutation-Invariant Embedding Model Fine-Tuning for Structured Metadata Retrieval29 Jun 2026
- 2026SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptation11 Jun 2026
- 2026Generalistic or Specific Embeddings, Which is Better? An Empirical Study on Search for Clinical Coding in Non-English Languages28 May 2026
- 2026Search for Coverage: Learning Coverage-Aware Retrieval with Augmented Sub-Question Answerability27 May 2026
- 2026The Multilingual Curse at the Retrieval Layer: Evidence from Amharic23 May 2026
- 2026To MRL or not to MRL: Text Embeddings are Robust to Truncation Without Matryoshka Learning, Except In Heavy Truncation Scenarios15 May 2026
- 2026ProtSent: Protein Sentence Transformers7 May 2026
- 2026ORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generation22 Apr 2026
- 2026Claim2Vec: Embedding Fact-Check Claims for Multilingual Similarity and Clustering10 Apr 2026
- 2026CLEAR: Cross-Lingual Enhancement in Alignment via Reverse-training7 Apr 2026
- 2026Domain-Adapted Retrieval for In-Context Annotation of Pedagogical Dialogue Acts3 Apr 2026
- 2026Where Experts Disagree, Models Fail: Detecting Implicit Legal Citations in French Court Decisions24 Mar 2026
- 2026PROMPT2BOX:Improving LLM Weakness Discovery and Specificity Estimation by Uncovering Entailment Structure among Prompts22 Mar 2026
- 2026Nepali Passport Question Answering: A Low-Resource Dataset for Public Service Applications4 Mar 2026
- 2026FEAST: Retrieval-Augmented Multi-Hierarchical Food Classification for the FoodEx2 System3 Mar 2026
- 2026Overton Pluralistic Reinforcement Learning for Large Language Models24 Feb 2026
- 2026Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answering20 Feb 2026
- 2026Geometry-Preserving Aggregation for Mixture-of-Experts Embedding Models15 Feb 2026
- 2026LEMUR: A Corpus for Robust Fine-Tuning of Multilingual Law Embedding Models for Retrieval10 Feb 2026
- 2026ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation19 Jan 2026
- 2026MACA: A Framework for Distilling Trustworthy LLMs into Efficient Retrievers1 Jan 2026
- 2025Skim-Aware Contrastive Learning for Efficient Document Representation30 Dec 2025
- 2025Towards Better Search with Domain-Aware Text Embeddings for C2C Marketplaces24 Dec 2025
- 2025Enhancing Job Matching: Occupation, Skill and Qualification Linking with the ESCO and EQF taxonomies2 Dec 2025
- 2025Comparative Analysis of LoRA-Adapted Embedding Models for Clinical Cardiology Text Representation24 Nov 2025
- 2025BiCA: Effective Biomedical Dense Retrieval with Citation-Aware Hard Negatives11 Nov 2025
- 2025PatenTEB: A Comprehensive Benchmark and Model Family for Patent Text Embedding25 Oct 2025
- 2025ToolDreamer: Instilling LLM Reasoning Into Tool Retrievers22 Oct 2025
- 2025A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation2 Oct 2025
- 2025Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarios18 Sep 2025
- 2025Handling Open-Vocabulary Constructs in Formalizing Specifications: Retrieval-Augmented Parsing with Expert Knowledge10 Sep 2025
- 2025Ontology-Aligned Embeddings for Data-Driven Labour Market Analytics5 Sep 2025
- 2025Stack Trace-Based Crash Deduplication with Transformer Adaptation26 Aug 2025
- 2025Enhancing Document VQA Models via Retrieval-Augmented Generation26 Aug 2025
- 2025Improving Document Retrieval Coherence for Semantically Equivalent Queries11 Aug 2025
- 2025LLMDistill4Ads: Using Cross-Encoders to Distill from LLM Signals for Advertiser Keyphrase Recommendations at eBay5 Aug 2025
- 2025fact check AI at SemEval-2025 Task 7: Multilingual and Crosslingual Fact-checked Claim Retrieval5 Aug 2025
- 2025Uncertainty-driven Embedding Convolution28 Jul 2025
50 newest of 228 All 228 (JSON)
- 2024GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuningcited by 40
- 2025A Survey of Multimodal Retrieval-Augmented Generationcited by 37
- 2023Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Modelscited by 35
- 2024The Chronicles of RAG: The Retriever, the Chunk and the Generatorcited by 34
- 2025Optimizing Retrieval Strategies for Financial Question Answering Documents in Retrieval-Augmented Generation Systemscited by 9
- 2024NUDGE: Lightweight Non-Parametric Fine-Tuning of Embeddings for Retrievalcited by 5
- 2024Multi-Field Adaptive Retrievalcited by 3
- 2025Handling Open-Vocabulary Constructs in Formalizing Specifications: Retrieval-Augmented Parsing with Expert Knowledgecited by 0
- 2025A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generationcited by 0
- 2026Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answeringcited by 0
- 2026FEAST: Retrieval-Augmented Multi-Hierarchical Food Classification for the FoodEx2 Systemcited by 0
- 2026ORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generationcited by 0
12 most cited of 16 All 16 (JSON)
- 2026Automated Regulatory Compliance Question Answering in Financial Services with Domain-Adapted Retrieval-Augmented Generation24 Sep 2026
- 2026RAGAL: A Frugal, Fully Local Retrieval-Augmented Assistant for Technical Support at a Government Agency21 Jul 2026
- 2026Search for Coverage: Learning Coverage-Aware Retrieval with Augmented Sub-Question Answerability27 May 2026
- 2026The Multilingual Curse at the Retrieval Layer: Evidence from Amharic23 May 2026
- 2026ORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generation22 Apr 2026
- 2026FEAST: Retrieval-Augmented Multi-Hierarchical Food Classification for the FoodEx2 System3 Mar 2026
- 2026Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answering20 Feb 2026
- 2025A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation2 Oct 2025
- 2025Handling Open-Vocabulary Constructs in Formalizing Specifications: Retrieval-Augmented Parsing with Expert Knowledge10 Sep 2025
- 2025A Survey of Multimodal Retrieval-Augmented Generation26 Mar 2025
- 2025Optimizing Retrieval Strategies for Financial Question Answering Documents in Retrieval-Augmented Generation Systems19 Mar 2025
- 2024Multi-Field Adaptive Retrieval26 Oct 2024
12 newest of 16 All 16 (JSON)
- 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systemscited by 39
- 2025Towards Building General Purpose Embedding Models for Industry 4.0 Agentscited by 0
- 2026Glyph: A Multi-Strategy Agentic System for Column Description and Sensitivity-Ontology Tagging of Enterprise Data Catalogscited by 0
- 2026Glyph: A Multi-Strategy Agentic System for Column Description and Sensitivity-Ontology Tagging of Enterprise Data Catalogs9 Sep 2026
- 2025Towards Building General Purpose Embedding Models for Industry 4.0 Agents14 Jun 2025
- 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systems19 Nov 2023
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
- 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 175
- 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
- 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
- 2021TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learningcited by 116
- 2021CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIPcited by 88
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2021PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrievalcited by 50
- 2021LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrievalcited by 44
12 most cited of 201 All 201 (JSON)
- 2026RPTune: Learned Context Curation for LLM Catalog Search1 Oct 2026
- 2026Graded-Relevance Composed Multimodal Retrieval for E-commerce Visual Search at Scale21 Sep 2026
- 2026Semantic Candidate-Job Matching: A Comparative Evaluation of Dense Embedding Models in Hybrid Retrieval20 Sep 2026
- 2026Multi-Functional Embedding Models for Funder Name Disambiguation in Scientific Publication Records9 Sep 2026
- 2026Embedding Models for Stance-Aware Argument Retrieval28 Aug 2026
- 2026RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature27 Aug 2026
- 2026Counterfactual Bias Testing for Application Tracking System27 Aug 2026
- 2026EVL-MCoT: Enhanced Vision-Language Multi-CoT for Harmful Meme Detection24 Jul 2026
- 2026STEP: Career-Path Recommendation via Temporal and Educational Trajectory Modeling13 Jul 2026
- 2026Field Order Should Not Matter: Permutation-Invariant Embedding Model Fine-Tuning for Structured Metadata Retrieval29 Jun 2026
- 2026SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptation11 Jun 2026
- 2026Generalistic or Specific Embeddings, Which is Better? An Empirical Study on Search for Clinical Coding in Non-English Languages28 May 2026
12 newest of 201 All 201 (JSON)