Smart Reply: Automated Response Suggestion for Email
Not on the map. Why?
Abstract (arXiv)
In this paper we propose and investigate a novel end-to-end method for automatically generating short email responses, called Smart Reply. It generates semantically diverse suggestions that can be used as complete email responses with just one tap on mobile. The system is currently used in Inbox by Gmail and is responsible for assisting with 10% of all mobile responses. It is designed to work at very high throughput and process hundreds of millions of messages daily. The system exploits state-of-the-art, large-scale deep learning. We describe the architecture of the system as well as the challenges that we faced while building it, like response diversity and scalability. We also introduce a new method for semantic clustering of user-generated content that requires only a modest amount of explicitly labeled data.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 9; 2023: 12; 2024: 6; 2025: 6; 2026: 5.
54 papers.
Sort:
By area:
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
- 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2021The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writerscited by 61
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 59
- 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
- 2022Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summariescited by 47
- 2023Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Promptingcited by 36
- 2023Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writerscited by 32
- 2025A Survey of Personalization: From RAG to Agentcited by 26
38 more
- 2023Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedbackcited by 23
- 2021Artificial intelligence in communication impacts language and social relationshipscited by 22
- 2021Google Neural Network Models for Edge Devices: Analyzing and Mitigating Machine Learning Inference Bottleneckscited by 22
- 2023The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authorscited by 22
- 2021Investigating Memorization of Conspiracy Theories in Text Generationcited by 15
- 2024Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Toolscited by 13
- 2023"One-Size-Fits-All"? Examining Expectations around What Constitute "Fair" or "Good" NLG System Behaviorscited by 11
- 2022On Learning Mixture of Linear Regressions in the Non-Realizable Settingcited by 10
- 2021A Dataset and Baselines for Multilingual Reply Suggestioncited by 9
- 2023Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communicationcited by 9
- 2021Differentially Private n-gram Extractioncited by 8
- 2022Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentationcited by 7
- 2022Combing for Credentials: Active Pattern Extraction from Smart Replycited by 7
- 2022Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorshipcited by 7
- 2022Context-Aware Abbreviation Expansion Using Large Language Modelscited by 5
- 2022Who Wrote this? How Smart Replies Impact Language and Agency in the Workplacecited by 5
- 2023MAILEX: Email Event and Argument Extractioncited by 5
- 2025Understanding and Supporting Formal Email Exchange by Answering AI-Generated Questionscited by 5
- 2021Automatic Document Sketching: Generating Drafts from Analogous Textscited by 4
- 2021Improving Text Auto-Completion with Next Phrase Predictioncited by 4
- 2026Reactive Writers: How Co-Writing with AI Changes How We Engage with Ideascited by 4
- 2021Auto Response Generation in Online Medical Chat Servicescited by 3
- 2023Explicit and Implicit Semantic Ranking Frameworkcited by 3
- 2025Personalizing Large Language Models using Retrieval Augmented Generation and Knowledge Graphcited by 3
- 2021Language Scaling for Universal Suggested Replies Modelcited by 2
- 2025Content-Driven Local Response: Supporting Sentence-Level and Message-Level Mobile Email Replies With and Without AIcited by 2
- 2025Learning When to Quit in Sales Conversationscited by 2
- 2021A Conditional Generative Matching Model for Multi-lingual Reply Suggestioncited by 1
- 2022Efficient Deep Learning Using Non-Volatile Memory Technologycited by 1
- 2022Multimodal Learning for Non-small Cell Lung Cancer Prognosiscited by 1
- 2021Multilingual Email Zoningcited by 0
- 2021Topical Language Generation using Transformerscited by 0
- 2021A Bi-Encoder LSTM Model For Learning Unstructured Dialogscited by 0
- 2023Model-Based Simulation for Optimising Smart Replycited by 0
- 2023An Ensemble Approach to Personalized Real Time Predictive Writing for Expertscited by 0
- 2024A comprehensive study of on-device NLP applications -- VQA, automated Form filling, Smart Replies for Linguistic Codeswitchingcited by 0
- 2024Enhancing AI Assisted Writing with One-Shot Implicit Negative Feedbackcited by 0
- 2025AI-Mediated Communication Reshapes Social Structure in Opinion-Diverse Groupscited by 0
50 most cited of 54 All 54 (JSON)
- 20263-Key-Input: Exploring the Theoretical Minimum Keys for Text Entry10 Jun 2026
- 2026Micro Language Models Enable Instant Responses21 Apr 2026
- 2026Reactive Writers: How Co-Writing with AI Changes How We Engage with Ideas11 Mar 2026
- 2026Moral Mazes in the Era of LLMs6 Mar 2026
- 2026Users Mispredict Their Own Preferences for AI Writing Assistance8 Jan 2026
- 2025Learning When to Quit in Sales Conversations3 Nov 2025
- 2025AI-Mediated Communication Reshapes Social Structure in Opinion-Diverse Groups24 Oct 2025
- 2025Personalizing Large Language Models using Retrieval Augmented Generation and Knowledge Graph15 May 2025
- 2025A Survey of Personalization: From RAG to Agent14 Apr 2025
- 2025Content-Driven Local Response: Supporting Sentence-Level and Message-Level Mobile Email Replies With and Without AI10 Feb 2025
- 2025Understanding and Supporting Formal Email Exchange by Answering AI-Generated Questions6 Feb 2025
- 2024Enhancing AI Assisted Writing with One-Shot Implicit Negative Feedback14 Oct 2024
38 more
- 2024A comprehensive study of on-device NLP applications -- VQA, automated Form filling, Smart Replies for Linguistic Codeswitching23 Sep 2024
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances17 Sep 2024
- 2024Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools27 May 2024
- 2024A Design Space for Intelligent and Interactive Writing Assistants21 Mar 2024
- 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models18 Feb 2024
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers15 Nov 2023
- 2023"One-Size-Fits-All"? Examining Expectations around What Constitute "Fair" or "Good" NLG System Behaviors23 Oct 2023
- 2023Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writers22 Sep 2023
- 2023An Ensemble Approach to Personalized Real Time Predictive Writing for Experts25 Aug 2023
- 2023Model-Based Simulation for Optimising Smart Reply26 May 2023
- 2023MAILEX: Email Event and Argument Extraction22 May 2023
- 2023Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedback15 May 2023
- 2023Explicit and Implicit Semantic Ranking Framework11 Apr 2023
- 2023The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authors6 Mar 2023
- 2023Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting6 Mar 2023
- 2023Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication26 Feb 2023
- 2023Co-Writing with Opinionated Language Models Affects Users' Views1 Feb 2023
- 2022Multimodal Learning for Non-small Cell Lung Cancer Prognosis7 Nov 2022
- 2022Who Wrote this? How Smart Replies Impact Language and Agency in the Workplace7 Oct 2022
- 2022Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries19 Aug 2022
- 2022Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorship1 Aug 2022
- 2022Combing for Credentials: Active Pattern Extraction from Smart Reply14 Jul 2022
- 2022Efficient Deep Learning Using Non-Volatile Memory Technology27 Jun 2022
- 2022On Learning Mixture of Linear Regressions in the Non-Realizable Setting26 May 2022
- 2022Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation18 May 2022
- 2022Context-Aware Abbreviation Expansion Using Large Language Models8 May 2022
- 2021Sparks: Inspiration for Science Writing using Language Models14 Oct 2021
- 2021Google Neural Network Models for Edge Devices: Analyzing and Mitigating Machine Learning Inference Bottlenecks29 Sep 2021
- 2021Improving Text Auto-Completion with Next Phrase Prediction15 Sep 2021
- 2021A Conditional Generative Matching Model for Multi-lingual Reply Suggestion15 Sep 2021
- 2021Differentially Private n-gram Extraction5 Aug 2021
- 2021Automatic Document Sketching: Generating Drafts from Analogous Texts14 Jun 2021
- 2021Language Scaling for Universal Suggested Replies Model4 Jun 2021
- 2021A Dataset and Baselines for Multilingual Reply Suggestion3 Jun 2021
- 2021Auto Response Generation in Online Medical Chat Services26 Apr 2021
- 2021A Bi-Encoder LSTM Model For Learning Unstructured Dialogs25 Apr 2021
- 2021Membership Inference Attacks on Machine Learning: A Survey14 Mar 2021
- 2021Topical Language Generation using Transformers11 Mar 2021
50 newest of 54 All 54 (JSON)
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2021Membership Inference Attacks on Machine Learning: A Survey14 Mar 2021
- 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
- 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2021The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writerscited by 61
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 59
- 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
- 2022Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summariescited by 47
- 2023Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Promptingcited by 36
- 2023Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writerscited by 32
- 2023Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedbackcited by 23
- 2021Artificial intelligence in communication impacts language and social relationshipscited by 22
12 most cited of 51 All 51 (JSON)
- 20263-Key-Input: Exploring the Theoretical Minimum Keys for Text Entry10 Jun 2026
- 2026Micro Language Models Enable Instant Responses21 Apr 2026
- 2026Reactive Writers: How Co-Writing with AI Changes How We Engage with Ideas11 Mar 2026
- 2026Moral Mazes in the Era of LLMs6 Mar 2026
- 2026Users Mispredict Their Own Preferences for AI Writing Assistance8 Jan 2026
- 2025Learning When to Quit in Sales Conversations3 Nov 2025
- 2025AI-Mediated Communication Reshapes Social Structure in Opinion-Diverse Groups24 Oct 2025
- 2025Content-Driven Local Response: Supporting Sentence-Level and Message-Level Mobile Email Replies With and Without AI10 Feb 2025
- 2025Understanding and Supporting Formal Email Exchange by Answering AI-Generated Questions6 Feb 2025
- 2024Enhancing AI Assisted Writing with One-Shot Implicit Negative Feedback14 Oct 2024
- 2024A comprehensive study of on-device NLP applications -- VQA, automated Form filling, Smart Replies for Linguistic Codeswitching23 Sep 2024
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances17 Sep 2024
12 newest of 51 All 51 (JSON)