Gmail Smart Compose: Real-Time Assisted Writing
Not on the map. Why?
Abstract (arXiv)
In this paper, we present Smart Compose, a novel system for generating interactive, real-time suggestions in Gmail that assists users in writing mails by reducing repetitive typing. In the design and deployment of such a large-scale and complicated system, we faced several challenges including model selection, performance evaluation, serving and other practical issues. At the core of Smart Compose is a large-scale neural language model. We leveraged state-of-the-art machine learning techniques for language model training which enabled high-quality suggestion prediction, and constructed novel serving infrastructure for high-throughput and real-time inference. Experimental results show the effectiveness of our proposed system design and deployment approach. This system is currently being served in Gmail.
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 16; 2023: 23; 2024: 15; 2025: 10; 2026: 9.
97 papers.
Sort:
By area:
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2021Membership Inference Attacks From First Principlescited by 839
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 278
- 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
- 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 194
- 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 193
- 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
- 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
- 2022Evaluating Human-Language Model Interactioncited by 90
- 2024SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agentscited by 89
- 2021A Study of Face Obfuscation in ImageNetcited by 83
38 more
- 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
- 2024Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systemscited by 76
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
- 2021The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writerscited by 61
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 59
- 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Modelscited by 51
- 2022Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summariescited by 47
- 2021Zero-Shot Recommender Systemscited by 45
- 2021Quantum federated learning through blind quantum computingcited by 44
- 2022Memorization in NLP Fine-tuning Methodscited by 43
- 2021FRUIT: Faithfully Reflecting Updated Information in Textcited by 39
- 2023Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Promptingcited by 36
- 2023User Inference Attacks on Large Language Modelscited by 36
- 2021Membership Inference on Word Embedding and Beyondcited by 34
- 2022Training and Evaluating a Jupyter Notebook Data Science Assistantcited by 31
- 2023Privacy Implications of Retrieval-Based Language Modelscited by 31
- 2021Fast and Memory Efficient Differentially Private-SGD via JL Projectionscited by 29
- 2021Privacy Regularization: Joint Privacy-Utility Optimization in Language Modelscited by 29
- 2024Fine-Tuning Large Language Models with User-Level Differential Privacycited by 28
- 2022Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writingcited by 27
- 2023Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedbackcited by 23
- 2023The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authorscited by 22
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agencycited by 18
- 2022A Blessing of Dimensionality in Membership Inference through Regularizationcited by 17
- 2023From Commit Message Generation to History-Aware Commit Message Completioncited by 16
- 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
- 2023Next Steps for Human-Centered Generative AI: A Technical Perspectivecited by 13
- 2024Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Toolscited by 13
- 2021IGA : An Intent-Guided Authoring Assistantcited by 12
- 2022Data Isotopes for Data Provenance in DNNscited by 11
- 2023CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Modelscited by 10
- 2021Spelling Correction with Denoising Transformercited by 9
- 2023Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communicationcited by 9
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Releasecited by 9
- 2021Differentially Private n-gram Extractioncited by 8
- 2021Training Data Leakage Analysis in Language Modelscited by 7
- 2022Combing for Credentials: Active Pattern Extraction from Smart Replycited by 7
50 most cited of 97 All 97 (JSON)
- 2026Designing Proactive Thought Partners for Writing1 Sep 2026
- 2026When Do Fewer Coordinates Suffice in DP-SGD?3 Jun 2026
- 2026Micro Language Models Enable Instant Responses21 Apr 2026
- 2026DocQAC: Adaptive Trie-Guided Decoding for Effective In-Document Query Auto-Completion20 Apr 2026
- 2026Gradual Cognitive Externalization: From Modeling Cognition to Constituting It6 Apr 2026
- 2026Reactive Writers: How Co-Writing with AI Changes How We Engage with Ideas11 Mar 2026
- 2026The Conundrum of Trustworthy Research on Attacking Personally Identifiable Information Removal Techniques9 Mar 2026
- 2026Moral Mazes in the Era of LLMs6 Mar 2026
- 2026Users Mispredict Their Own Preferences for AI Writing Assistance8 Jan 2026
- 2025User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios23 Oct 2025
- 2025Secret-Protected Evolution for Differentially Private Synthetic Text Generation13 Oct 2025
- 2025AdaDPIGU: Differentially Private SGD with Adaptive Clipping and Importance-Based Gradient Updates for Deep Neural Networks9 Jul 2025
38 more
- 2025Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems8 Jul 2025
- 2025Meta-Learning Transformers to Improve In-Context Generalization7 Jul 2025
- 2025StorySage: Conversational Autobiography Writing Powered by a Multi-Agent Framework17 Jun 2025
- 2025Let's Put Ourselves in Sally's Shoes: Shoes-of-Others Prefilling Improves Theory of Mind in Large Language Models6 Jun 2025
- 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process16 Apr 2025
- 2025Content-Driven Local Response: Supporting Sentence-Level and Message-Level Mobile Email Replies With and Without AI10 Feb 2025
- 2025Understanding and Supporting Formal Email Exchange by Answering AI-Generated Questions6 Feb 2025
- 2024ChaI-TeA: A Benchmark for Evaluating Autocompletion of Interactions with LLM-based Chatbots24 Dec 2024
- 2024Quantifying the Risks of Tool-assisted Rephrasing to Linguistic Diversity23 Oct 2024
- 2024Enhancing AI Assisted Writing with One-Shot Implicit Negative Feedback14 Oct 2024
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances17 Sep 2024
- 2024Fine-Tuning Large Language Models with User-Level Differential Privacy10 Jul 2024
- 2024The Great AI Witch Hunt: Reviewers Perception and (Mis)Conception of Generative AI in Research Writing27 Jun 2024
- 2024Superposed Decoding: Multiple Generations from a Single Autoregressive Inference Pass28 May 2024
- 2024Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools27 May 2024
- 2024A Transformer-Based Approach for Smart Invocation of Automatic Code Completion23 May 2024
- 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AI22 Apr 2024
- 2024A Design Space for Intelligent and Interactive Writing Assistants21 Mar 2024
- 2024SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents13 Mar 2024
- 2024Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems27 Feb 2024
- 2024Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models18 Feb 2024
- 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency13 Feb 2024
- 2023Using Large Language Models to Accelerate Communication for Users with Severe Motor Impairments3 Dec 2023
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Release23 Nov 2023
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers15 Nov 2023
- 2023User Inference Attacks on Large Language Models13 Oct 2023
- 2023An Ensemble Approach to Personalized Real Time Predictive Writing for Experts25 Aug 2023
- 2023From Commit Message Generation to History-Aware Commit Message Completion15 Aug 2023
- 2023The Future of AI-Assisted Writing29 Jun 2023
- 2023Next Steps for Human-Centered Generative AI: A Technical Perspective27 Jun 2023
- 2023Interactive Editing for Text Summarization5 Jun 2023
- 2023Privacy Implications of Retrieval-Based Language Models24 May 2023
- 2023MAILEX: Email Event and Argument Extraction22 May 2023
- 2023Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedback15 May 2023
- 2023Now It Sounds Like You: Learning Personalized Vocabulary On Device5 May 2023
- 2023Towards Explainable AI Writing Assistants for Non-native English Speakers5 Apr 2023
- 2023Reasonable Scale Machine Learning with Open-Source Metaflow21 Mar 2023
- 2023Parachute: Evaluating Interactive Human-LM Co-writing Systems11 Mar 2023
50 newest of 97 All 97 (JSON)
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2021Membership Inference Attacks From First Principlescited by 839
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 278
- 2021Membership Inference on Word Embedding and Beyondcited by 34
- 2022A Blessing of Dimensionality in Membership Inference through Regularizationcited by 17
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Releasecited by 9
- 2023DPSUR: Accelerating Differentially Private Stochastic Gradient Descent Using Selective Update and Release23 Nov 2023
- 2023Analyzing Leakage of Personally Identifiable Information in Language Models1 Feb 2023
- 2022A Blessing of Dimensionality in Membership Inference through Regularization27 May 2022
- 2022Red Teaming Language Models with Language Models7 Feb 2022
- 2021Membership Inference Attacks From First Principles7 Dec 2021
- 2021Membership Inference on Word Embedding and Beyond21 Jun 2021
- 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 194
- 2021Adversary Instantiation: Lower Bounds for Differentially Private Machine Learningcited by 193
- 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
- 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
- 2022Evaluating Human-Language Model Interactioncited by 90
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
- 2021The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writerscited by 61
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 59
12 most cited of 88 All 88 (JSON)
- 2026Designing Proactive Thought Partners for Writing1 Sep 2026
- 2026When Do Fewer Coordinates Suffice in DP-SGD?3 Jun 2026
- 2026Micro Language Models Enable Instant Responses21 Apr 2026
- 2026DocQAC: Adaptive Trie-Guided Decoding for Effective In-Document Query Auto-Completion20 Apr 2026
- 2026Gradual Cognitive Externalization: From Modeling Cognition to Constituting It6 Apr 2026
- 2026Reactive Writers: How Co-Writing with AI Changes How We Engage with Ideas11 Mar 2026
- 2026The Conundrum of Trustworthy Research on Attacking Personally Identifiable Information Removal Techniques9 Mar 2026
- 2026Moral Mazes in the Era of LLMs6 Mar 2026
- 2026Users Mispredict Their Own Preferences for AI Writing Assistance8 Jan 2026
- 2025User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios23 Oct 2025
- 2025Secret-Protected Evolution for Differentially Private Synthetic Text Generation13 Oct 2025
- 2025AdaDPIGU: Differentially Private SGD with Adaptive Clipping and Importance-Based Gradient Updates for Deep Neural Networks9 Jul 2025
12 newest of 88 All 88 (JSON)