Collecting Telemetry Data Privately
Not on the map. Why?
Abstract (arXiv)
The collection and analysis of telemetry data from users' devices is routinely performed by many software companies. Telemetry collection leads to improved user experience but poses significant risks to users' privacy. Locally differentially private (LDP) algorithms have recently emerged as the main tool that allows data collectors to estimate various population statistics, while preserving privacy. The guarantees provided by such algorithms are typically very strong for a single round of telemetry collection, but degrade rapidly when telemetry is collected regularly. In particular, existing LDP algorithms are not suitable for repeated collection of counter data such as daily app usage statistics. In this paper, we develop new LDP mechanisms geared towards repeated collection of counter data, with formal privacy guarantees even after being executed for an arbitrarily long period of time. For two basic analytical tasks, mean estimation and histogram estimation, our LDP mechanisms for repeated data collection provide estimates with comparable or even the same accuracy as existing single-round LDP collection mechanisms. We conduct empirical evaluation on real-world counter datasets to verify our theoretical results. Our mechanisms have been deployed by Microsoft to collect telemetry across millions of devices.
Key facts. Cited by 149 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 37; 2023: 24; 2024: 21; 2025: 25; 2026: 12.
149 papers.
Sort:
By area:
- 2021Deep Learning with Label Differential Privacycited by 117
- 2023Foundation Models and Fair Usecited by 116
- 2021Learning with User-Level Privacycited by 72
- 2022Privacy of Noisy Stochastic Gradient Descent: More Iterations without More Privacy Losscited by 61
- 2022Connect the Dots: Tighter Discrete Approximations of Privacy Loss Distributionscited by 52
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2021High Dimensional Differentially Private Stochastic Optimization with Heavy-tailed Datacited by 42
- 2021Federated Learning with Local Differential Privacy: Trade-offs between Privacy, Utility, and Communicationcited by 39
- 2021Private Robust Estimation by Stabilizing Convex Relaxationscited by 38
- 2021Generalized Linear Bandits with Local Differential Privacycited by 29
- 2022Stronger Privacy Amplification by Shuffling for R'enyi and Approximate Differential Privacycited by 29
- 2021Lossless Compression of Efficient Private Local Randomizerscited by 27
38 more
- 2021Differentially private inference via noisy optimizationcited by 27
- 2022A Critical Review on the Use (and Misuse) of Differential Privacy in Machine Learningcited by 27
- 2022Differentially Private Label Protection in Split Learningcited by 26
- 2022Optimal and Differentially Private Data Acquisition: Central and Local Mechanismscited by 24
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learningcited by 23
- 2022Differentially Private SGDA for Minimax Problemscited by 23
- 2022Learning to Generate Image Embeddings with User-level Differential Privacycited by 23
- 2021Differentially Private SGD with Non-Smooth Lossescited by 22
- 2021Locally Private k-Means in One Roundcited by 19
- 2021Dopamine: Differentially Private Federated Learning on Medical Datacited by 18
- 2021Private Prediction Setscited by 17
- 2021Wide Network Learning with Differential Privacycited by 17
- 2021The Role of Cross-Silo Federated Learning in Facilitating Data Sharing in the Agri-Food Sectorcited by 16
- 2021On the Renyi Differential Privacy of the Shuffle Modelcited by 16
- 2022Towards Private Learning on Decentralized Graphs with Local Differential Privacycited by 16
- 2022Faster Privacy Accounting via Evolving Discretizationcited by 15
- 2021Privately Learning Mixtures of Axis-Aligned Gaussianscited by 13
- 2022Private Convex Optimization in General Normscited by 13
- 2023Share Your Representation Only: Guaranteed Improvement of the Privacy-Utility Tradeoff in Federated Learningcited by 13
- 2021Faster Rates of Private Stochastic Convex Optimizationcited by 12
- 2022Private High-Dimensional Hypothesis Testingcited by 12
- 2023On the Efficacy of Differentially Private Few-shot Image Classificationcited by 12
- 2023User-Level Differential Privacy With Few Examples Per Usercited by 12
- 2024Why Does Differential Privacy with Large Epsilon Defend Against Practical Membership Inference Attacks?cited by 12
- 2022Protecting Global Properties of Datasets with Distribution Privacy Mechanismscited by 11
- 2024Optimal Differentially Private PCA and Estimation for Spiked Covariance Matricescited by 11
- 2024Optimal Federated Learning for Nonparametric Regression with Heterogeneous Distributed Differential Privacy Constraintscited by 10
- 2021User-Level Private Learning via Correlated Samplingcited by 9
- 2022Degree-Preserving Randomized Response for Graph Neural Networks under Local Differential Privacycited by 9
- 2022Fair NLP Models with Differentially Private Text Encoderscited by 9
- 2022Fine-grained Poisoning Attack to Local Differential Privacy Protocols for Mean and Variance Estimationcited by 9
- 2023Optimal Differentially Private Model Training with Public Datacited by 9
- 2024Analysis of Privacy Leakage in Federated Large Language Modelscited by 9
- 2021Frequency Estimation Under Multiparty Differential Privacy: One-shot and Streamingcited by 8
- 2024A Statistical Viewpoint on Differential Privacy: Hypothesis Testing, Representation and Blackwell's Theoremcited by 8
- 2024Federated Learning under Periodic Client Participation and Heterogeneous Data: A New Communication-Efficient Algorithm and Analysiscited by 8
- 2021Renyi Differential Privacy of the Subsampled Shuffle Model in Distributed Learningcited by 6
- 2021Distribution-Invariant Differential Privacycited by 6
50 most cited of 149 All 149 (JSON)
- 2026Trust-But-Verify: Poisoning-Resilient Locally Private Graph Learning Protocols7 Sep 2026
- 2026Auditing Privacy Risks in LLM-Enhanced Graph Neural Networks26 Aug 2026
- 2026ABC: Numerical Data Collection under Local Differential Privacy without Prior Knowledge6 Aug 2026
- 2026Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacy16 May 2026
- 2026DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum13 May 2026
- 2026Scalable and Private Federated Learning Using Distributed Differential Privacy and Secure Aggregation8 Apr 2026
- 2026MAPLE: Metadata Augmented Private Language Evolution26 Feb 2026
- 2026HoGS: Homophily-Oriented Graph Synthesis for Local Differentially Private GNN Training9 Feb 2026
- 2026Sequential Auditing for f-Differential Privacy6 Feb 2026
- 2026Classification Under Local Differential Privacy with Model Reversal and Model Averaging5 Feb 2026
- 2026Fundamental Limitations of Favorable Privacy-Utility Guarantees for DP-SGD15 Jan 2026
- 2026Near-Optimal Private Linear Regression via Iterative Hessian Mixing12 Jan 2026
38 more
- 2025Privacy-Utility-Bias Trade-offs for Privacy-Preserving Recommender Systems27 Nov 2025
- 2025Differential privacy from axioms26 Nov 2025
- 2025Optimal Fairness under Local Differential Privacy20 Nov 2025
- 2025Private Frequency Estimation Via Residue Number Systems14 Nov 2025
- 2025ACTG-ARL: Differentially Private Conditional Text Generation with RL-Boosted Control21 Oct 2025
- 2025High-Probability Bounds For Heterogeneous Local Differential Privacy13 Oct 2025
- 2025Locally Optimal Private Sampling: Beyond the Global Minimax10 Oct 2025
- 2025Differentially Private Wasserstein Barycenters3 Oct 2025
- 2025Federated Learning of Quantile Inference under Local Differential Privacy26 Sep 2025
- 2025Consistent Estimation of Numerical Distributions under Local Differential Privacy by Wavelet Expansion24 Sep 2025
- 2025BinaryShield: Cross-Service Threat Intelligence in LLM Services using Privacy-Preserving Fingerprints6 Sep 2025
- 2025Strategic Incentivization for Locally Differentially Private Federated Learning10 Aug 2025
- 2025Non-Asymptotic Analysis of Online Local Private Learning with SGD9 Jul 2025
- 2025On the Inherent Privacy of Zeroth Order Projected Gradient Descent8 Jul 2025
- 2025Theoretically Unmasking Inference Attacks Against LDP-Protected Clients in Federated Vision Models16 Jun 2025
- 2025Private Continuous-Time Synthetic Trajectory Generation via Mean-Field Langevin Dynamics13 Jun 2025
- 2025Differentially Private Sparse Linear Regression with Heavy-tailed Responses7 Jun 2025
- 2025Gaussian Differential Private Bootstrap by Subsampling2 May 2025
- 2025Auditing Differential Privacy in the Black-Box Setting15 Mar 2025
- 2025A Unified View of Optimal Kernel Hypothesis Testing10 Mar 2025
- 2025Data Poisoning Attacks to Locally Differentially Private Range Query Protocols5 Mar 2025
- 2025On Theoretical Limits of Learning with Label Differential Privacy20 Feb 2025
- 2025Learning from End User Data with Shuffled Differential Privacy over Kernel Densities19 Feb 2025
- 2025JoLT: Joint Probabilistic Predictions on Tabular Data Using LLMs17 Feb 2025
- 2025Learning with Differentially Private (Sliced) Wasserstein Gradients3 Feb 2025
- 2024Federated PCA and Estimation for Spiked Covariance Matrices: Optimal Rates and Efficient Algorithm23 Nov 2024
- 2024Locally Private Sampling with Public Data13 Nov 2024
- 2024Sample-Efficient Private Learning of Mixtures of Gaussians4 Nov 2024
- 2024Federated Learning under Periodic Client Participation and Heterogeneous Data: A New Communication-Efficient Algorithm and Analysis30 Oct 2024
- 2024Exactly Minimax-Optimal Locally Differentially Private Sampling30 Oct 2024
- 2024Enhancing Feature-Specific Data Protection via Bayesian Coordinate Differential Privacy24 Oct 2024
- 2024Differential Privacy on Trust Graphs15 Oct 2024
- 2024Testing Credibility of Public and Private Surveys through the Lens of Regression7 Oct 2024
- 2024A Statistical Viewpoint on Differential Privacy: Hypothesis Testing, Representation and Blackwell's Theorem14 Sep 2024
- 2024Beyond Statistical Estimation: Differentially Private Individual Computation via Shuffling26 Jun 2024
- 2024Optimal Federated Learning for Nonparametric Regression with Heterogeneous Distributed Differential Privacy Constraints10 Jun 2024
- 2024Federated Nonparametric Hypothesis Testing with Differential Privacy Constraints: Optimal Rates and Adaptive Tests10 Jun 2024
- 2024Enhancing Learning with Label Differential Privacy by Vector Approximation24 May 2024
50 newest of 149 All 149 (JSON)
- 2022Fine-grained Poisoning Attack to Local Differential Privacy Protocols for Mean and Variance Estimationcited by 9
- 2024On the Robustness of LDP Protocols for Numerical Attributes under Data Poisoning Attackscited by 5
- 2025Data Poisoning Attacks to Locally Differentially Private Range Query Protocolscited by 1
- 2026Trust-But-Verify: Poisoning-Resilient Locally Private Graph Learning Protocolscited by 0
- 2026Trust-But-Verify: Poisoning-Resilient Locally Private Graph Learning Protocols7 Sep 2026
- 2025Data Poisoning Attacks to Locally Differentially Private Range Query Protocols5 Mar 2025
- 2024On the Robustness of LDP Protocols for Numerical Attributes under Data Poisoning Attacks28 Mar 2024
- 2022Fine-grained Poisoning Attack to Local Differential Privacy Protocols for Mean and Variance Estimation24 May 2022
- 2021Deep Learning with Label Differential Privacycited by 117
- 2023Foundation Models and Fair Usecited by 116
- 2021Learning with User-Level Privacycited by 72
- 2022Privacy of Noisy Stochastic Gradient Descent: More Iterations without More Privacy Losscited by 61
- 2022Connect the Dots: Tighter Discrete Approximations of Privacy Loss Distributionscited by 52
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2021High Dimensional Differentially Private Stochastic Optimization with Heavy-tailed Datacited by 42
- 2021Federated Learning with Local Differential Privacy: Trade-offs between Privacy, Utility, and Communicationcited by 39
- 2021Private Robust Estimation by Stabilizing Convex Relaxationscited by 38
- 2021Generalized Linear Bandits with Local Differential Privacycited by 29
- 2022Stronger Privacy Amplification by Shuffling for R'enyi and Approximate Differential Privacycited by 29
- 2021Lossless Compression of Efficient Private Local Randomizerscited by 27
12 most cited of 144 All 144 (JSON)
- 2026Auditing Privacy Risks in LLM-Enhanced Graph Neural Networks26 Aug 2026
- 2026ABC: Numerical Data Collection under Local Differential Privacy without Prior Knowledge6 Aug 2026
- 2026Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacy16 May 2026
- 2026DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum13 May 2026
- 2026Scalable and Private Federated Learning Using Distributed Differential Privacy and Secure Aggregation8 Apr 2026
- 2026MAPLE: Metadata Augmented Private Language Evolution26 Feb 2026
- 2026HoGS: Homophily-Oriented Graph Synthesis for Local Differentially Private GNN Training9 Feb 2026
- 2026Sequential Auditing for f-Differential Privacy6 Feb 2026
- 2026Classification Under Local Differential Privacy with Model Reversal and Model Averaging5 Feb 2026
- 2026Fundamental Limitations of Favorable Privacy-Utility Guarantees for DP-SGD15 Jan 2026
- 2026Near-Optimal Private Linear Regression via Iterative Hessian Mixing12 Jan 2026
- 2025Privacy-Utility-Bias Trade-offs for Privacy-Preserving Recommender Systems27 Nov 2025
12 newest of 144 All 144 (JSON)