mlsanityData to 14 Oct 2026

Federated Learning of Quantile Inference under Local Differential Privacy

arXiv 2509.21800 ↗First posted 26 Sep 2025stat.ME stat.MLcited by 2

Not on the map. Why?

Abstract (arXiv)

In this paper, we investigate federated learning for quantile inference under local differential privacy (LDP). We propose an estimator based on local stochastic gradient descent (SGD), whose local gradients are perturbed via a randomized mechanism with global parameters, making the procedure tolerant of communication and storage constraints without compromising statistical efficiency. Although the quantile loss and its corresponding gradient do not satisfy standard smoothness conditions typically assumed in existing literature, we establish asymptotic normality for our estimator as well as a functional central limit theorem. The proposed method accommodates data heterogeneity and allows each server to operate with an individual privacy budget. Furthermore, we construct confidence intervals for the target value through a self-normalization approach, thereby circumventing the need to estimate additional nuisance parameters. Extensive numerical experiments and real data application validate the theoretical guarantees of the proposed methodology.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 51 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

27 of 51 references.

References · 27

  1. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  2. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
  3. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
  4. 2018Local SGD Converges Fast and Communicates Littlecited by 605
  5. 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 434
  6. 2018cpSGD: Communication-efficient and differentially-private distributed SGDcited by 158
  7. 2017Collecting Telemetry Data Privatelycited by 149
  8. 2018Distributed Differential Privacy via Shufflingcited by 115
  9. 2019Accelerating Federated Learning via Momentum Gradient Descentcited by 76
  10. 2020Local Differential Privacy based Federated Learning for Internet of Thingscited by 75
  11. 2016Statistical Inference for Model Parameters in Stochastic Gradient Descentcited by 71
  12. 2021Instance-optimal Mean Estimation Under Differential Privacycited by 37
15 more
  1. 2019Communication-Efficient Accurate Statistical Estimationcited by 32
  2. 2021Evaluating Treatment Prioritization Rules via Rank-Weighted Average Treatment Effectscited by 31
  3. 2021Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex Lossescited by 30
  4. 2019Localized Debiased Machine Learning: Efficient Inference on Quantile Treatment Effects and Beyondcited by 23
  5. 2020Smoothed Quantile Regression with Large-Scale Inferencecited by 23
  6. 2021Differentially Private Quantilescited by 23
  7. 2018First-order Newton-type Estimator for Distributed Estimation and Inferencecited by 16
  8. 2021fairadapt: Causal Reasoning for Fair Data Pre-processingcited by 16
  9. 2019The Role of Interactivity in Local Differential Privacycited by 15
  10. 2024High Confidence Level Inference is Almost Free using Parallel Stochastic Optimizationcited by 10
  11. 2019A Distributed and Integrated Method of Moments for High-Dimensional Correlated Data Analysiscited by 7
  12. 2022Forecasting with Economic Newscited by 6
  13. 2023Online Local Differential Private Quantile Inference via Self-normalizationcited by 5
  14. 2024Asymptotic Time-Uniform Inference for Parameters in Averaged Stochastic Approximationcited by 3
  15. 2024Does Worst-Performing Agent Lead the Pack? Analyzing Agent Dynamics in Unified Distributed SGDcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.