mlsanityData to 14 Oct 2026

Information Bottleneck under Perfect Privacy

arXiv 2608.11003 ↗First posted 11 Aug 2026cs.IT cs.LG math.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

In this work, we study the information bottleneck under perfect privacy, with particular emphasis on the active-rate regime, where the representation-rate constraint is binding and directly limits the achievable utility. The goal is to construct a representation that preserves utility-relevant information while remaining statistically independent of a sensitive variable. This exact independence requirement introduces an additional constraint beyond the classical rate-relevance tradeoff and must be explicitly incorporated into the optimization. To this end, we develop an alternating direction method of multipliers (ADMM)-based method tailored to the resulting problem structure. Under suitable regularity conditions, we establish global convergence of the generated sequence, characterize its convergence rate through the Kurdyka-Lojasiewicz exponent, and extend the analysis to inexact block updates.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

13 of 34 references.

References · 13

  1. 2015Global Convergence of ADMM in Nonconvex Nonsmooth Optimizationcited by 98
  2. 2014Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problemscited by 64
  3. 2014Splitting methods with variable metric for KL functionscited by 26
  4. 2019Learnability for the Information Bottleneckcited by 24
  5. 2022Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utilitycited by 12
  6. 2020Online Proximal-ADMM For Time-varying Constrained Convex Optimizationcited by 10
  7. 2020Bottleneck Problems: Information and Estimation-Theoretic Viewcited by 10
  8. 2015Information Extraction Under Privacy Constraintscited by 9
  9. 2020Multi-Block Nonconvex Nonsmooth Proximal ADMM: Convergence and Rates under Kurdyka-Lojasiewicz Propertycited by 3
  10. 2022A Linearly Convergent Douglas-Rachford Splitting Solver for Markovian Information-Theoretic Optimization Problemscited by 3
  11. 2022Proximal ADMM for Nonconvex and Nonsmooth Optimizationcited by 3
  12. 2021A Provably Convergent Information Bottleneck Solution via ADMMcited by 2
1 more
  1. 2025Perturbed Proximal Gradient ADMM for Nonconvex Composite Optimizationcited by 1

Built on by

Not cited yet.