mlsanityData to 7 Oct 2026

Source-Side Sufficiency for the Information Bottleneck: Exact Reduction and Finite-Block Equivalence

arXiv 2604.26744 ↗First posted 29 Apr 2026cs.IT math.IT stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

The input side of the Information Bottleneck may contain task-irrelevant variation that still costs rate. We identify this cost exactly. Let T be a source and C a relevance variable. Suppose the deterministic statistic Z = phi(T) satisfies C-Z-T. For any encoder p(X|T), its conditional average over the fibres of phi preserves I(X;C) and lowers the rate by I(X;T|Z). The reverse pullback preserves both coordinates. These maps establish equality of the relevance-rate curves and Lagrangian infima on standard Borel spaces for every tradeoff parameter. They also characterise all attained optima. Every full-source minimiser factors through Z, and every reduced minimiser pulls back to T. When C is finite and distortion is logarithmic loss, replacement of T^n by Z^n also preserves the optimal remote distortion at every blocklength and message budget. The operational rate-distortion functions are therefore equal.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 35 references that are in the map. First posted on arXiv 29 Apr 2026.

Builds on

8 of 35 references.

References · 8

  1. 2016Deep Variational Information Bottleneckcited by 915
  2. 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 213
  3. 2018Caveats for information bottleneck in deterministic scenarioscited by 34
  4. 2020On the Information Bottleneck Problems: Models, Connections, Applications and Information Theoretic Viewscited by 28
  5. 2020Bottleneck Problems: Information and Estimation-Theoretic Viewcited by 10
  6. 2017Gaussian Lower Bound for the Information Bottleneck Limitcited by 5
  7. 2018Generalizing Bottleneck Problemscited by 5
  8. 2024Partial information decomposition: redundancy as information bottleneckcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.