Source-Side Sufficiency for the Information Bottleneck: Exact Reduction and Finite-Block Equivalence
Not on the map. Why?
Abstract (arXiv)
The input side of the Information Bottleneck may contain task-irrelevant variation that still costs rate. We identify this cost exactly. Let T be a source and C a relevance variable. Suppose the deterministic statistic Z = phi(T) satisfies C-Z-T. For any encoder p(X|T), its conditional average over the fibres of phi preserves I(X;C) and lowers the rate by I(X;T|Z). The reverse pullback preserves both coordinates. These maps establish equality of the relevance-rate curves and Lagrangian infima on standard Borel spaces for every tradeoff parameter. They also characterise all attained optima. Every full-source minimiser factors through Z, and every reduced minimiser pulls back to T. When C is finite and distortion is logarithmic loss, replacement of T^n by Z^n also preserves the optimal remote distortion at every blocklength and message budget. The operational rate-distortion functions are therefore equal.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 35 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
8 of 35 references.
References · 8
- 2016Deep Variational Information Bottleneckcited by 915
- 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 213
- 2018Caveats for information bottleneck in deterministic scenarioscited by 34
- 2020On the Information Bottleneck Problems: Models, Connections, Applications and Information Theoretic Viewscited by 28
- 2020Bottleneck Problems: Information and Estimation-Theoretic Viewcited by 10
- 2017Gaussian Lower Bound for the Information Bottleneck Limitcited by 5
- 2018Generalizing Bottleneck Problemscited by 5
- 2024Partial information decomposition: redundancy as information bottleneckcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026On Task Scope and Information Retention in Source Codingcited by 0
- 2026On Task Scope and Information Retention in Source Coding29 Sep 2026