Lost and Found in Translation: Variational Diagnostics for Neural Codebook Channels
Not on the map. Why?
Abstract (arXiv)
Classical communication systems fail not only through random noise but also when transmitter and receiver use incompatible operational codebooks. Variational autoencoders (VAEs) train an encoder qφ and decoder pθ jointly, and practitioners treat the resulting latent space as a discrete code -- for clustering, conditional generation, and mechanistic interpretability. Yet standard VAE diagnostics -- ELBO, active units, mutual information, and code histograms -- certify only whether this code is used, never whether the decoder reads each latent under the encoder's code. We close this gap with the neural codebook channel Ke→ d(jmid i), a coupled encoder-decoder diagnostic whose off-diagonal mass is bounded by an architecture-free Bernoulli-KL certificate dbin(1-A ,|, barηp) ≤ barDelta controlled by the variational gap. The certificate is the operational specialization of the classical KL chain rule under disintegration to the encoder-decoder disagreement event, complemented by a constructive marginal-impossibility result: no combination of marginal histograms, entropies, active-code counts, or mutual information determines Ke→ d. We audit the certificate on four sklearn datasets (finite-grid exact, 5/5 seeds, 20/20 pairs satisfy the bound), a 2D model where the bound is non-vacuous at 2.71× the observed disagreement and the four-term identity closes within 10-4, MNIST under importance-sampling control, and a VQ-VAE attaining the predicted limit hatA=1.000. The package (Ke→ d, A, Reff, R, AU) is an audit-ready reporting unit. More broadly, the framework makes mismatched decoding -- a failure mode classical communication theory named decades ago -- visible inside a single deep generative model.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 46 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
16 of 46 references.
References · 16
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2022Toy Models of Superpositioncited by 971
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
- 2015Importance Weighted Autoencoderscited by 456
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 282
- 2022Relative representations enable zero-shot latent space communicationcited by 191
- 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 185
- 2017Latent Space Oddity: on the Curvature of Deep Generative Modelscited by 174
- 2020Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Spacecited by 114
- 2019The continuous Bernoulli: fixing a pervasive error in variational autoencoderscited by 41
4 more
- 2020Autoencoding Variational Autoencodercited by 25
- 2025Navigating the Latent Space Dynamics of Neural Modelscited by 8
- 2023Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoderscited by 7
- 2020On the Encoder-Decoder Incompatibility in Variational Text Modeling and Beyondcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2022Embrace the Gap: VAEs Perform Independent Mechanism Analysis
- 2023Codebook Features: Sparse and Discrete Interpretability for Neural Networks
- 2022SQ-VAE: Variational Bayes on Discrete Representation with Self-annealed Stochastic Quantization
- 2024Integrating Pre-Trained Language Model with Physical Layer Communications
- 2023Joint Coding-Modulation for Digital Semantic Communications via Variational Autoencoder
- 2024Transcoders Find Interpretable LLM Feature Circuits
- 2026Variational Diffusion Channel Decoder
- 2023Component Training of Turbo Autoencoders