mlsanityData to 14 Oct 2026

Neural Information Causality

arXiv 2605.09316 ↗First posted 10 May 2026quant-ph cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Query-separated computation forces a representation to play an operational role: data are encoded before a query is known, and a later decoder can answer only through the intermediate interface. In this regime the representation functions as a message rather than merely as a feature map. We formalize this observation by embedding information causality (IC) into representation learning, obtaining a framework called neural information causality (Neural-IC). The revised formulation separates two logically distinct statements. First, every query-separated architecture induces a random-access communication experiment and obeys the embedding inequality I_mathrmN-RAC≤ I(vec a:H,B). Second, any independently certified physical capacity bound on the interface, such as a hard m-bit alphabet, a finite-precision register, or a power-constrained noisy channel, implies I_mathrmN-RAC≤ CH. This separation avoids treating capacity as a post hoc definition and makes Neural-IC an operational diagnostic for query leakage, precision leakage, and episode-specific memory. We also provide an exact one-bit classical RAC benchmark, showing explicitly that the relevant quantum enhancement is not total information beyond the bottleneck, but fair query-conditioned access. For CHSH-type correlation layers, nested Neural-RAC protocols multiply correlation biases across depth; requiring stability of a one-bit bottleneck for arbitrary depth selects the Tsirelson threshold. We extend the analysis to asymmetric seed biases, to multi-capacity finite-depth phase diagrams, and to correlated data via a conditional information score. Controlled simulations, including straight-through binary bottlenecks and deliberately leaky ablations, verify that apparent violations are accounted for by broken query separation or undercounted capacity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 34 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

7 of 34 references.

References · 7

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2016Deep Variational Information Bottleneckcited by 930
  4. 2020Variational Quantum Algorithmscited by 692
  5. 2018Barren plateaus in quantum neural network training landscapescited by 630
  6. 2023How Does Information Bottleneck Help Deep Learning?cited by 93
  7. 2015Sponges and Engines: An introduction to Keccak and Keyakcited by 1

Built on by

Not cited yet.