mlsanityData to 14 Oct 2026

Gaussian Partial Information Decomposition: Bias Correction and Application to High-dimensional Data

arXiv 2307.10515 ↗First posted 20 Jul 2023cs.IT math.IT q-bio.NCcited by 17

Not on the map. Why?

Abstract (arXiv)

Recent advances in neuroscientific experimental techniques have enabled us to simultaneously record the activity of thousands of neurons across multiple brain regions. This has led to a growing need for computational tools capable of analyzing how task-relevant information is represented and communicated between several brain regions. Partial information decompositions (PIDs) have emerged as one such tool, quantifying how much unique, redundant and synergistic information two or more brain regions carry about a task-relevant message. However, computing PIDs is computationally challenging in practice, and statistical issues such as the bias and variance of estimates remain largely unexplored. In this paper, we propose a new method for efficiently computing and estimating a PID definition on multivariate Gaussian distributions. We show empirically that our method satisfies an intuitive additivity property, and recovers the ground truth in a battery of canonical examples, even at high dimensionality. We also propose and evaluate, for the first time, a method to correct the bias in PID estimates at finite sample sizes. Finally, we demonstrate that our Gaussian PID effectively characterizes inter-areal interactions in the mouse brain, revealing higher redundancy between visual areas when a stimulus is behaviorally relevant.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Jul 2023.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 6; 2026: 7.

17 papers.

Sort:

By area:

  1. 2024Quantifying Knowledge Distillation Using Partial Information Decompositioncited by 13
  2. 2024Towards Formalizing Spuriousness of Biased Datasets Using Partial Information Decompositioncited by 6
  3. 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributionscited by 5
  4. 2025Massively Multimodal Foundation Models: A Framework for Capturing Interactions with Specialized Mixture-of-Expertscited by 4
  5. 2024SOmegaI: Score-based O-INFORMATION Estimationcited by 3
  6. 2024A Unified View of Group Fairness Tradeoffs Using Partial Information Decompositioncited by 3
  7. 2026Auditing Language Model Unlearning via Information Decompositioncited by 3
  8. 2025Broadcast Channel Cooperative Gain: An Operational Interpretation of Partial Information Decompositioncited by 2
  9. 2025Explainable Multimodal Regression via Information Decompositioncited by 2
  10. 2025Learning Invariant Graph Representations Through Redundant Informationcited by 1
  11. 2025Information-theoretic signatures of causality in Bayesian networks and hypergraphscited by 0
  12. 2026Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathologycited by 0
5 more
  1. 2026ALICE: In-context, Zero-shot, Mutual Information Estimationcited by 0
  2. 2026Structured Latent Modeling for Supervised Multimodal Information Decompositioncited by 0
  3. 2026Interpreting Reasoning of Large Language Models via Partial Information Decompositioncited by 0
  4. 2026Gaussian BROJA Partial Information Decomposition in Closed Formcited by 0
  5. 2026Are Multimodal Benchmarks Really Useful? Item-Level Multimodal Benchmark Diagnosis via Structure-Response Co-Calibrationcited by 0