Gaussian Partial Information Decomposition: Bias Correction and Application to High-dimensional Data
Not on the map. Why?
Abstract (arXiv)
Recent advances in neuroscientific experimental techniques have enabled us to simultaneously record the activity of thousands of neurons across multiple brain regions. This has led to a growing need for computational tools capable of analyzing how task-relevant information is represented and communicated between several brain regions. Partial information decompositions (PIDs) have emerged as one such tool, quantifying how much unique, redundant and synergistic information two or more brain regions carry about a task-relevant message. However, computing PIDs is computationally challenging in practice, and statistical issues such as the bias and variance of estimates remain largely unexplored. In this paper, we propose a new method for efficiently computing and estimating a PID definition on multivariate Gaussian distributions. We show empirically that our method satisfies an intuitive additivity property, and recovers the ground truth in a battery of canonical examples, even at high dimensionality. We also propose and evaluate, for the first time, a method to correct the bias in PID estimates at finite sample sizes. Finally, we demonstrate that our Gaussian PID effectively characterizes inter-areal interactions in the mouse brain, revealing higher redundancy between visual areas when a stimulus is behaviorally relevant.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Jul 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 4; 2025: 6; 2026: 7.
17 papers.
Sort:
By area:
- 2024Quantifying Knowledge Distillation Using Partial Information Decompositioncited by 13
- 2024Towards Formalizing Spuriousness of Biased Datasets Using Partial Information Decompositioncited by 6
- 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributionscited by 5
- 2025Massively Multimodal Foundation Models: A Framework for Capturing Interactions with Specialized Mixture-of-Expertscited by 4
- 2024SOmegaI: Score-based O-INFORMATION Estimationcited by 3
- 2024A Unified View of Group Fairness Tradeoffs Using Partial Information Decompositioncited by 3
- 2026Auditing Language Model Unlearning via Information Decompositioncited by 3
- 2025Broadcast Channel Cooperative Gain: An Operational Interpretation of Partial Information Decompositioncited by 2
- 2025Explainable Multimodal Regression via Information Decompositioncited by 2
- 2025Learning Invariant Graph Representations Through Redundant Informationcited by 1
- 2025Information-theoretic signatures of causality in Bayesian networks and hypergraphscited by 0
- 2026Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathologycited by 0
5 more
- 2026ALICE: In-context, Zero-shot, Mutual Information Estimationcited by 0
- 2026Structured Latent Modeling for Supervised Multimodal Information Decompositioncited by 0
- 2026Interpreting Reasoning of Large Language Models via Partial Information Decompositioncited by 0
- 2026Gaussian BROJA Partial Information Decomposition in Closed Formcited by 0
- 2026Are Multimodal Benchmarks Really Useful? Item-Level Multimodal Benchmark Diagnosis via Structure-Response Co-Calibrationcited by 0
- 2026Are Multimodal Benchmarks Really Useful? Item-Level Multimodal Benchmark Diagnosis via Structure-Response Co-Calibration10 Oct 2026
- 2026Gaussian BROJA Partial Information Decomposition in Closed Form9 Oct 2026
- 2026Interpreting Reasoning of Large Language Models via Partial Information Decomposition30 Sep 2026
- 2026Structured Latent Modeling for Supervised Multimodal Information Decomposition28 Sep 2026
- 2026ALICE: In-context, Zero-shot, Mutual Information Estimation28 Sep 2026
- 2026Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathology2 Sep 2026
- 2026Auditing Language Model Unlearning via Information Decomposition21 Jan 2026
- 2025Explainable Multimodal Regression via Information Decomposition26 Dec 2025
- 2025Information-theoretic signatures of causality in Bayesian networks and hypergraphs23 Dec 2025
- 2025Learning Invariant Graph Representations Through Redundant Information5 Dec 2025
- 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributions6 Oct 2025
- 2025Massively Multimodal Foundation Models: A Framework for Capturing Interactions with Specialized Mixture-of-Experts30 Sep 2025
5 more
- 2025Broadcast Channel Cooperative Gain: An Operational Interpretation of Partial Information Decomposition15 Feb 2025
- 2024Quantifying Knowledge Distillation Using Partial Information Decomposition12 Nov 2024
- 2024Towards Formalizing Spuriousness of Biased Datasets Using Partial Information Decomposition29 Jun 2024
- 2024A Unified View of Group Fairness Tradeoffs Using Partial Information Decomposition7 Jun 2024
- 2024SOmegaI: Score-based O-INFORMATION Estimation8 Feb 2024
- 2024Towards Formalizing Spuriousness of Biased Datasets Using Partial Information Decompositioncited by 6
- 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributionscited by 5
- 2024SOmegaI: Score-based O-INFORMATION Estimationcited by 3
- 2024A Unified View of Group Fairness Tradeoffs Using Partial Information Decompositioncited by 3
- 2025Broadcast Channel Cooperative Gain: An Operational Interpretation of Partial Information Decompositioncited by 2
- 2025Explainable Multimodal Regression via Information Decompositioncited by 2
- 2025Learning Invariant Graph Representations Through Redundant Informationcited by 1
- 2025Information-theoretic signatures of causality in Bayesian networks and hypergraphscited by 0
- 2026Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathologycited by 0
- 2026ALICE: In-context, Zero-shot, Mutual Information Estimationcited by 0
- 2026Structured Latent Modeling for Supervised Multimodal Information Decompositioncited by 0
- 2026Gaussian BROJA Partial Information Decomposition in Closed Formcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Are Multimodal Benchmarks Really Useful? Item-Level Multimodal Benchmark Diagnosis via Structure-Response Co-Calibration10 Oct 2026
- 2026Gaussian BROJA Partial Information Decomposition in Closed Form9 Oct 2026
- 2026Structured Latent Modeling for Supervised Multimodal Information Decomposition28 Sep 2026
- 2026ALICE: In-context, Zero-shot, Mutual Information Estimation28 Sep 2026
- 2026Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathology2 Sep 2026
- 2025Explainable Multimodal Regression via Information Decomposition26 Dec 2025
- 2025Information-theoretic signatures of causality in Bayesian networks and hypergraphs23 Dec 2025
- 2025Learning Invariant Graph Representations Through Redundant Information5 Dec 2025
- 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributions6 Oct 2025
- 2025Broadcast Channel Cooperative Gain: An Operational Interpretation of Partial Information Decomposition15 Feb 2025
- 2024Towards Formalizing Spuriousness of Biased Datasets Using Partial Information Decomposition29 Jun 2024
- 2024A Unified View of Group Fairness Tradeoffs Using Partial Information Decomposition7 Jun 2024
12 newest of 13 All 13 (JSON)