mlsanityData to 7 Oct 2026

Extracting individual variable information for their decoupling, direct mutual information and multi-feature Granger causality

arXiv 2311.13431 ↗First posted 22 Nov 2023stat.ML cs.IT cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Working with multiple variables they usually contain difficult to control complex dependencies. This article proposes extraction of their individual information, e.g. overlineX|Y as random variable containing information from X, but with removed information about Y, by using (x,y) leftrightarrow (barx=textrmCDFX|Y=y(x),y) reversible normalization. One application can be decoupling of individual information of variables: reversibly transform (X1,ldots,Xn)leftrightarrow(tildeX1,ldots tildeXn) together containing the same information, but being independent: forallineq j tildeXiperp tildeXj, tildeXiperp Xj. It requires detailed models of complex conditional probability distributions - it is generally a difficult task, but here can be done through multiple dependency reducing iterations, using imperfect methods (here HCR: Hierarchical Correlation Reconstruction). It could be also used for direct mutual information - evaluating direct information transfer: without use of intermediate variables. For causality direction there is discussed multi-feature Granger causality, e.g. to trace various types of individual information transfers between such decoupled variables, including propagation time (delay).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 11 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

5 of 11 references.

References · 5

  1. 2020A Tutorial on Learning With Bayesian Networkscited by 56
  2. 2018Hierarchical correlation reconstruction with missing data, for example for biology-inspired neuroncited by 6
  3. 2019Modelling bid-ask spread conditional distributions using hierarchical correlation reconstructioncited by 6
  4. 2022Predicting conditional probability distributions of redshifts of Active Galactic Nuclei using Hierarchical Correlation Reconstructioncited by 4
  5. 2023Time delay multi-feature correlation analysis to extract subtle dependencies from EEG signalscited by 3

Built on by

Not cited yet.