mlsanityData to 14 Oct 2026

Encoding Causal Macrovariables

arXiv 2111.14724 ↗First posted 29 Nov 2021cs.LG stat.MLcited by 4

Not on the map. Why?

Abstract (arXiv)

In many scientific disciplines, coarse-grained causal models are used to explain and predict the dynamics of more fine-grained systems. Naturally, such models require appropriate macrovariables. Automated procedures to detect suitable variables would be useful to leverage increasingly available high-dimensional observational datasets. This work introduces a novel algorithmic approach that is inspired by a new characterisation of causal macrovariables as information bottlenecks between microstates. Its general form can be adapted to address individual needs of different scientific goals. After a further transformation step, the causal relationships between learned variables can be investigated through additive noise models. Experiments on both simulated data and on a real climate dataset are reported. In a synthetic dataset, the algorithm robustly detects the ground-truth variables and correctly infers the causal relationships between them. In a real climate dataset, the algorithm robustly detects two variables that correspond to the two known variations of the El Nino phenomenon.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 29 Nov 2021.

Builds on

12 of 33 references.

References · 12

  1. 2013Auto-Encoding Variational Bayescited by 4,053
  2. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  3. 2015Deep Learning and the Information Bottleneck Principlecited by 802
  4. 2019On Mutual Information Maximization for Representation Learningcited by 316
  5. 2019Causality for Machine Learningcited by 243
  6. 2016Information Dropout: Learning Optimal Representations Through Noisy Computationcited by 132
  7. 2013Deep Learning of Representations: Looking Forwardcited by 84
  8. 2016Discovering Causal Signals in Imagescited by 79
  9. 2014Visual Causal Feature Learningcited by 59
  10. 2015Multi-Level Cause-Effect Systemscited by 30
  11. 2016Unsupervised Discovery of El Nino Using Causal Feature Learning on Microlevel Climate Datacited by 20
  12. 2016When the map is better than the territorycited by 17

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 1.

4 papers.