Telling Cause from Effect using MDL-based Local and Global Regression
Not on the map. Why?
Abstract (arXiv)
We consider the fundamental problem of inferring the causal direction between two univariate numeric random variables X and Y from observational data. The two-variable case is especially difficult to solve since it is not possible to use standard conditional independence tests between the variables. To tackle this problem, we follow an information theoretic approach based on Kolmogorov complexity and use the Minimum Description Length (MDL) principle to provide a practical solution. In particular, we propose a compression scheme to encode local and global functional relations using MDL-based regression. We infer X causes Y in case it is shorter to describe Y as a function of X than the inverse direction. In addition, we introduce Slope, an efficient linear-time algorithm that through thorough empirical evaluation on both synthetic and real world data we show outperforms the state of the art by a wide margin.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 5; 2024: 0; 2025: 6; 2026: 4.
21 papers.
Sort:
By area:
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 348
- 2022On the Identifiability and Estimation of Causal Location-Scale Noise Modelscited by 56
- 2023Self-Compatibility: Evaluating Causal Discovery without Ground Truthcited by 22
- 2022Causal Discovery in Hawkes Processes by Minimum Description Lengthcited by 11
- 2021Causal versions of Maximum Entropy and Principle of Insufficient Reasoncited by 7
- 2023Robust Estimation of Causal Heteroscedastic Noise Modelscited by 6
- 2022Ordinal Causal Discoverycited by 5
- 2023Structural restrictions in local causal discovery: identifying direct causes of a target variablecited by 5
- 2022Bivariate Causal Discovery for Categorical Data via Classification with Optimal Label Permutationcited by 3
- 2023Reinterpreting causal discovery as the task of predicting unobserved joint statisticscited by 3
- 2025Identifying Causal Direction via Variational Bayesian Compressioncited by 3
- 2025Identifying Causal Direction via Dense Functional Classescited by 3
9 more
- 2025Density Ratio-based Causal Discovery from Bivariate Continuous-Discrete Datacited by 1
- 2025Skewness-Robust Causal Discovery in Location-Scale Noise Modelscited by 1
- 2026Bivariate Causal Discovery Using Rate-Distortion MDL: An Information Dimension Approachcited by 1
- 2022Variation-based Cause Effect Identificationcited by 0
- 2025Hybrid Causal Identification and Causal Mechanism Clusteringcited by 0
- 2025LxCIM: a new rank-based binary classifier performance metric invariant to local exchange of classescited by 0
- 2026One Ruler: A Same-Hands Re-Evaluation of Bivariate Causal Direction on Tuebingen, with a Parameter-Free Compression Baselinecited by 0
- 2026MDL Meets Latent Confounders: LNML-based Causal Discoverycited by 0
- 2026Inferring Causal Relations between Two Sequences of Events with Language Modelscited by 0
- 2026Inferring Causal Relations between Two Sequences of Events with Language Models30 Sep 2026
- 2026MDL Meets Latent Confounders: LNML-based Causal Discovery5 Jul 2026
- 2026One Ruler: A Same-Hands Re-Evaluation of Bivariate Causal Direction on Tuebingen, with a Parameter-Free Compression Baseline22 Jun 2026
- 2026Bivariate Causal Discovery Using Rate-Distortion MDL: An Information Dimension Approach7 Apr 2026
- 2025LxCIM: a new rank-based binary classifier performance metric invariant to local exchange of classes10 Dec 2025
- 2025Skewness-Robust Causal Discovery in Location-Scale Noise Models18 Nov 2025
- 2025Identifying Causal Direction via Dense Functional Classes30 Aug 2025
- 2025Hybrid Causal Identification and Causal Mechanism Clustering29 Jul 2025
- 2025Density Ratio-based Causal Discovery from Bivariate Continuous-Discrete Data13 May 2025
- 2025Identifying Causal Direction via Variational Bayesian Compression12 May 2025
- 2023Robust Estimation of Causal Heteroscedastic Noise Models15 Dec 2023
- 2023Structural restrictions in local causal discovery: identifying direct causes of a target variable29 Jul 2023
9 more
- 2023Self-Compatibility: Evaluating Causal Discovery without Ground Truth18 Jul 2023
- 2023Reinterpreting causal discovery as the task of predicting unobserved joint statistics11 May 2023
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causality28 Apr 2023
- 2022Variation-based Cause Effect Identification22 Nov 2022
- 2022On the Identifiability and Estimation of Causal Location-Scale Noise Models13 Oct 2022
- 2022Bivariate Causal Discovery for Categorical Data via Classification with Optimal Label Permutation18 Sep 2022
- 2022Causal Discovery in Hawkes Processes by Minimum Description Length10 Jun 2022
- 2022Ordinal Causal Discovery19 Jan 2022
- 2021Causal versions of Maximum Entropy and Principle of Insufficient Reason7 Feb 2021
- 2022On the Identifiability and Estimation of Causal Location-Scale Noise Modelscited by 56
- 2023Self-Compatibility: Evaluating Causal Discovery without Ground Truthcited by 22
- 2022Causal Discovery in Hawkes Processes by Minimum Description Lengthcited by 11
- 2021Causal versions of Maximum Entropy and Principle of Insufficient Reasoncited by 7
- 2023Robust Estimation of Causal Heteroscedastic Noise Modelscited by 6
- 2022Ordinal Causal Discoverycited by 5
- 2023Structural restrictions in local causal discovery: identifying direct causes of a target variablecited by 5
- 2022Bivariate Causal Discovery for Categorical Data via Classification with Optimal Label Permutationcited by 3
- 2023Reinterpreting causal discovery as the task of predicting unobserved joint statisticscited by 3
- 2025Identifying Causal Direction via Variational Bayesian Compressioncited by 3
- 2025Identifying Causal Direction via Dense Functional Classescited by 3
- 2025Density Ratio-based Causal Discovery from Bivariate Continuous-Discrete Datacited by 1
12 most cited of 20 All 20 (JSON)
- 2026Inferring Causal Relations between Two Sequences of Events with Language Models30 Sep 2026
- 2026MDL Meets Latent Confounders: LNML-based Causal Discovery5 Jul 2026
- 2026One Ruler: A Same-Hands Re-Evaluation of Bivariate Causal Direction on Tuebingen, with a Parameter-Free Compression Baseline22 Jun 2026
- 2026Bivariate Causal Discovery Using Rate-Distortion MDL: An Information Dimension Approach7 Apr 2026
- 2025LxCIM: a new rank-based binary classifier performance metric invariant to local exchange of classes10 Dec 2025
- 2025Skewness-Robust Causal Discovery in Location-Scale Noise Models18 Nov 2025
- 2025Identifying Causal Direction via Dense Functional Classes30 Aug 2025
- 2025Hybrid Causal Identification and Causal Mechanism Clustering29 Jul 2025
- 2025Density Ratio-based Causal Discovery from Bivariate Continuous-Discrete Data13 May 2025
- 2025Identifying Causal Direction via Variational Bayesian Compression12 May 2025
- 2023Robust Estimation of Causal Heteroscedastic Noise Models15 Dec 2023
- 2023Structural restrictions in local causal discovery: identifying direct causes of a target variable29 Jul 2023
12 newest of 20 All 20 (JSON)