# Robust Estimation of Causal Heteroscedastic Noise Models

arXiv: https://arxiv.org/abs/2312.10102 · HTML: https://mlsanity.com/paper/2312.10102/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 31 references that are in the map.
- First posted on arXiv 15 Dec 2023.

## Builds on (most cited first, 13 of 13)

- [Causal Discovery with Continuous Additive Noise Models](https://mlsanity.com/paper/1309.6779/) (2013)
- [Neural Autoregressive Flows](https://mlsanity.com/paper/1804.00779/) (2018)
- [CAM: Causal additive models, high-dimensional order search and penalized regression](https://mlsanity.com/paper/1310.1533/) (2013)
- [On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networks](https://mlsanity.com/paper/2203.09168/) (2022)
- [Causal Autoregressive Flows](https://mlsanity.com/paper/2011.02268/) (2020)
- [Reliable training and estimation of variance networks](https://mlsanity.com/paper/1906.03260/) (2019)
- [On the Identifiability and Estimation of Causal Location-Scale Noise Models](https://mlsanity.com/paper/2210.09054/) (2022)
- [Student-t Processes as Alternatives to Gaussian Processes](https://mlsanity.com/paper/1402.4306/) (2014)
- [Identifying Patient-Specific Root Causes with the Heteroscedastic Noise Model](https://mlsanity.com/paper/2205.13085/) (2022)
- [Faithful Heteroscedastic Regression with Neural Networks](https://mlsanity.com/paper/2212.09184/) (2022)
- [Telling Cause from Effect using MDL-based Local and Global Regression](https://mlsanity.com/paper/1709.08915/) (2017)
- [Consistency of Causal Inference under the Additive Noise Model](https://mlsanity.com/paper/1312.5770/) (2013)
- [On the pitfalls of Gaussian likelihood scoring for causal discovery](https://mlsanity.com/paper/2210.11104/) (2022)

## Built on by (most cited first, 6 of 6)

- [Identifying Causal Direction via Variational Bayesian Compression](https://mlsanity.com/paper/2505.07503/) (2025)
- [Identifying Causal Direction via Dense Functional Classes](https://mlsanity.com/paper/2509.00538/) (2025)
- [Skewness-Robust Causal Discovery in Location-Scale Noise Models](https://mlsanity.com/paper/2511.14441/) (2025)
- [Bivariate Causal Discovery Using Rate-Distortion MDL: An Information Dimension Approach](https://mlsanity.com/paper/2604.05829/) (2026)
- [LxCIM: a new rank-based binary classifier performance metric invariant to local exchange of classes](https://mlsanity.com/paper/2512.10053/) (2025)
- [Moment Matters: Mean and Variance Causal Graph Discovery from Heteroscedastic Observational Data](https://mlsanity.com/paper/2602.23602/) (2026)

## Abstract (arXiv)

Distinguishing the cause and effect from bivariate observational data is the foundational problem that finds applications in many scientific disciplines. One solution to this problem is assuming that cause and effect are generated from a structural causal model, enabling identification of the causal direction after estimating the model in each direction. The heteroscedastic noise model is a type of structural causal model where the cause can contribute to both the mean and variance of the noise. Current methods for estimating heteroscedastic noise models choose the Gaussian likelihood as the optimization objective which can be suboptimal and unstable when the data has a non-Gaussian distribution. To address this limitation, we propose a novel approach to estimating this model with Student's t-distribution, which is known for its robustness in accounting for sampling variability with smaller sample sizes and extreme values without significantly altering the overall distribution shape. This adaptability is beneficial for capturing the parameters of the noise distribution in heteroscedastic noise models. Our empirical evaluations demonstrate that our estimators are more robust and achieve better overall performance across synthetic and real benchmarks.
