# A Comparison of Likelihood-Free Methods With and Without Summary Statistics

arXiv: https://arxiv.org/abs/2103.02407 · HTML: https://mlsanity.com/paper/2103.02407/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Mar 2021.

## Built on by (most cited first, 9 of 9)

- [Neural Methods for Amortized Inference](https://mlsanity.com/paper/2404.12484/) (2024)
- [Approximate Bayesian Computation with Path Signatures](https://mlsanity.com/paper/2106.12555/) (2021)
- [Simulation-based Bayesian inference under model misspecification](https://mlsanity.com/paper/2503.12315/) (2025)
- [Misspecification-robust Sequential Neural Likelihood for Simulation-based Inference](https://mlsanity.com/paper/2301.13368/) (2023)
- [Towards black-box parameter estimation](https://mlsanity.com/paper/2303.15041/) (2023)
- [Preconditioned Neural Posterior Estimation for Likelihood-free Inference](https://mlsanity.com/paper/2404.13557/) (2024)
- [A Comprehensive Guide to Simulation-based Inference in Computational Biology](https://mlsanity.com/paper/2409.19675/) (2024)
- [Approximate Bayesian Computation via Classification](https://mlsanity.com/paper/2111.11507/) (2021)
- [Pseudo-Likelihood Inference](https://mlsanity.com/paper/2311.16656/) (2023)

## Abstract (arXiv)

Likelihood-free methods are useful for parameter estimation of complex models with intractable likelihood functions for which it is easy to simulate data. Such models are prevalent in many disciplines including genetics, biology, ecology and cosmology. Likelihood-free methods avoid explicit likelihood evaluation by finding parameter values of the model that generate data close to the observed data. The general consensus has been that it is most efficient to compare datasets on the basis of a low dimensional informative summary statistic, incurring information loss in favour of reduced dimensionality. More recently, researchers have explored various approaches for efficiently comparing empirical distributions in the likelihood-free context in an effort to avoid data summarisation. This article provides a review of these full data distance based approaches, and conducts the first comprehensive comparison of such methods, both qualitatively and empirically. We also conduct a substantive empirical comparison with summary statistic based likelihood-free methods. The discussion and results offer guidance to practitioners considering a likelihood-free approach. Whilst we find the best approach to be problem dependent, we also find that the full data distance based approaches are promising and warrant further development. We discuss some opportunities for future research in this space. Computer code to implement the methods discussed in this paper can be found at https://github.com/cdrovandi/ABC-dist-compare.
