# Algorithmic Data Analytics, Small Data Matters and Correlation versus Causation

arXiv: https://arxiv.org/abs/1309.1418 · HTML: https://mlsanity.com/paper/1309.1418/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Sep 2013.

## Built on by (most cited first, 2 of 2)

- [Reliability and Interpretability in Science and Deep Learning](https://mlsanity.com/paper/2401.07359/) (2024)
- [A Computable Piece of Uncomputable Art whose Expansion May Explain the Universe in Software Space](https://mlsanity.com/paper/2109.08523/) (2021)

## Abstract (arXiv)

This is a review of aspects of the theory of algorithmic information that may contribute to a framework for formulating questions related to complex highly unpredictable systems. We start by contrasting Shannon Entropy and Kolmogorov-Chaitin complexity epitomizing the difference between correlation and causation to then move onto surveying classical results from algorithmic complexity and algorithmic probability, highlighting their deep connection to the study of automata frequency distributions. We end showing how long-range algorithmic predicting models for economic and biological systems may require infinite computation but locally approximated short-range estimations are possible thereby showing how small data can deliver important insights into important features of complex "Big Data".