# Extending Universal Approximation Guarantees: A Theoretical Justification for the Continuity of Real-World Learning Tasks

arXiv: https://arxiv.org/abs/2212.07934 · HTML: https://mlsanity.com/paper/2212.07934/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 5 of its 29 references that are in the map.
- First posted on arXiv 6 Dec 2022.

## Builds on (most cited first, 5 of 5)

- [UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction](https://mlsanity.com/paper/1802.03426/) (2018)
- [The Expressive Power of Neural Networks: A View from the Width](https://mlsanity.com/paper/1709.02540/) (2017)
- [Universal Approximation with Deep Narrow Networks](https://mlsanity.com/paper/1905.08539/) (2019)
- [Approximating Continuous Functions by ReLU Nets of Minimal Width](https://mlsanity.com/paper/1710.11278/) (2017)
- [Minimum Width for Universal Approximation](https://mlsanity.com/paper/2006.08859/) (2020)

## Abstract (arXiv)

Universal Approximation Theorems establish the density of various classes of neural network function approximators in C(K, ℝm), where K subset ℝn is compact. In this paper, we aim to extend these guarantees by establishing conditions on learning tasks that guarantee their continuity. We consider learning tasks given by conditional expectations x mapsto Eleft[Y mid X = xright], where the learning target Y = f circ L is a potentially pathological transformation of some underlying data-generating process L. Under a factorization L = T circ W for the data-generating process where T is thought of as a deterministic map acting on some random input W, we establish conditions (that might be easily verified using knowledge of T alone) that guarantee the continuity of practically textitany derived learning task x mapsto Eleft[f circ L mid X = xright]. We motivate the realism of our conditions using the example of randomized stable matching, thus providing a theoretical justification for the continuity of real-world learning tasks.