Density Estimation via Binless Multidimensional Integration
Not on the map. Why?
Abstract (arXiv)
We introduce the Binless Multidimensional Thermodynamic Integration (BMTI) method for nonparametric, robust, and data-efficient density estimation. BMTI estimates the logarithm of the density by initially computing log-density differences between neighbouring data points. Subsequently, such differences are integrated, weighted by their associated uncertainties, using a maximum-likelihood formulation. This procedure can be seen as an extension to a multidimensional setting of the thermodynamic integration, a technique developed in statistical physics. The method leverages the manifold hypothesis, estimating quantities within the intrinsic data manifold without defining an explicit coordinate map. It does not rely on any binning or space partitioning, but rather on the construction of a neighbourhood graph based on an adaptive bandwidth selection procedure. BMTI mitigates the limitations commonly associated with traditional nonparametric density estimators, effectively reconstructing smooth profiles even in high-dimensional embedding spaces. The method is tested on a variety of complex synthetic high-dimensional datasets, where it is shown to outperform traditional estimators, and is benchmarked on realistic datasets from the chemical physics literature.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 126 references that are in the map. First posted on arXiv 10 Jul 2024.
Builds on
19 of 126 references.
References · 19
- 2016Density estimation using Real NVPcited by 2,029
- 2014Deep Learning in Neural Networks: An Overviewcited by 765
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 307
- 2019Intrinsic dimension of data representations in deep neural networkscited by 276
- 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 246
- 2021Scikit-dimension: a Python package for intrinsic dimension estimationcited by 68
- 2023normflows: A PyTorch Package for Normalizing Flowscited by 56
- 2018Deep Energy Estimator Networkscited by 34
- 2020Analysis of KNN Density Estimationcited by 28
- 2022DADApy: Distance-based Analysis of DAta-manifolds in Pythoncited by 22
- 2018Automatic topography of high-dimensional data sets by non-parametric Density Peak clusteringcited by 15
7 more
- 2021Density estimation on low-dimensional manifolds: an inflation-deflation approachcited by 11
- 2019Intrinsic dimension estimation for locally undersampled datacited by 10
- 2022The Intrinsic Manifolds of Radiological Images and their Role in Deep Learningcited by 10
- 2022Voronoi Density Estimator for High-Dimensional Data: Computation, Compactification and Convergencecited by 7
- 2022Intrinsic dimension estimation for discrete metricscited by 4
- 2022An Efficient and Continuous Voronoi Density Estimatorcited by 3
- 2022On the intrinsic dimensionality of Covid-19 data: a global perspectivecited by 1
Built on by
Not cited yet.