Funnels: Exact maximum likelihood with dimensionality reduction
Not on the map. Why?
Abstract (arXiv)
Normalizing flows are diffeomorphic, typically dimension-preserving, models trained using the likelihood of the model. We use the SurVAE framework to construct dimension reducing surjective flows via a new layer, known as the funnel. We demonstrate its efficacy on a variety of datasets, and show it improves upon or matches the performance of existing flows while having a reduced latent space size. The funnel layer can be constructed from a wide range of transformations including restricted convolution and feed forward layers.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 15 Dec 2021.
Builds on
23 of 41 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2016Density estimation using Real NVPcited by 2,029
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2016Pixel Recurrent Neural Networkscited by 814
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2019Neural Spline Flowscited by 590
11 more
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 220
- 2020SurVAE Flows: Surjections to Bridge the Gap between VAEs and Flowscited by 71
- 2019Latent Normalizing Flows for Discrete Sequencescited by 66
- 2020Augmented Normalizing Flows: Bridging the Gap Between Generative Flows and Latent Variable Modelscited by 66
- 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 46
- 2020VFlow: More Expressive Generative Flows with Variational Data Augmentationcited by 38
- 2018Autoregressive Quantile Networks for Generative Modelingcited by 31
- 2019Emerging Convolutions for Generative Normalizing Flowscited by 31
- 2021The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collidercited by 28
- 2018Transformation Autoregressive Networkscited by 27
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 0; 2025: 0; 2026: 1.
4 papers.
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimationcited by 8
- 2022Flowification: Everything is a Normalizing Flowcited by 5
- 2023Uncertainty quantification and out-of-distribution detection using surjective normalizing flowscited by 0
- 2026Generative AI-enhanced Probabilistic Multi-Fidelity Surrogate Modeling Via Transfer Learningcited by 0
- 2026Generative AI-enhanced Probabilistic Multi-Fidelity Surrogate Modeling Via Transfer Learning20 Jan 2026
- 2023Uncertainty quantification and out-of-distribution detection using surjective normalizing flows1 Nov 2023
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimation2 Aug 2023
- 2022Flowification: Everything is a Normalizing Flow30 May 2022