Analytic Bijections for Smooth and Interpretable Normalizing Flows
Not on the map. Why?
Abstract (arXiv)
A key challenge in normalizing flows is finding expressive invertible scalar bijections. Existing approaches face trade-offs: affine transformations are smooth and analytically invertible but lack expressivity; monotonic splines offer local control but are only piecewise smooth and act on bounded domains; residual flows achieve smoothness but need numerical inversion. We introduce three families of analytic bijections that are globally smooth (C^∞), defined on all of ℝ, and analytically invertible in closed form, combining the favorable properties of prior approaches. Beyond serving as drop-in replacements in coupling flows, where they match or exceed spline performance, we develop radial flows: a novel architecture using direct parametrization that transforms the radial coordinate while preserving angular direction. Radial flows exhibit exceptional training stability, produce geometrically interpretable transformations, and on targets with radial structure can achieve comparable quality to coupling flows with 1000× fewer parameters. We provide comprehensive evaluation on 1D and 2D benchmarks, and demonstrate applicability to higher-dimensional physics problems through experiments on φ4 lattice field theory, where our bijections outperform affine baselines and enable problem-specific designs that address mode collapse.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
28 of 37 references.
References · 28
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2016Density estimation using Real NVPcited by 2,042
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2017Masked Autoregressive Flow for Density Estimationcited by 684
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
- 2019Neural Spline Flowscited by 596
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
- 2018Invertible Residual Networkscited by 365
- 2019Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Designcited by 262
16 more
- 2019Residual Flows for Invertible Generative Modelingcited by 257
- 2018Neural Autoregressive Flowscited by 208
- 2019Flow-based generative models for Markov chain Monte Carlo in lattice field theorycited by 148
- 2020Normalizing Flows on Tori and Spherescited by 117
- 2021Smooth Normalizing Flowscited by 53
- 2020Invertible Generative Modeling using Linear Rational Splinescited by 40
- 2023SE(3) Equivariant Augmented Coupling Flowscited by 37
- 2023Free-form Flows: Make Any Architecture a Normalizing Flowcited by 26
- 2020Representational aspects of depth and conditioning in normalizing flowscited by 25
- 2020Gaussianization Flowscited by 20
- 2019Neural Networks with Cheap Differential Operatorscited by 18
- 2024On the Universality of Volume-Preserving and Coupling-Based Normalizing Flowscited by 18
- 2022On the Robustness of Normalizing Flows for Inverse Problems in Imagingcited by 8
- 2024Stable Training of Normalizing Flows for High-dimensional Variational Inferencecited by 6
- 2025Lecture Notes on Normalizing Flows for Lattice Quantum Field Theoriescited by 4
- 2023Neural Diffeomorphic Non-uniform B-spline Flowscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.