Block Neural Autoregressive Flow
Not on the map. Why?
Abstract (arXiv)
Normalising flows (NFS) map two density functions via a differentiable bijection whose Jacobian determinant can be computed efficiently. Recently, as an alternative to hand-crafted bijections, Huang et al. (2018) proposed neural autoregressive flow (NAF) which is a universal approximator for density functions. Their flow is a neural network (NN) whose parameters are predicted by another NN. The latter grows quadratically with the size of the former and thus an efficient technique for parametrization is needed. We propose block neural autoregressive flow (B-NAF), a much more compact universal approximator of density functions, where we model a bijection directly using a single feed-forward network. Invertibility is ensured by carefully designing each affine transformation with block matrices that make the flow autoregressive and (strictly) monotone. We compare B-NAF to NAF and other established flows on density estimation and approximate inference for latent variable models. Our proposed flow is competitive across datasets while using orders of magnitude fewer parameters.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 14; 2023: 7; 2024: 12; 2025: 8; 2026: 4.
62 papers.
Sort:
By area:
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 221
- 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
- 2024Normalizing Flows are Capable Generative Modelscited by 89
- 2023Membership Inference Attacks against Synthetic Data through Overfitting Detectioncited by 66
- 2021Smooth Normalizing Flowscited by 52
- 2022Robust Neural Posterior Estimation and Statistical Model Criticismcited by 45
- 2021Stochastic Normalizing Flows for Inverse Problems: a Markov Chains Viewpointcited by 32
- 2021Tensor-Train Density Estimationcited by 30
- 2022Universal approximation property of invertible neural networkscited by 30
- 2021Implicit Normalizing Flowscited by 28
- 2021Generalized Normalizing Flows via Markov Chainscited by 23
38 more
- 2022On minimax density estimation via measure transportcited by 18
- 2021Invertible DenseNets with Concatenated LipSwishcited by 17
- 2021Autoregressive Quantile Flows for Predictive Uncertainty Estimationcited by 15
- 2021Surrogate Likelihoods for Variational Annealed Importance Samplingcited by 14
- 2024Data Plagiarism Index: Characterizing the Privacy Risk of Data-Copying in Tabular Generative Modelscited by 12
- 2021Density estimation on low-dimensional manifolds: an inflation-deflation approachcited by 11
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Datacited by 10
- 2024Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networkscited by 9
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimationcited by 8
- 2025Flexible Language Modeling in Continuous Space with Transformer-based Autoregressive Flowscited by 8
- 2023Expressive Monotonic Neural Networkscited by 7
- 2024Transformer Neural Autoregressive Flowscited by 7
- 2024Efficient and Generalized end-to-end Autonomous Driving System with Latent Deep Reinforcement Learning and Demonstrationscited by 7
- 2024Importance Corrected Neural JKO Samplingcited by 7
- 2024LazyDINO: Fast, scalable, and efficiently amortized Bayesian inversion via structure-exploiting and surrogate-driven measure transportcited by 7
- 2022Turning Normalizing Flows into Monge Maps with Geodesic Gaussian Preserving Flowscited by 6
- 2021Bootstrap Your Flowcited by 5
- 2022AUTM Flow: Atomic Unrestricted Time Machine for Monotonic Normalizing Flowscited by 5
- 2022Proximal Residual Flows for Bayesian Inverse Problemscited by 5
- 2024Local Flow Matching Generative Modelscited by 5
- 2025Privacy Auditing Synthetic Data Release through Local Likelihood Attackscited by 5
- 2021Marginalizable Density Modelscited by 4
- 2022AS-IntroVAE: Adversarial Similarity Distance Makes Robust IntroVAEcited by 4
- 2025Efficient Autoregressive Inference for Transformer Probabilistic Modelscited by 4
- 2022NFL: Robust Learned Index via Distribution Transformationcited by 3
- 2022AdaCat: Adaptive Categorical Discretization for Autoregressive Modelscited by 3
- 2022Tackling Multimodal Device Distributions in Inverse Photonic Design using Invertible Neural Networkscited by 3
- 2022Normalizing Flows for Hierarchical Bayesian Analysis: A Gravitational Wave Population Studycited by 3
- 2024Variational Inference of Parameters in Opinion Dynamics Modelscited by 3
- 2021Visual Attention in Imaginative Agentscited by 2
- 2022Neural Inverse Transform Samplercited by 2
- 2023On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networkscited by 2
- 2023Reparameterized Variational Rejection Samplingcited by 2
- 2023TERM Model: Tensor Ring Mixture Model for Density Estimationcited by 2
- 2025Accelerate TarFlow Sampling with GS-Jacobi Iterationcited by 2
- 2021Minimax Analysis for Inverse Risk in Nonparametric Planer Invertible Regressioncited by 1
- 2021ELF: Exact-Lipschitz Based Universal Density Approximator Flowcited by 1
- 2024Mixed Noise and Posterior Estimation with Conditional DeepGEMcited by 1
50 most cited of 62 All 62 (JSON)
- 2026Monotonic Kolmogorov-Arnold Networks: A Theoretical and Empirical Study of Monotonicity as an Inductive Bias16 Jun 2026
- 2026ReMIA: a Powerful and Efficient Alternative to Membership Inference Attacks against Synthetic Data Generators14 May 2026
- 2026Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunities25 Mar 2026
- 2026Neural Autoregressive Flows for Markov Boundary Learning21 Mar 2026
- 2025Variational Polya Tree26 Oct 2025
- 2025Efficient Autoregressive Inference for Transformer Probabilistic Models10 Oct 2025
- 2025Privacy Auditing Synthetic Data Release through Local Likelihood Attacks28 Aug 2025
- 2025Flexible Language Modeling in Continuous Space with Transformer-based Autoregressive Flows1 Jul 2025
- 2025Causal Posterior Estimation27 May 2025
- 2025Accelerate TarFlow Sampling with GS-Jacobi Iteration19 May 2025
- 2025A Neural Difference-of-Entropies Estimator for Mutual Information18 Feb 2025
- 2025LucidAtlas: Learning Uncertainty-Aware, Covariate-Disentangled, Individualized Atlas Representations12 Feb 2025
38 more
- 2024Normalizing Flows are Capable Generative Models9 Dec 2024
- 2024LazyDINO: Fast, scalable, and efficiently amortized Bayesian inversion via structure-exploiting and surrogate-driven measure transport19 Nov 2024
- 2024Privacy Vulnerabilities in Marginals-based Synthetic Data7 Oct 2024
- 2024Local Flow Matching Generative Models3 Oct 2024
- 2024Importance Corrected Neural JKO Sampling29 Jul 2024
- 2024Data Plagiarism Index: Characterizing the Privacy Risk of Data-Copying in Tabular Generative Models18 Jun 2024
- 2024Fast Bayesian Inference for Neutrino Non-Standard Interactions at Dark Matter Direct Detection Experiments23 May 2024
- 2024Variational Inference of Parameters in Opinion Dynamics Models8 Mar 2024
- 2024Mixed Noise and Posterior Estimation with Conditional DeepGEM5 Feb 2024
- 2024Monotone, Bi-Lipschitz, and Polyak-Lojasiewicz Networks2 Feb 2024
- 2024Efficient and Generalized end-to-end Autonomous Driving System with Latent Deep Reinforcement Learning and Demonstrations22 Jan 2024
- 2024Transformer Neural Autoregressive Flows3 Jan 2024
- 2023TERM Model: Tensor Ring Mixture Model for Density Estimation13 Dec 2023
- 2023Reparameterized Variational Rejection Sampling26 Sep 2023
- 2023On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networks18 Aug 2023
- 2023Simulation-based Inference for High-dimensional Data using Surjective Sequential Neural Likelihood Estimation2 Aug 2023
- 2023Expressive Monotonic Neural Networks14 Jul 2023
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT7 Mar 2023
- 2023Membership Inference Attacks against Synthetic Data through Overfitting Detection24 Feb 2023
- 2022Proximal Residual Flows for Bayesian Inverse Problems30 Nov 2022
- 2022Normalizing Flows for Hierarchical Bayesian Analysis: A Gravitational Wave Population Study15 Nov 2022
- 2022Concrete Score Matching: Generalized Score Matching for Discrete Data2 Nov 2022
- 2022Are Deep Sequence Classifiers Good at Non-Trivial Generalization?24 Oct 2022
- 2022Robust Neural Posterior Estimation and Statistical Model Criticism12 Oct 2022
- 2022Turning Normalizing Flows into Monge Maps with Geodesic Gaussian Preserving Flows22 Sep 2022
- 2022Tackling Multimodal Device Distributions in Inverse Photonic Design using Invertible Neural Networks29 Aug 2022
- 2022AdaCat: Adaptive Categorical Discretization for Autoregressive Models3 Aug 2022
- 2022On minimax density estimation via measure transport20 Jul 2022
- 2022AS-IntroVAE: Adversarial Similarity Distance Makes Robust IntroVAE28 Jun 2022
- 2022Neural Inverse Transform Sampler22 Jun 2022
- 2022AUTM Flow: Atomic Unrestricted Time Machine for Monotonic Normalizing Flows5 Jun 2022
- 2022NFL: Robust Learned Index via Distribution Transformation24 May 2022
- 2022Universal approximation property of invertible neural networks15 Apr 2022
- 2021Surrogate Likelihoods for Variational Annealed Importance Sampling22 Dec 2021
- 2021ELF: Exact-Lipschitz Based Universal Density Approximator Flow13 Dec 2021
- 2021Autoregressive Quantile Flows for Predictive Uncertainty Estimation9 Dec 2021
- 2021Minimax Analysis for Inverse Risk in Nonparametric Planer Invertible Regression1 Dec 2021
- 2021Generalized Normalizing Flows via Markov Chains24 Nov 2021
50 newest of 62 All 62 (JSON)
- 2024Local Flow Matching Generative Modelscited by 5
- 2024Local Flow Matching Generative Models3 Oct 2024
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 221
- 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
- 2024Normalizing Flows are Capable Generative Modelscited by 89
- 2021Smooth Normalizing Flowscited by 52
- 2022Robust Neural Posterior Estimation and Statistical Model Criticismcited by 45
- 2021Stochastic Normalizing Flows for Inverse Problems: a Markov Chains Viewpointcited by 32
- 2021Tensor-Train Density Estimationcited by 30
- 2022Universal approximation property of invertible neural networkscited by 30
- 2021Implicit Normalizing Flowscited by 28
- 2021Generalized Normalizing Flows via Markov Chainscited by 23
- 2022On minimax density estimation via measure transportcited by 18
12 most cited of 58 All 58 (JSON)
- 2026Monotonic Kolmogorov-Arnold Networks: A Theoretical and Empirical Study of Monotonicity as an Inductive Bias16 Jun 2026
- 2026Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunities25 Mar 2026
- 2026Neural Autoregressive Flows for Markov Boundary Learning21 Mar 2026
- 2025Variational Polya Tree26 Oct 2025
- 2025Efficient Autoregressive Inference for Transformer Probabilistic Models10 Oct 2025
- 2025Privacy Auditing Synthetic Data Release through Local Likelihood Attacks28 Aug 2025
- 2025Flexible Language Modeling in Continuous Space with Transformer-based Autoregressive Flows1 Jul 2025
- 2025Causal Posterior Estimation27 May 2025
- 2025Accelerate TarFlow Sampling with GS-Jacobi Iteration19 May 2025
- 2025A Neural Difference-of-Entropies Estimator for Mutual Information18 Feb 2025
- 2025LucidAtlas: Learning Uncertainty-Aware, Covariate-Disentangled, Individualized Atlas Representations12 Feb 2025
- 2024Normalizing Flows are Capable Generative Models9 Dec 2024
12 newest of 58 All 58 (JSON)