MintNet: Building Invertible Neural Networks with Masked Convolutions
Not on the map. Why?
Abstract (arXiv)
We propose a new way of constructing invertible neural networks by combining simple building blocks with a novel set of composition rules. This leads to a rich set of invertible architectures, including those similar to ResNets. Inversion is achieved with a locally convergent iterative procedure that is parallelizable and very fast in practice. Additionally, the determinant of the Jacobian can be computed analytically and efficiently, enabling their generative use as flow models. To demonstrate their flexibility, we show that our invertible neural networks are competitive with ResNets on MNIST and CIFAR-10 classification. When trained as generative models, our invertible networks achieve competitive likelihoods on MNIST, CIFAR-10 and ImageNet 32x32, with bits per dimension of 0.98, 3.32 and 4.06 respectively.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 7; 2023: 9; 2024: 5; 2025: 4; 2026: 1.
35 papers.
Sort:
By area:
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
- 2022Towards Blind Watermarking: Combining Invertible and Non-invertible Mechanismscited by 61
- 2022Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attackscited by 58
- 2021Featurized Density Ratio Estimationcited by 33
- 2023Reversible Vision Transformerscited by 33
- 2021Implicit Normalizing Flowscited by 28
- 2022Re^2TAL: Rewiring Pretrained Video Backbones for Reversible Temporal Action Localizationcited by 19
- 2023SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layercited by 14
- 2024Invertible Diffusion Models for Compressed Sensingcited by 12
- 2022Improved Input Reprogramming for GAN Conditioningcited by 7
23 more
- 2021A Compact Neural Network-based Algorithm for Robust Image Watermarkingcited by 6
- 2023Training Energy-Based Normalizing Flow with Score-Matching Objectivescited by 6
- 2023Memory-Efficient Reversible Spiking Neural Networkscited by 6
- 2023PRIS: Practical robust invertible network for image steganographycited by 5
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmarkcited by 5
- 2021Multi-Resolution Continuous Normalizing Flowscited by 4
- 2025On Surjectivity of Neural Networks: Can you elicit any behavior from your model?cited by 4
- 2025A Unifying Framework for Parallelizing Sequential Models with Linear Dynamical Systemscited by 4
- 2023Certified Invertibility in Neural Networks via Mixed-Integer Programmingcited by 3
- 2021The U-Net based GLOW for Optical-Flow-free Video Interframe Generationcited by 2
- 2021Coded-InvNet for Resilient Prediction Serving Systemscited by 2
- 2022Graphical Residual Flowscited by 2
- 2023FInC Flow: Fast and Invertible k × k Convolutions for Normalizing Flowscited by 2
- 2024Classification Diffusion Models: Revitalizing Density Ratio Estimationcited by 2
- 2024Generative Modeling: A Reviewcited by 2
- 2025Accelerate TarFlow Sampling with GS-Jacobi Iterationcited by 2
- 2026Learning Energy-Based Models from Stochastic Interpolants using Spatiotemporal Differencescited by 2
- 2023PaReprop: Fast Parallelized Reversible Backpropagationcited by 1
- 2024On Exact Bit-level Reversible Transformers Without Changing Architecturescited by 1
- 2021Sinusoidal Flow: A Fast Invertible Autoregressive Flowcited by 0
- 2022SIReN-VAE: Leveraging Flows and Amortized Inference for Bayesian Networkscited by 0
- 2023Quantification of Predictive Uncertainty via Inference-Time Samplingcited by 0
- 2024Enhancing Perception Quality in Remote Sensing Image Compression via Invertible Neural Networkcited by 0
- 2026Learning Energy-Based Models from Stochastic Interpolants using Spatiotemporal Differences26 May 2026
- 2025A Unifying Framework for Parallelizing Sequential Models with Linear Dynamical Systems26 Sep 2025
- 2025On Surjectivity of Neural Networks: Can you elicit any behavior from your model?26 Aug 2025
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmark9 Jun 2025
- 2025Accelerate TarFlow Sampling with GS-Jacobi Iteration19 May 2025
- 2024Generative Modeling: A Review24 Dec 2024
- 2024On Exact Bit-level Reversible Transformers Without Changing Architectures12 Jul 2024
- 2024Enhancing Perception Quality in Remote Sensing Image Compression via Invertible Neural Network17 May 2024
- 2024Invertible Diffusion Models for Compressed Sensing25 Mar 2024
- 2024Classification Diffusion Models: Revitalizing Density Ratio Estimation15 Feb 2024
- 2023Memory-Efficient Reversible Spiking Neural Networks13 Dec 2023
- 2023PRIS: Practical robust invertible network for image steganography24 Sep 2023
23 more
- 2023Quantification of Predictive Uncertainty via Inference-Time Sampling3 Aug 2023
- 2023PaReprop: Fast Parallelized Reversible Backpropagation15 Jun 2023
- 2023Training Energy-Based Normalizing Flow with Score-Matching Objectives24 May 2023
- 2023Reversible Vision Transformers9 Feb 2023
- 2023SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer30 Jan 2023
- 2023Certified Invertibility in Neural Networks via Mixed-Integer Programming27 Jan 2023
- 2023FInC Flow: Fast and Invertible k × k Convolutions for Normalizing Flows23 Jan 2023
- 2022Towards Blind Watermarking: Combining Invertible and Non-invertible Mechanisms24 Dec 2022
- 2022Re^2TAL: Rewiring Pretrained Video Backbones for Reversible Temporal Action Localization25 Nov 2022
- 2022Concrete Score Matching: Generalized Score Matching for Discrete Data2 Nov 2022
- 2022SIReN-VAE: Leveraging Flows and Amortized Inference for Bayesian Networks23 Apr 2022
- 2022Graphical Residual Flows23 Apr 2022
- 2022Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attacks28 Jan 2022
- 2022Improved Input Reprogramming for GAN Conditioning7 Jan 2022
- 2021A Compact Neural Network-based Algorithm for Robust Image Watermarking27 Dec 2021
- 2021Sinusoidal Flow: A Fast Invertible Autoregressive Flow26 Oct 2021
- 2021Featurized Density Ratio Estimation5 Jul 2021
- 2021Multi-Resolution Continuous Normalizing Flows15 Jun 2021
- 2021Coded-InvNet for Resilient Prediction Serving Systems11 Jun 2021
- 2021The U-Net based GLOW for Optical-Flow-free Video Interframe Generation17 Mar 2021
- 2021Implicit Normalizing Flows17 Mar 2021
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models8 Mar 2021
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions10 Feb 2021
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
- 2022Towards Blind Watermarking: Combining Invertible and Non-invertible Mechanismscited by 61
- 2022Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attackscited by 58
- 2021Featurized Density Ratio Estimationcited by 33
- 2023Reversible Vision Transformerscited by 33
- 2021Implicit Normalizing Flowscited by 28
- 2022Re^2TAL: Rewiring Pretrained Video Backbones for Reversible Temporal Action Localizationcited by 19
- 2023SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layercited by 14
- 2022Improved Input Reprogramming for GAN Conditioningcited by 7
- 2021A Compact Neural Network-based Algorithm for Robust Image Watermarkingcited by 6
- 2023Training Energy-Based Normalizing Flow with Score-Matching Objectivescited by 6
12 most cited of 32 All 32 (JSON)
- 2026Learning Energy-Based Models from Stochastic Interpolants using Spatiotemporal Differences26 May 2026
- 2025A Unifying Framework for Parallelizing Sequential Models with Linear Dynamical Systems26 Sep 2025
- 2025On Surjectivity of Neural Networks: Can you elicit any behavior from your model?26 Aug 2025
- 2025SoK: Data Reconstruction Attacks Against Machine Learning Models: Definition, Metrics, and Benchmark9 Jun 2025
- 2025Accelerate TarFlow Sampling with GS-Jacobi Iteration19 May 2025
- 2024Generative Modeling: A Review24 Dec 2024
- 2024On Exact Bit-level Reversible Transformers Without Changing Architectures12 Jul 2024
- 2024Enhancing Perception Quality in Remote Sensing Image Compression via Invertible Neural Network17 May 2024
- 2023Memory-Efficient Reversible Spiking Neural Networks13 Dec 2023
- 2023PRIS: Practical robust invertible network for image steganography24 Sep 2023
- 2023Quantification of Predictive Uncertainty via Inference-Time Sampling3 Aug 2023
- 2023PaReprop: Fast Parallelized Reversible Backpropagation15 Jun 2023
12 newest of 32 All 32 (JSON)