Hybrid Models with Deep and Invertible Features
Not on the map. Why?
Abstract (arXiv)
We propose a neural hybrid model consisting of a linear model defined on a set of features computed by a deep, invertible transformation (i.e. a normalizing flow). An attractive property of our model is that both p(features), the density of the features, and p(targets | features), the predictive distribution, can be computed exactly in a single feed-forward pass. We show that our hybrid model, despite the invertibility constraints, achieves similar accuracy to purely predictive models. Moreover the generative component remains a good model of the input features despite the hybrid optimization objective. This offers additional capabilities such as detection of out-of-distribution inputs and enabling semi-supervised learning. The availability of the exact joint density p(targets, features) also allows us to compute many quantities readily, making our hybrid model a useful building block for downstream applications of probabilistic deep learning.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 9; 2023: 7; 2024: 6; 2025: 4; 2026: 1.
41 papers.
Sort:
By area:
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
- 2021Machine Learning with a Reject Option: A surveycited by 107
- 2022GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Modelscited by 87
- 2021Types of Out-of-Distribution Texts and How to Detect Themcited by 80
- 2021On the Practicality of Deterministic Epistemic Uncertaintycited by 62
- 2022Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Modelcited by 58
- 2021Densely connected normalizing flowscited by 49
- 2021Featurized Density Ratio Estimationcited by 33
- 2022Universal approximation property of invertible neural networkscited by 30
- 2022Breaking Down Out-of-Distribution Detection: Many Methods Based on OOD Training Data Estimate a Combination of the Same Core Quantitiescited by 23
- 2023Learning Data Representations with Joint Diffusion Modelscited by 22
29 more
- 2021A Unified Benchmark for the Unknown Detection Capability of Deep Neural Networkscited by 19
- 2021Invertible DenseNets with Concatenated LipSwishcited by 17
- 2022Chroma-VAE: Mitigating Shortcut Learning with Generative Classifierscited by 17
- 2021Task-agnostic Continual Learning with Hybrid Probabilistic Modelscited by 16
- 2021Autoregressive Quantile Flows for Predictive Uncertainty Estimationcited by 15
- 2024A Causal Framework for Evaluating Deferring Systemscited by 13
- 2021InversionNet3D: Efficient and Scalable Learning for 3D Full Waveform Inversioncited by 12
- 2022Fix-A-Step: Semi-supervised Learning from Uncurated Unlabeled Datacited by 11
- 2022Semi-Autoregressive Energy Flows: Exploring Likelihood-Free Training of Normalizing Flowscited by 9
- 2023DejaVu: Conditional Regenerative Learning to Enhance Dense Predictioncited by 9
- 2023Concurrent Misclassification and Out-of-Distribution Detection for Semantic Segmentation via Energy-Based Normalizing Flowcited by 8
- 2024Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilitiescited by 8
- 2023Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learningcited by 7
- 2024Taming False Positives in Out-of-Distribution Detection with Human Feedbackcited by 7
- 2024Entropy-Informed Weighting Channel Normalizing Flow for Deep Generative Modelscited by 5
- 2025Synergistic Benefits of Joint Molecule Generation and Property Predictioncited by 5
- 2025HybridFlow: Quantification of Aleatoric and Epistemic Uncertainty with a Single Hybrid Modelcited by 3
- 2021Data-driven Cloud Clustering via a Rotationally Invariant Autoencodercited by 2
- 2022Saliency Guided Adversarial Training for Learning Generalizable Features with Applications to Medical Imaging Classification Systemcited by 2
- 2023On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networkscited by 2
- 2023De Novo Drug Design with Joint Transformerscited by 2
- 2024Discriminant Distance-Aware Representation on Deterministic Uncertainty Quantification Methodscited by 2
- 2024FlowCon: Out-of-Distribution Detection using Flow-Based Contrastive Learningcited by 2
- 2021Semi-Supervised Few-Shot Classification with Deep Invertible Hybrid Modelscited by 0
- 2021Deep Generative Models for Vehicle Speed Trajectoriescited by 0
- 2023MixerFlow: MLP-Mixer meets Normalising Flowscited by 0
- 2025Nash: Neural Adaptive Shrinkage for Structured High-Dimensional Regressioncited by 0
- 2025Normalizing Flow to Augmented Posterior: Conditional Density Estimation with Interpretable Dimension Reduction for High Dimensional Datacited by 0
- 2026Sample Efficient Generative Molecular Optimization with Joint Self-Improvementcited by 0
- 2026Sample Efficient Generative Molecular Optimization with Joint Self-Improvement11 Feb 2026
- 2025HybridFlow: Quantification of Aleatoric and Epistemic Uncertainty with a Single Hybrid Model6 Oct 2025
- 2025Normalizing Flow to Augmented Posterior: Conditional Density Estimation with Interpretable Dimension Reduction for High Dimensional Data6 Jul 2025
- 2025Nash: Neural Adaptive Shrinkage for Structured High-Dimensional Regression16 May 2025
- 2025Synergistic Benefits of Joint Molecule Generation and Property Prediction23 Apr 2025
- 2024Entropy-Informed Weighting Channel Normalizing Flow for Deep Generative Models6 Jul 2024
- 2024FlowCon: Out-of-Distribution Detection using Flow-Based Contrastive Learning3 Jul 2024
- 2024Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilities31 May 2024
- 2024A Causal Framework for Evaluating Deferring Systems29 May 2024
- 2024Taming False Positives in Out-of-Distribution Detection with Human Feedback25 Apr 2024
- 2024Discriminant Distance-Aware Representation on Deterministic Uncertainty Quantification Methods20 Feb 2024
- 2023Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learning11 Nov 2023
29 more
- 2023MixerFlow: MLP-Mixer meets Normalising Flows25 Oct 2023
- 2023De Novo Drug Design with Joint Transformers3 Oct 2023
- 2023On the Approximation of Bi-Lipschitz Maps by Invertible Neural Networks18 Aug 2023
- 2023Concurrent Misclassification and Out-of-Distribution Detection for Semantic Segmentation via Energy-Based Normalizing Flow16 May 2023
- 2023DejaVu: Conditional Regenerative Learning to Enhance Dense Prediction2 Mar 2023
- 2023Learning Data Representations with Joint Diffusion Models31 Jan 2023
- 2022Chroma-VAE: Mitigating Shortcut Learning with Generative Classifiers28 Nov 2022
- 2022GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Models5 Oct 2022
- 2022Saliency Guided Adversarial Training for Learning Generalizable Features with Applications to Medical Imaging Classification System9 Sep 2022
- 2022Fix-A-Step: Semi-supervised Learning from Uncurated Unlabeled Data25 Aug 2022
- 2022Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model16 Aug 2022
- 2022Breaking Down Out-of-Distribution Detection: Many Methods Based on OOD Training Data Estimate a Combination of the Same Core Quantities20 Jun 2022
- 2022Semi-Autoregressive Energy Flows: Exploring Likelihood-Free Training of Normalizing Flows14 Jun 2022
- 2022Universal approximation property of invertible neural networks15 Apr 2022
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback12 Apr 2022
- 2021Deep Generative Models for Vehicle Speed Trajectories14 Dec 2021
- 2021Autoregressive Quantile Flows for Predictive Uncertainty Estimation9 Dec 2021
- 2021A Unified Benchmark for the Unknown Detection Capability of Deep Neural Networks1 Dec 2021
- 2021Types of Out-of-Distribution Texts and How to Detect Them14 Sep 2021
- 2021Machine Learning with a Reject Option: A survey23 Jul 2021
- 2021Featurized Density Ratio Estimation5 Jul 2021
- 2021On the Practicality of Deterministic Epistemic Uncertainty1 Jul 2021
- 2021Task-agnostic Continual Learning with Hybrid Probabilistic Models24 Jun 2021
- 2021Densely connected normalizing flows8 Jun 2021
- 2021Exploring the Limits of Out-of-Distribution Detection6 Jun 2021
- 2021Semi-Supervised Few-Shot Classification with Deep Invertible Hybrid Models22 May 2021
- 2021InversionNet3D: Efficient and Scalable Learning for 3D Full Waveform Inversion25 Mar 2021
- 2021Data-driven Cloud Clustering via a Rotationally Invariant Autoencoder8 Mar 2021
- 2021Invertible DenseNets with Concatenated LipSwish4 Feb 2021
- 2021Exploring the Limits of Out-of-Distribution Detectioncited by 283
- 2021Machine Learning with a Reject Option: A surveycited by 107
- 2022GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Modelscited by 87
- 2021Types of Out-of-Distribution Texts and How to Detect Themcited by 80
- 2021On the Practicality of Deterministic Epistemic Uncertaintycited by 62
- 2021Densely connected normalizing flowscited by 49
- 2021Featurized Density Ratio Estimationcited by 33
- 2022Universal approximation property of invertible neural networkscited by 30
- 2022Breaking Down Out-of-Distribution Detection: Many Methods Based on OOD Training Data Estimate a Combination of the Same Core Quantitiescited by 23
- 2021A Unified Benchmark for the Unknown Detection Capability of Deep Neural Networkscited by 19
- 2021Invertible DenseNets with Concatenated LipSwishcited by 17
- 2022Chroma-VAE: Mitigating Shortcut Learning with Generative Classifierscited by 17
12 most cited of 38 All 38 (JSON)
- 2026Sample Efficient Generative Molecular Optimization with Joint Self-Improvement11 Feb 2026
- 2025HybridFlow: Quantification of Aleatoric and Epistemic Uncertainty with a Single Hybrid Model6 Oct 2025
- 2025Normalizing Flow to Augmented Posterior: Conditional Density Estimation with Interpretable Dimension Reduction for High Dimensional Data6 Jul 2025
- 2025Nash: Neural Adaptive Shrinkage for Structured High-Dimensional Regression16 May 2025
- 2025Synergistic Benefits of Joint Molecule Generation and Property Prediction23 Apr 2025
- 2024Entropy-Informed Weighting Channel Normalizing Flow for Deep Generative Models6 Jul 2024
- 2024FlowCon: Out-of-Distribution Detection using Flow-Based Contrastive Learning3 Jul 2024
- 2024Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilities31 May 2024
- 2024A Causal Framework for Evaluating Deferring Systems29 May 2024
- 2024Taming False Positives in Out-of-Distribution Detection with Human Feedback25 Apr 2024
- 2024Discriminant Distance-Aware Representation on Deterministic Uncertainty Quantification Methods20 Feb 2024
- 2023Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learning11 Nov 2023
12 newest of 38 All 38 (JSON)