Generative Moment Matching Networks
Not on the map. Why?
Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We consider the problem of learning deep generative models from data. We formulate a method that generates an independent sample via a single feedforward pass through a multilayer perceptron, as in the recently proposed generative adversarial networks (Goodfellow et al., 2014). Training a generative adversarial network, however, requires careful optimization of a difficult minimax program. Instead, we utilize a technique from statistical hypothesis testing known as maximum mean discrepancy (MMD), which leads to a simple objective that can be interpreted as matching all orders of statistics between a dataset and samples from the model, and can be trained by backpropagation. We further boost the performance of this approach by combining our generative network with an auto-encoder network, using MMD to learn to generate codes that can then be decoded to produce samples. We show that the combination of these techniques yields excellent generative models compared to baseline approaches as measured on MNIST and the Toronto Face Database.
Key facts. Cited by 252 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Feb 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 1; 2021: 57; 2022: 41; 2023: 38; 2024: 34; 2025: 40; 2026: 40.
252 papers.
Sort:
By area:
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2021Dataset Condensation with Distribution Matchingcited by 362
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
- 2019A Divergence Minimization Perspective on Imitation Learning Methodscited by 188
- 2021Neural SDEs as Infinite-Dimensional GANscited by 159
- 2023Improved Distribution Matching for Dataset Condensationcited by 124
- 2025Inductive Moment Matchingcited by 107
- 2021Generalized Decision Transformer for Offline Hindsight Information Matchingcited by 105
- 2026Generative Modeling via Driftingcited by 98
- 2023DataDAM: Efficient Dataset Distillation with Attention Matchingcited by 83
- 2021Efficient and Accurate Gradients for Neural SDEscited by 68
- 2022Synthetic Data -- what, why and how?cited by 66
38 more
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 59
- 2024Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generationcited by 56
- 2021Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloudscited by 55
- 2021Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentationcited by 53
- 2021Rates of Estimation of Optimal Transport Maps using Plug-in Estimators via Barycentric Projectionscited by 52
- 2023Vector Quantized Time Series Generation with a Bidirectional Prior Modelcited by 49
- 2021Improving Conditional Coverage via Orthogonal Quantile Regressioncited by 48
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
- 2021SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentationcited by 41
- 2022Robust Bayesian Inference for Simulator-based Models via the MMD Posterior Bootstrapcited by 41
- 2020Energy-Based Imitation Learningcited by 39
- 2021Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectorscited by 37
- 2021KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Supportcited by 37
- 2021Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nystr"om Method, and Use of Kernels in Machine Learning: Tutorial and Surveycited by 36
- 2023Generative Sliced MMD Flows with Riesz Kernelscited by 36
- 2023Non-adversarial training of Neural SDEs with signature kernel scorescited by 36
- 2021An error analysis of generative adversarial networks for learning distributionscited by 35
- 2021Probabilistic Forecasting with Generative Networks via Scoring Rule Minimizationcited by 35
- 2023DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classificationcited by 32
- 2026Representation Fr'echet Loss for Visual Generationcited by 32
- 2024DySLIM: Dynamics Stable Learning by Invariant Measure for Chaotic Systemscited by 29
- 2022Pre-trained Perceptual Features Improve Differentially Private Image Generationcited by 28
- 2023Primitive Generation and Semantic-related Alignment for Universal Zero-Shot Segmentationcited by 28
- 2022Generative machine learning methods for multivariate ensemble post-processingcited by 26
- 2023Prototype Adaption and Projection for Few- and Zero-shot 3D Point Cloud Semantic Segmentationcited by 26
- 2025Distributional Diffusion Models with Scoring Rulescited by 25
- 2022Faster Unbalanced Optimal Transport: Translation invariant Sinkhorn and 1-D Frank-Wolfecited by 22
- 2021Generative adversarial networks in time series: A survey and taxonomycited by 20
- 2021On the capacity of deep generative networks for approximating distributionscited by 19
- 2022Enhancing Sequential Recommendation with Graph Contrastive Learningcited by 18
- 2025Proper scoring rules for estimation and forecast evaluationcited by 18
- 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidancecited by 18
- 2026One-Step Generative Modeling via Wasserstein Gradient Flowscited by 18
- 2021Implicit Generative Copulascited by 17
- 2021Composite Goodness-of-fit Tests with Kernelscited by 16
- 2021Neural Tangent Kernel Maximum Mean Discrepancycited by 15
- 2022AirFi: Empowering WiFi-based Passive Human Gesture Recognition to Unseen Environment via Domain Generalizationcited by 15
50 most cited of 252 All 252 (JSON)
- 2026Kernelized Activation Steering1 Oct 2026
- 2026Improved Distributional Diffusion Models29 Sep 2026
- 2026Unifying Distributional Training for One-Step Visual Generation28 Sep 2026
- 2026From Scores to Samples: Elastic Forcing for Autoregressive Video Generation28 Sep 2026
- 2026Sharp Convergence of Wasserstein Gradient Flows for Spectrally Nonnegative Interaction Energies22 Sep 2026
- 2026Importance Weighting for Unlabeled-unlabeled Learning under Distribution Shift10 Sep 2026
- 2026Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation29 Jul 2026
- 2026Amortized Moment Matching for Visual Generation29 Jul 2026
- 2026Minimax Lower Bounds of Kernel Discrepancy Estimation: MMD, HSIC, KSD27 Jul 2026
- 2026Three-Body Scattering for Generative Modeling20 Jul 2026
- 2026Representation Distribution Matching for One-Step Visual Generation2 Jul 2026
- 2026Enhancing Numerical Prediction in LLMs via Smooth MMD Alignment26 Jun 2026
38 more
- 2026A nonparametric two-sample test using a parametric integral probability metric15 Jun 2026
- 2026A Unifying Framework for Concept-Based Representational Similarity8 Jun 2026
- 2026Generating Financial Time Series by Matching Random Convolutional Features3 Jun 2026
- 2026Generate in Reconstruction Space, Match in Semantic Space: Transport Geometry for One-Step Generation30 May 2026
- 2026LiFT: Lifted Inter-slice Feature Trajectories for 3D Image Generation from 2D Generators18 May 2026
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields12 May 2026
- 2026One-Step Generative Modeling via Wasserstein Gradient Flows12 May 2026
- 2026Inverse Design for Conditional Distribution Matching10 May 2026
- 2026Gaussian mixture models in Hilbert spaces via kernel methods7 May 2026
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Models6 May 2026
- 2026LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Models5 May 2026
- 2026Representation Fr'echet Loss for Visual Generation30 Apr 2026
- 2026Generalising maximum mean discrepancy: kernelised functional Bregman divergences27 Apr 2026
- 2026Reinforcement-Guided Synthetic Data Generation for Privacy-Sensitive Identity Recognition9 Apr 2026
- 2026Bi-Lipschitz Autoencoder With Injectivity Guarantee8 Apr 2026
- 2026Muon Dynamics as a Spectral Wasserstein Flow6 Apr 2026
- 2026Energy-Aware Imitation Learning for Steering Prediction Using Events and Frames30 Mar 2026
- 2026Gradient Flow Drifting: Generative Modeling via Wasserstein Gradient Flows of KDE-Approximated Divergences11 Mar 2026
- 2026A Unified View of Score-Based and Drifting Models8 Mar 2026
- 2026Distribution-Conditioned Transport5 Mar 2026
- 2026Nearest-Neighbor Density Estimation for Dependency Suppression4 Mar 2026
- 2026AdvSynGNN: Structure-Adaptive Graph Neural Nets via Adversarial Synthesis and Self-Corrective Propagation19 Feb 2026
- 2026Minimum Distance Summaries for Robust Neural Posterior Estimation9 Feb 2026
- 2026Generative Modeling via Drifting4 Feb 2026
- 2026Multivariate Time Series Data Imputation via Distributionally Robust Regularization31 Jan 2026
- 2026History Is Not Enough: An Adaptive Dataflow System for Financial Time-Series Synthesis15 Jan 2026
- 2026Bayesian Robust Financial Trading with Adversarial Synthetic Market Data14 Jan 2026
- 2026MMD Guidance: Training-Free Distribution Adaptation for Diffusion Models via Maximum Mean Discrepancy Guidance13 Jan 2026
- 2025HeteroHBA: A Generative Structure-Manipulating Backdoor Attack on Heterogeneous Graphs31 Dec 2025
- 2025Microstructure-based Variational Neural Networks for Robust Uncertainty Quantification in Materials Digital Twins19 Dec 2025
- 2025Maximum Mean Discrepancy with Unequal Sample Sizes via Generalized U-Statistics16 Dec 2025
- 2025Classical and quantum kernel fusion for two-sample testing26 Nov 2025
- 2025SynQuE: Estimating Synthetic Dataset Quality Without Annotations6 Nov 2025
- 2025Improved Training Technique for Shortcut Models24 Oct 2025
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025FnRGNN: Distribution-aware Fairness in Graph Neural Network22 Oct 2025
- 2025PolyGraph Discrepancy: a classifier-based metric for graph generation7 Oct 2025
- 2025One-shot Conditional Sampling: MMD meets Nearest Neighbors29 Sep 2025
50 newest of 252 All 252 (JSON)
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
- 2025Inductive Moment Matchingcited by 107
- 2024Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generationcited by 56
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
- 2023DiffMIC: Dual-Guidance Diffusion Network for Medical Image Classificationcited by 32
- 2025Distributional Diffusion Models with Scoring Rulescited by 25
- 2026One-Step Generative Modeling via Wasserstein Gradient Flowscited by 18
- 2024Adversarial Schr"odinger Bridge Matchingcited by 12
- 2025Scale-wise Distillation of Diffusion Modelscited by 11
- 2025Learning to Integrate Diffusion ODEs by Averaging the Derivativescited by 9
- 2023Fast Inference in Denoising Diffusion Models via MMD Finetuningcited by 8
12 most cited of 21 All 21 (JSON)
- 2026Improved Distributional Diffusion Models29 Sep 2026
- 2026One-Step Generative Modeling via Wasserstein Gradient Flows12 May 2026
- 2026Inverse Design for Conditional Distribution Matching10 May 2026
- 2026A Unified View of Score-Based and Drifting Models8 Mar 2026
- 2026MMD Guidance: Training-Free Distribution Adaptation for Diffusion Models via Maximum Mean Discrepancy Guidance13 Jan 2026
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025Distribution Matching via Generalized Consistency Models17 Aug 2025
- 2025Pyramid Hierarchical Masked Diffusion Model for Imaging Synthesis22 Jul 2025
- 2025Learning to Integrate Diffusion ODEs by Averaging the Derivatives20 May 2025
- 2025Scale-wise Distillation of Diffusion Models20 Mar 2025
- 2025Inductive Moment Matching10 Mar 2025
- 2025Distributional Diffusion Models with Scoring Rules4 Feb 2025
12 newest of 21 All 21 (JSON)
- 2019A Divergence Minimization Perspective on Imitation Learning Methodscited by 188
- 2021Generalized Decision Transformer for Offline Hindsight Information Matchingcited by 105
- 2020Energy-Based Imitation Learningcited by 39
- 2021A Pragmatic Look at Deep Imitation Learningcited by 9
- 2024Cross-Domain Policy Transfer by Representation Alignment via Multi-Domain Behavioral Cloningcited by 1
- 2025Trust Region Reward Optimization and Proximal Inverse Reward Optimization Algorithmcited by 1
- 2026Energy-Aware Imitation Learning for Steering Prediction Using Events and Framescited by 0
- 2026Energy-Aware Imitation Learning for Steering Prediction Using Events and Frames30 Mar 2026
- 2025Trust Region Reward Optimization and Proximal Inverse Reward Optimization Algorithm27 Sep 2025
- 2024Cross-Domain Policy Transfer by Representation Alignment via Multi-Domain Behavioral Cloning24 Jul 2024
- 2021Generalized Decision Transformer for Offline Hindsight Information Matching19 Nov 2021
- 2021A Pragmatic Look at Deep Imitation Learning4 Aug 2021
- 2020Energy-Based Imitation Learning20 Apr 2020
- 2019A Divergence Minimization Perspective on Imitation Learning Methods6 Nov 2019
- 2021Dataset Condensation with Distribution Matchingcited by 362
- 2021Neural SDEs as Infinite-Dimensional GANscited by 159
- 2023Improved Distribution Matching for Dataset Condensationcited by 124
- 2026Generative Modeling via Driftingcited by 98
- 2023DataDAM: Efficient Dataset Distillation with Attention Matchingcited by 83
- 2021Efficient and Accurate Gradients for Neural SDEscited by 68
- 2022Synthetic Data -- what, why and how?cited by 66
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 59
- 2021Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloudscited by 55
- 2021Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentationcited by 53
- 2021Rates of Estimation of Optimal Transport Maps using Plug-in Estimators via Barycentric Projectionscited by 52
12 most cited of 220 All 220 (JSON)
- 2026Kernelized Activation Steering1 Oct 2026
- 2026Unifying Distributional Training for One-Step Visual Generation28 Sep 2026
- 2026From Scores to Samples: Elastic Forcing for Autoregressive Video Generation28 Sep 2026
- 2026Sharp Convergence of Wasserstein Gradient Flows for Spectrally Nonnegative Interaction Energies22 Sep 2026
- 2026Importance Weighting for Unlabeled-unlabeled Learning under Distribution Shift10 Sep 2026
- 2026Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation29 Jul 2026
- 2026Amortized Moment Matching for Visual Generation29 Jul 2026
- 2026Minimax Lower Bounds of Kernel Discrepancy Estimation: MMD, HSIC, KSD27 Jul 2026
- 2026Three-Body Scattering for Generative Modeling20 Jul 2026
- 2026Representation Distribution Matching for One-Step Visual Generation2 Jul 2026
- 2026Enhancing Numerical Prediction in LLMs via Smooth MMD Alignment26 Jun 2026
- 2026A nonparametric two-sample test using a parametric integral probability metric15 Jun 2026
12 newest of 220 All 220 (JSON)