Improved Precision and Recall Metric for Assessing Generative Models
Not on the map. Why?
Cited by 442 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The ability to automatically estimate the quality and coverage of the samples produced by a generative model is a vital requirement for driving algorithm research. We present an evaluation metric that can separately and reliably measure both of these aspects in image generation tasks by forming explicit, non-parametric representations of the manifolds of real and generated data. We demonstrate the effectiveness of our metric in StyleGAN and BigGAN by providing several illustrative examples where existing metrics yield uninformative or contradictory results. Furthermore, we analyze multiple design variants of StyleGAN to better understand the relationships between the model architecture, training methods, and the properties of the resulting sample distribution. In the process, we identify new variants that improve the state-of-the-art. We also perform the first principled analysis of truncation methods and identify an improved method. Finally, we extend our metric to estimate the perceptual quality of individual samples, and use this to study latent space interpolations.
Key facts. Cited by 944 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 55; 2022: 97; 2023: 142; 2024: 196; 2025: 215; 2026: 239.
944 papers.
Sort:
By area:
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2023Consistency Modelscited by 1,822
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2022On Distillation of Guided Diffusion Modelscited by 725
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 561
38 more
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
- 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 402
- 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
- 2025Diffusion Transformers with Representation Autoencoderscited by 295
- 2021Generating Images with Sparse Representationscited by 266
- 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizercited by 262
- 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 254
- 2023Self-Consuming Generative Models Go MADcited by 250
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 213
- 2021Projected GANs Converge Fastercited by 208
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 205
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 196
- 2023Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Modelscited by 177
- 2023Fast Training of Diffusion Models with Masked Transformerscited by 176
- 2022Fast Sampling of Diffusion Models via Operator Learningcited by 175
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 167
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
- 2023Flow Matching in Latent Spacecited by 160
- 2023Holistic Evaluation of Text-To-Image Modelscited by 160
- 2024Open-MAGVIT2: An Open-Source Project Toward Democratizing Auto-regressive Visual Generationcited by 155
- 2022Improving Sample Quality of Diffusion Models Using Self-Attention Guidancecited by 154
- 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Cachingcited by 142
- 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
- 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 131
50 most cited of 944 All 944 (JSON)
- 2026Representation Conditioning for Generation14 Oct 2026
- 2026SNACK: A Sequential Notation Framework for Probabilistic Graph Generation14 Oct 2026
- 2026Annealed L'evy Diffusion via Gaussian Surrogate Reverse Dynamics14 Oct 2026
- 2026PixelMoE: Scaling Pixel-Space Diffusion with LLM-Style Mixture-of-Experts13 Oct 2026
- 2026Texture Interpolation as Texton Matching13 Oct 2026
- 2026Unbalanced W-Flow: Unbalanced Wasserstein Drifting under Finite-Batch Marginal Fluctuations13 Oct 2026
- 2026Image Tokenizers Should Be Trained Between Images12 Oct 2026
- 2026Learning ω-Powered Conditional Distributions with Importance-Weighted Flow Matching12 Oct 2026
- 2026Understanding Unified VLMs: From Attention Probing to Guidance Tuning for Multimodal Generation10 Oct 2026
- 2026TRIG: Toward Measuring Texture Realism in Image Generation10 Oct 2026
- 2026PixARG: Pixel-Asynchronous Retrieval-Augmented Diffusion for Fast and Realistic Image Generation10 Oct 2026
- 2026Correction Training for Diffusion Models9 Oct 2026
38 more
- 2026CorrFlow: Exact and Permutation-Equivariant Flow Matching on the Correlation Elliptope9 Oct 2026
- 2026CoVA: Composing VAE Representations for Generative Learning9 Oct 2026
- 2026Pristine Models8 Oct 2026
- 2026From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model5 Oct 2026
- 2026What Does Fr'echet Distance Measure? A Directional Decomposition4 Oct 2026
- 2026Verifier-Guided Synthetic Augmentation for 3D Human Shape Generation2 Oct 2026
- 2026Embedding Prediction Helps Image Generation1 Oct 2026
- 2026Debias Anything: Fairness with Diversity without Supervision in Diffusion Models1 Oct 2026
- 2026PLDiv: Measuring Dataset Diversity and Semantic Collapse via Persistence Landscapes30 Sep 2026
- 2026Specificity-Aware Diffusion Steering via Variance-Reduced Sequential Monte Carlo30 Sep 2026
- 2026Visualizing Distribution Coverage in Generative Diffusion Models30 Sep 2026
- 2026Adversarial Training for Pixel Diffusion29 Sep 2026
- 2026Improved Distributional Diffusion Models29 Sep 2026
- 2026Reactive Real-Time Flow Policies via Asynchronous Distribution Alignment29 Sep 2026
- 2026Improving Generative Model Self-Training with Geometrically Modified Outputs28 Sep 2026
- 2026Scaffold Then Internalize: Representation Injection for Diffusion Transformers28 Sep 2026
- 2026Generative AI-Based Data Augmentation for Oral Lesion Classification: The PhotoMOCI Dataset and Benchmark28 Sep 2026
- 2026What Visual Generators Need from Teachers: Rethinking Representation Alignment28 Sep 2026
- 2026M3-Score: Fidelity, Memorization and Coverage as Separate Axes for Evaluating Generative Radiology Image Models27 Sep 2026
- 2026One-Step Generative Modeling via Unbalanced Optimal Transport26 Sep 2026
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models25 Sep 2026
- 2026The Null Is the Hard Part: Exact Tests for Memorization in Generative Models23 Sep 2026
- 2026A Data-Interventional Framework for Auditing Privacy and Fairness in Generative Medical Imaging22 Sep 2026
- 2026A Semiotics-Aware Framework for Evaluating Fidelity and Coverage in Natural Language Generation22 Sep 2026
- 2026Classifier-Free Guidance in Flow Matching: Non-Autonomous Potentials, Overshoot, and Posterior-Mean Control21 Sep 2026
- 2026EmbeddGAN: A Novel GAN Framework Using an Embedding Network and Gini Distance Correlation18 Sep 2026
- 2026Same Flow, Different Paths: Variance Reduction in Flow Matching15 Sep 2026
- 2026An End-to-End Automated Pipeline for Controllable Crack Data Synthesis11 Sep 2026
- 2026From Synthetic Priors to Model Behavior: Structural Coverage in Tabular Foundation Models7 Sep 2026
- 2026SwiftExplorer: Training-free Diffusion Model Alignment with Swift Diversity Exploration6 Sep 2026
- 2026Generative Diffusion Surrogates with Analytical Variance Schedule1 Sep 2026
- 2026Advanced Pixel Diffusion Model with Guided Sparse Global Refinement1 Sep 2026
- 2026NepScript Genesis: Neural Architecture Search for Handwritten Devanagari Digit Synthesis30 Aug 2026
- 2026GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modeling29 Aug 2026
- 2026Beyond Representation Learning: A Systematic Study of Joint-Embedding Predictive Generation for 3D Brain MRI28 Aug 2026
- 2026PAWBench: How Far Are We from Probabilistically Aligned World Modeling?27 Aug 2026
- 2026Efficient Training with Foresight: Multi-Token Auxiliary Supervision for Autoregressive Image Generation26 Aug 2026
- 2026What FID Hides: Detecting, Ranking, and Diagnosing Deviations in Generative Evaluation25 Aug 2026
50 newest of 944 All 944 (JSON)
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2023Consistency Modelscited by 1,822
- 2022On Distillation of Guided Diffusion Modelscited by 725
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
- 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 402
12 most cited of 438 All 438 (JSON)
- 2026Representation Conditioning for Generation14 Oct 2026
- 2026Annealed L'evy Diffusion via Gaussian Surrogate Reverse Dynamics14 Oct 2026
- 2026PixelMoE: Scaling Pixel-Space Diffusion with LLM-Style Mixture-of-Experts13 Oct 2026
- 2026Image Tokenizers Should Be Trained Between Images12 Oct 2026
- 2026Learning ω-Powered Conditional Distributions with Importance-Weighted Flow Matching12 Oct 2026
- 2026Correction Training for Diffusion Models9 Oct 2026
- 2026CorrFlow: Exact and Permutation-Equivariant Flow Matching on the Correlation Elliptope9 Oct 2026
- 2026CoVA: Composing VAE Representations for Generative Learning9 Oct 2026
- 2026Embedding Prediction Helps Image Generation1 Oct 2026
- 2026Debias Anything: Fairness with Diversity without Supervision in Diffusion Models1 Oct 2026
- 2026Specificity-Aware Diffusion Steering via Variance-Reduced Sequential Monte Carlo30 Sep 2026
- 2026Visualizing Distribution Coverage in Generative Diffusion Models30 Sep 2026
12 newest of 438 All 438 (JSON)
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2024Consistency-diversity-realism Pareto fronts of conditional image generative modelscited by 36
- 2025Orbis: Overcoming Challenges of Long-Horizon Prediction in Driving World Modelscited by 17
- 2026CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?cited by 3
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenescited by 1
- 2026Autonomous Video Generation with Counterfactual Controllability for Self-Evolving World Modelscited by 1
- 2026PAWBench: How Far Are We from Probabilistically Aligned World Modeling?cited by 0
- 2026PAWBench: How Far Are We from Probabilistically Aligned World Modeling?27 Aug 2026
- 2026CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?17 Aug 2026
- 2026Autonomous Video Generation with Counterfactual Controllability for Self-Evolving World Models23 Jun 2026
- 2025Orbis: Overcoming Challenges of Long-Horizon Prediction in Driving World Models17 Jul 2025
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes23 Jun 2025
- 2024Consistency-diversity-realism Pareto fronts of conditional image generative models14 Jun 2024
- 2022Scalable Diffusion Models with Transformers19 Dec 2022
- 2022MaskGIT: Masked Generative Image Transformer8 Feb 2022
- 2024RandAR: Decoder-only Autoregressive Visual Generation in Random Orderscited by 83
- 2025Autoregressive Image Generation with Randomized Parallel Decodingcited by 20
- 2025Locality-aware Parallel Decoding for Efficient Autoregressive Image Generationcited by 10
- 2025Resurrect Mask AutoRegressive Modeling for Efficient and Scalable Image Generationcited by 9
- 2025VVS: Accelerating Speculative Decoding for Visual Autoregressive Generation via Partial Verification Skippingcited by 2
- 2025VVS: Accelerating Speculative Decoding for Visual Autoregressive Generation via Partial Verification Skipping17 Nov 2025
- 2025Resurrect Mask AutoRegressive Modeling for Efficient and Scalable Image Generation17 Jul 2025
- 2025Locality-aware Parallel Decoding for Efficient Autoregressive Image Generation2 Jul 2025
- 2025Autoregressive Image Generation with Randomized Parallel Decoding13 Mar 2025
- 2024RandAR: Decoder-only Autoregressive Visual Generation in Random Orders2 Dec 2024
- 2024Differentially Private Synthetic Data via Foundation Model APIs 2: Textcited by 76
- 2024Model Collapse in the Self-Consuming Chain of Diffusion Finetuning: A Novel Perspective from Quantitative Trait Modelingcited by 12
- 2025Measuring Diversity in Synthetic Datasetscited by 5
- 2026When Sample Selection Bias Precipitates Model Collapsecited by 1
- 2026When Sample Selection Bias Precipitates Model Collapse11 Jun 2026
- 2025Measuring Diversity in Synthetic Datasets12 Feb 2025
- 2024Model Collapse in the Self-Consuming Chain of Diffusion Finetuning: A Novel Perspective from Quantitative Trait Modeling4 Jul 2024
- 2024Differentially Private Synthetic Data via Foundation Model APIs 2: Text4 Mar 2024
- 2026Beyond the Dirac Delta: Mitigating Diversity Collapse in Reinforcement Fine-Tuning for Versatile Image Generationcited by 5
- 2025VendiRL: A Framework for Self-Supervised Reinforcement Learning of Diversely Diverse Skillscited by 2
- 2026Multi-Axis Max@K Reinforcement Learning for Representative Diversity in Text-to-Image Generationcited by 2
- 2026Multi-Axis Max@K Reinforcement Learning for Representative Diversity in Text-to-Image Generation16 Jul 2026
- 2026Beyond the Dirac Delta: Mitigating Diversity Collapse in Reinforcement Fine-Tuning for Versatile Image Generation18 Jan 2026
- 2025VendiRL: A Framework for Self-Supervised Reinforcement Learning of Diversely Diverse Skills3 Sep 2025
- 2024Privacy-Preserving Instructions for Aligning Large Language Modelscited by 35
- 2025CREward: A Type-Specific Creativity Reward Modelcited by 0
- 2025CREward: A Type-Specific Creativity Reward Model25 Nov 2025
- 2024Privacy-Preserving Instructions for Aligning Large Language Models21 Feb 2024
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 561
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
- 2021Generating Images with Sparse Representationscited by 266
- 2023Self-Consuming Generative Models Go MADcited by 250
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
- 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 213
- 2021Projected GANs Converge Fastercited by 208
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
12 most cited of 469 All 469 (JSON)
- 2026SNACK: A Sequential Notation Framework for Probabilistic Graph Generation14 Oct 2026
- 2026Texture Interpolation as Texton Matching13 Oct 2026
- 2026Unbalanced W-Flow: Unbalanced Wasserstein Drifting under Finite-Batch Marginal Fluctuations13 Oct 2026
- 2026TRIG: Toward Measuring Texture Realism in Image Generation10 Oct 2026
- 2026Pristine Models8 Oct 2026
- 2026From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model5 Oct 2026
- 2026What Does Fr'echet Distance Measure? A Directional Decomposition4 Oct 2026
- 2026Verifier-Guided Synthetic Augmentation for 3D Human Shape Generation2 Oct 2026
- 2026PLDiv: Measuring Dataset Diversity and Semantic Collapse via Persistence Landscapes30 Sep 2026
- 2026Improving Generative Model Self-Training with Geometrically Modified Outputs28 Sep 2026
- 2026Generative AI-Based Data Augmentation for Oral Lesion Classification: The PhotoMOCI Dataset and Benchmark28 Sep 2026
- 2026M3-Score: Fidelity, Memorization and Coverage as Separate Axes for Evaluating Generative Radiology Image Models27 Sep 2026
12 newest of 469 All 469 (JSON)