Scaling Group Inference for Diverse and High-Quality Generation
Not on the map. Why?
Abstract (arXiv)
Generative models typically sample outputs independently, and recent inference-time guidance and scaling algorithms focus on improving the quality of individual samples. However, in real-world applications, users are often presented with a set of multiple images (e.g., 4-8) for each prompt, where independent sampling tends to lead to redundant results, limiting user choices and hindering idea exploration. In this work, we introduce a scalable group inference method that improves both the diversity and quality of a group of samples. We formulate group inference as a quadratic integer assignment problem: candidate outputs are modeled as graph nodes, and a subset is selected to optimize sample quality (unary term) while maximizing group diversity (binary term). To substantially improve runtime efficiency, we progressively prune the candidate set using intermediate predictions, allowing our method to scale up to large candidate sets. Extensive experiments show that our method significantly improves group diversity and quality compared to independent sampling baselines and recent inference algorithms. Our framework generalizes across a wide range of tasks, including text-to-image, image-to-image, image prompting, and video generation, enabling generative models to treat multiple outputs as cohesive groups rather than independent samples.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 48 of its 52 references that are in the map. First posted on arXiv 21 Aug 2025.
Builds on
48 of 52 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
36 more
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Video Diffusion Modelscited by 2,305
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2025s1: Simple test-time scalingcited by 1,341
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023Adversarial Diffusion Distillationcited by 759
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
- 2017Toward Multimodal Image-to-Image Translationcited by 296
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2024Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Modelscited by 254
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
- 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
- 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Modelscited by 170
- 2023Grounded Text-to-Image Synthesis with Attention Refocusingcited by 164
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
- 2024Distilling Diffusion Models into Conditional GANscited by 78
- 2023Particle Guidance: non-I.I.D. Diverse Sampling with Diffusion Modelscited by 71
- 2024Consistency-diversity-realism Pareto fronts of conditional image generative modelscited by 36
- 2023Localized Text-to-Image Generation for Free via Cross Attention Controlcited by 27
- 2025Generating Multi-Image Synthetic Data for Text-to-Image Customizationcited by 25
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025It's Never Too Late: Noise Optimization for Collapse Recovery in Trained Diffusion Modelscited by 11
- 2025Diverse Video Generation with Determinantal Point Process-Guided Policy Optimizationcited by 4
- 2026On-the-fly Repulsion in the Contextual Space for Rich Diversity in Diffusion Transformerscited by 3
- 2026STRIDE: Training-Free Diversity Guidance via PCA-Directed Feature Perturbation in Single-Step Diffusion Modelscited by 3
- 2026ArtifactLens: Hundreds of Labels Are Enough for Artifact Detection with VLMscited by 1
- 2026Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenescited by 1
- 2026Don't Settle at the Mode! Mitigating Diversity Collapse in Pretrained Flow Models via Feature Self-Guidancecited by 1
- 2026Manifold-Constrained Noise Optimization for Diverse Diffusion Samplingcited by 1
- 2026Diverse Sampling in Diffusion Models with Marginal Preserving Particle Guidancecited by 0
- 2026Semantic Browsing: Controllable Diversity for Image Generationcited by 0
- 2026Improving Sample Diversity in Autoregressive Text-to-Image Generation via Cluster Truncationcited by 0
- 2026Traversing the Satisfaction-Diversity Frontier in Text-to-Image Diffusioncited by 0
- 2026Traversing the Satisfaction-Diversity Frontier in Text-to-Image Diffusion1 Oct 2026
- 2026Manifold-Constrained Noise Optimization for Diverse Diffusion Sampling27 Jul 2026
- 2026Improving Sample Diversity in Autoregressive Text-to-Image Generation via Cluster Truncation12 Jul 2026
- 2026Don't Settle at the Mode! Mitigating Diversity Collapse in Pretrained Flow Models via Feature Self-Guidance25 Jun 2026
- 2026Semantic Browsing: Controllable Diversity for Image Generation22 Jun 2026
- 2026Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenes22 May 2026
- 2026STRIDE: Training-Free Diversity Guidance via PCA-Directed Feature Perturbation in Single-Step Diffusion Models12 May 2026
- 2026Diverse Sampling in Diffusion Models with Marginal Preserving Particle Guidance7 May 2026
- 2026On-the-fly Repulsion in the Contextual Space for Rich Diversity in Diffusion Transformers30 Mar 2026
- 2026ArtifactLens: Hundreds of Labels Are Enough for Artifact Detection with VLMs10 Feb 2026
- 2025It's Never Too Late: Noise Optimization for Collapse Recovery in Trained Diffusion Models31 Dec 2025
- 2025Diverse Video Generation with Determinantal Point Process-Guided Policy Optimization25 Nov 2025