MCLR: Improving Conditional Modeling via Inter-Class Likelihood-Ratio Maximization and Unifying Classifier-Free Guidance with Alignment Objectives
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models achieve strong performance in generative modeling, but their success often relies heavily on classifier-free guidance (CFG), an inference-time heuristic that modifies the sampling trajectory. In theory, diffusion models trained with standard denoising score matching (DSM) should recover the target data distribution, raising two fundamental questions: (i) why is inference-time guidance necessary in practice, and (ii) can its underlying effect be internalized into a principled training objective? In this work, we argue that a key limitation of standard DSM is insufficient inter-class separation. To address this issue, we propose MCLR, an alignment objective that explicitly maximizes inter-class likelihood-ratios during training. Fine-tuning diffusion models with MCLR induces CFG-like improvements under standard sampling, substantially improving guidance-free conditional generation and narrowing the gap to inference-time CFG. Beyond these empirical benefits, we show theoretically that the CFG-guided score is exactly the optimal solution to a sample-adaptive weighted MCLR objective. This result connects CFG to alignment-based objectives, providing a mechanistic interpretation of CFG as an implicit inference-time contrastive alignment procedure.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. First posted on arXiv 23 Mar 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Bridging the Gap: Addressing Discrepancies in Diffusion Model Training for Classifier-Free Guidance
- 2025Conditional Diffusion Models with Classifier-Free Gibbs-like Guidance
- 2026Revisiting Classifier-Free Guidance Methods in Latent Diffusion Models
- 2024Rectified Diffusion Guidance for Conditional Generation
- 2023Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models
- 2024No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Models
- 2025Diffusion Sampling Path Tells More: An Efficient Plug-and-Play Strategy for Sample Filtering
- 2025Classifier-free Guidance with Adaptive Scaling