DICT: Data Injection and Contrastive Trajectory Refinement for Conditional Image Generation with Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models have become a dominant paradigm for conditional image generation, yet existing approaches generally follow two directions: task-specific designs that can improve performance but limit generalization, and training-free loss guidance that compresses rich conditions into scalar objectives and applies stepwise guidance, leading to information bottlenecks and error accumulation along the sampling trajectory. Given the urgent need for an effective unified framework across diverse conditional image generation tasks, we propose Data Injection and Contrastive Trajectory Refinement (DICT), a training-free inference method that enhances conditional image generation without introducing task-dependent architectures. DICT introduces Data Injection, where noise-perturbed conditional signals are integrated into early denoising stages; by performing guided denoising on these injected signals, DICT adaptively selects and distills task-salient information from the raw condition, effectively preserving spatial richness and ensuring precise condition-to-generation alignment. Furthermore, DICT applies Contrastive Trajectory Refinement across adjacent denoising states, enabling pairwise comparisons that progressively improve sample quality. These designs keep inference simple while improving cross-task transfer under a unified diffusion formulation. Extensive experiments on conditional image generation tasks (e.g., style transfer, image super-resolution, and image deblurring) show consistent gains in fidelity and perceptual quality over representative task-specific and loss-guided baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 31 of its 40 references that are in the map. First posted on arXiv 4 Jul 2026.
Builds on
31 of 40 references.
Closest ancestors · 8
Same direction, newest first
- 2024TFG: Unified Training-Free Guidance for Diffusion Models24 Sep
- 2023Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models19 Dec
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model17 Mar
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
- 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 166
- 2024Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealingcited by 157
11 more
- 2023Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion Modelscited by 156
- 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 85
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 76
- 2024DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representationscited by 68
- 2025FlowDPS: Flow-Driven Posterior Sampling for Inverse Problemscited by 65
- 2024StyleShot: A Snapshot on Any Stylecited by 60
- 2024Steering Rectified Flow Models in the Vector Field for Controlled Image Generationcited by 38
- 2024StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elementscited by 26
- 2024SITCOM: Step-wise Triple-Consistent Diffusion Sampling for Inverse Problemscited by 23
- 2025Rethinking Diffusion Posterior Sampling: From Conditional Score Estimator to Maximizing a Posteriorcited by 20
- 2024Solving Inverse Problems via Diffusion Optimal Controlcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024A Simple Approach to Unifying Diffusion-based Conditional Generation
- 2023CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation
- 2023A Unified Conditional Framework for Diffusion-based Image Restoration
- 2023ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectories
- 2024Input-Adaptive Generative Dynamics in Diffusion Models
- 2023Conditional Generation from Unconditional Diffusion Models using Denoiser Representations
- 2024Conditional Image Synthesis with Diffusion Models: A Survey
- 2023Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis