CritiFusion: Semantic Critique and Spectral Alignment for Faithful Text-to-Image Generation
On the map: Diffusion models → Image generation, text-to-image and editing
also in 1 more
Abstract (arXiv)
Recent text-to-image diffusion models have achieved remarkable visual fidelity but often struggle with semantic alignment to complex prompts. We introduce CritiFusion, a novel inference-time framework that integrates a multimodal semantic critique mechanism with frequency-domain refinement to improve text-to-image consistency and detail. The proposed CritiCore module leverages a vision-language model and multiple large language models to enrich the prompt context and produce high-level semantic feedback, guiding the diffusion process to better align generated content with the prompt's intent. Additionally, SpecFusion merges intermediate generation states in the spectral domain, injecting coarse structural information while preserving high-frequency details. No additional model training is required. CritiFusion serves as a plug-in refinement stage compatible with existing diffusion backbones. Experiments on standard benchmarks show that our method notably improves human-aligned metrics of text-to-image correspondence and visual quality. CritiFusion consistently boosts performance on human preference scores and aesthetic evaluations, achieving results on par with state-of-the-art reward optimization approaches. Qualitative results further demonstrate superior detail, realism, and prompt fidelity, indicating the effectiveness of our semantic critique and spectral alignment strategy.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 32 of its 33 references that are in the map. First posted on arXiv 27 Dec 2025.
Builds on
32 of 33 references.
Closest ancestors · 6
Same direction, newest first
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2023A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generation25 Oct
- 2023Manipulating Embeddings of Stable Diffusion Prompts23 Aug
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers2 Nov
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2023GPT-4 Technical Reportcited by 18,278
- 2022Training language models to follow instructions with human feedbackcited by 15,856
- 2020Denoising Diffusion Implicit Modelscited by 9,718
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,323
- 2021Zero-Shot Text-to-Image Generationcited by 4,284
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,289
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,180
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,028
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 961
14 more
- 2023Training Diffusion Models with Reinforcement Learningcited by 955
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 871
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 775
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 663
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 440
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 420
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 286
- 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 286
- 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 247
- 2022Optimizing Prompts for Text-to-Image Generationcited by 204
- 2024Aligning Diffusion Models by Optimizing Human Utilitycited by 100
- 2024Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimizationcited by 83
- 2024DyMO: Training-Free Diffusion Model Alignment with Dynamic Multi-Objective Schedulingcited by 27
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Enhancing Semantic Fidelity in Text-to-Image Synthesis: Attention Regulation in Diffusion Models
- 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
- 2025UniAlignment: Semantic Alignment for Unified Image Generation, Understanding, Manipulation and Perception
- 2023Divide, Evaluate, and Refine: Evaluating and Improving Text-to-Image Alignment with Iterative VQA Feedback
- 2025HCMA: Hierarchical Cross-model Alignment for Grounded Text-to-Image Generation
- 2025Test-time Prompt Refinement for Text-to-Image Models
- 2026Iterative Refinement Improves Compositional Image Generation
- 2024Image Regeneration: Evaluating Text-to-Image Model via Generating Identical Image with Multimodal Large Language Models