Self-Corrected Image Generation with Explainable Latent Rewards
Not on the map. Why?
Abstract (arXiv)
Despite significant progress in text-to-image generation, aligning outputs with complex prompts remains challenging, particularly for fine-grained semantics and spatial relations. This difficulty stems from the feed-forward nature of generation, which requires anticipating alignment without fully understanding the output. In contrast, evaluating generated images is more tractable. Motivated by this asymmetry, we propose xLARD, a self-correcting framework that uses multimodal large language models to guide generation through Explainable LAtent RewarDs. xLARD introduces a lightweight corrector that refines latent representations based on structured feedback from model-generated references. A key component is a differentiable mapping from latent edits to interpretable reward signals, enabling continuous latent-level guidance from non-differentiable image-level evaluations. This mechanism allows the model to understand, assess, and correct itself during generation. Experiments across diverse generation and editing tasks show that xLARD improves semantic alignment and visual fidelity while maintaining generative priors. Code is available at https://yinyiluo.github.io/xLARD/.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 42 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
33 of 42 references.
References · 33
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
21 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024OmniGen: Unified Image Generationcited by 388
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 145
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 113
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 112
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Modelscited by 68
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
- 2025UniRL: Self-Improving Unified Multimodal Models via Supervised and Reinforcement Learningcited by 23
- 2025SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Modelscited by 19
- 2025HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generationcited by 17
- 2024Multi-modal Attribute Prompting for Vision-Language Modelscited by 12
- 2024EIVEN: Efficient Implicit Attribute Value Extraction using Multimodal LLMcited by 12
- 2025Enhancing Vision-Language Compositional Understanding with Multimodal Synthetic Datacited by 12
- 2025Evaluating Compositional Scene Understanding in Multimodal Generative Modelscited by 5
- 2025OmniBridge: Unified Multimodal Understanding, Generation, and Retrieval via Latent Space Alignmentcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
- 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
- 2026Large Language Models are Universal Reasoners for Visual Generation
- 2026SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation
- 2026Iterative Refinement Improves Compositional Image Generation
- 2025Test-time Prompt Refinement for Text-to-Image Models
- 2025Align Beyond Prompts: Evaluating World Knowledge Alignment in Text-to-Image Generation
- 2025FocusDiff: Advancing Fine-Grained Text-Image Alignment for Autoregressive Visual Generation through RL