Re-Align: Structured Reasoning-guided Alignment for In-Context Image Generation and Editing
Not on the map. Why?
Abstract (arXiv)
In-context image generation and editing (ICGE) enables users to specify visual concepts through interleaved image-text prompts, demanding precise understanding and faithful execution of user intent. Although recent unified multimodal models exhibit promising understanding capabilities, these strengths often fail to transfer effectively to image generation. We introduce Re-Align, a unified framework that bridges the gap between understanding and generation through structured reasoning-guided alignment. At its core lies the In-Context Chain-of-Thought (IC-CoT), a structured reasoning paradigm that decouples semantic guidance and reference association, providing clear textual target and mitigating confusion among reference images. Furthermore, Re-Align introduces an effective RL training scheme that leverages a surrogate reward to measure the alignment between structured reasoning text and the generated image, thereby improving the model's overall performance on ICGE tasks. Extensive experiments verify that Re-Align outperforms competitive methods of comparable model scale and resources on both in-context image generation and editing tasks.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 59 of its 67 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
59 of 67 references.
References · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Qwen2.5-VL Technical Reportcited by 5,418
38 more
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
- 2024OmniGen: Unified Image Generationcited by 388
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Expertscited by 6
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026Edit-R2: Context-Aware Reinforcement Learning for Multi-Turn Image Editingcited by 1
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generationcited by 0
- 2026Edit-R2: Context-Aware Reinforcement Learning for Multi-Turn Image Editing4 Jun 2026
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation25 May 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Experts12 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
- 2025Align Beyond Prompts: Evaluating World Knowledge Alignment in Text-to-Image Generation
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2025GIR-Bench: Versatile Benchmark for Generating Images with Reasoning
- 2025Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editing
- 2025Understanding-in-Generation: Reinforcing Generative Capability of Unified Model via Infusing Understanding into Generation
- 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing
- 2025REVEALER: Reinforcement-Guided Visual Reasoning for Element-Level Text-Image Alignment Evaluation