Region in Context: Text-condition Image editing with Human-like semantic reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent research has made significant progress in localizing and editing image regions based on text. However, most approaches treat these regions in isolation, relying solely on local cues without accounting for how each part contributes to the overall visual and semantic composition. This often results in inconsistent edits, unnatural transitions, or loss of coherence across the image. In this work, we propose Region in Context, a novel framework for text-conditioned image editing that performs multilevel semantic alignment between vision and language, inspired by the human ability to reason about edits in relation to the whole scene. Our method encourages each region to understand its role within the global image context, enabling precise and harmonized changes. At its core, the framework introduces a dual-level guidance mechanism: regions are represented with full-image context and aligned with detailed region-level descriptions, while the entire image is simultaneously matched to a comprehensive scene-level description generated by a large vision-language model. These descriptions serve as explicit verbal references of the intended content, guiding both local modifications and global structure. Experiments show that it produces more coherent and instruction-aligned results. Code is available at: https://github.com/thuyvuphuong/Region-in-Context.git
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 28 references that are in the map. First posted on arXiv 19 Oct 2025.
Builds on
25 of 28 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2016Improved Techniques for Training GANscited by 2,938
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
13 more
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 243
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 112
- 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 61
- 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 61
- 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
- 2023Text-Driven Image Editing via Learnable Regionscited by 31
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
- 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editorcited by 17
- 2024TiNO-Edit: Timestep and Noise Optimization for Robust Diffusion-Based Image Editingcited by 16
- 2024Diffusion-Based Conditional Image Editing through Optimized Inference with Guidancecited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026RegionReasoner: Region-Grounded Multi-Round Visual Reasoning
- 2024Toward Interactive Regional Understanding in Vision-Large Language Models
- 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing
- 2026Re-Align: Structured Reasoning-guided Alignment for In-Context Image Generation and Editing
- 2024Preserve or Modify? Context-Aware Evaluation for Balancing Preservation and Modification in Text-Guided Image Editing
- 2026SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision
- 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Rendering
- 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editing