mlsanityData to 7 Oct 2026

Region in Context: Text-condition Image editing with Human-like semantic reasoning

arXiv 2510.16772 ↗First posted 19 Oct 2025cs.CV cs.AIcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Recent research has made significant progress in localizing and editing image regions based on text. However, most approaches treat these regions in isolation, relying solely on local cues without accounting for how each part contributes to the overall visual and semantic composition. This often results in inconsistent edits, unnatural transitions, or loss of coherence across the image. In this work, we propose Region in Context, a novel framework for text-conditioned image editing that performs multilevel semantic alignment between vision and language, inspired by the human ability to reason about edits in relation to the whole scene. Our method encourages each region to understand its role within the global image context, enabling precise and harmonized changes. At its core, the framework introduces a dual-level guidance mechanism: regions are represented with full-image context and aligned with detailed region-level descriptions, while the entire image is simultaneously matched to a comprehensive scene-level description generated by a large vision-language model. These descriptions serve as explicit verbal references of the intended content, guiding both local modifications and global structure. Experiments show that it produces more coherent and instruction-aligned results. Code is available at: https://github.com/thuyvuphuong/Region-in-Context.git

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 28 references that are in the map. First posted on arXiv 19 Oct 2025.

Builds on

25 of 28 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  7. 2016Improved Techniques for Training GANscited by 2,938
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  10. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  11. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
  12. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
13 more
  1. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  2. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 243
  3. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  4. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
  5. 2023Self-correcting LLM-controlled Diffusion Modelscited by 112
  6. 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 61
  7. 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 61
  8. 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
  9. 2023Text-Driven Image Editing via Learnable Regionscited by 31
  10. 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
  11. 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editorcited by 17
  12. 2024TiNO-Edit: Timestep and Noise Optimization for Robust Diffusion-Based Image Editingcited by 16
  13. 2024Diffusion-Based Conditional Image Editing through Optimized Inference with Guidancecited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RegionReasoner: Region-Grounded Multi-Round Visual Reasoning
  2. 2024Toward Interactive Regional Understanding in Vision-Large Language Models
  3. 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing
  4. 2026Re-Align: Structured Reasoning-guided Alignment for In-Context Image Generation and Editing
  5. 2024Preserve or Modify? Context-Aware Evaluation for Balancing Preservation and Modification in Text-Guided Image Editing
  6. 2026SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision
  7. 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Rendering
  8. 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editing