InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning
Not on the map. Why?
Abstract (arXiv)
Emerging unified editing models have demonstrated strong capabilities in general object editing tasks. However, it remains a significant challenge to perform fine-grained editing in complex multi-entity scenes, particularly those where targets are not visually salient and require spatial reasoning. To this end, we propose InterCoG, a novel text-vision Interleaved Chain-of-Grounding reasoning framework for fine-grained image editing in complex real-world scenes. The key insight of InterCoG is to first perform object position reasoning solely within text that includes spatial relation details to explicitly deduce the location and identity of the edited target. It then conducts visual grounding via highlighting the editing targets with generated bounding boxes and masks in pixel space, and finally rewrites the editing description to specify the intended outcomes. To further facilitate this paradigm, we propose two auxiliary training modules: multimodal grounding reconstruction supervision and multimodal grounding reasoning alignment to enforce spatial localization accuracy and reasoning interpretability, respectively. We also construct GroundEdit-45K, a dataset comprising 45K grounding-oriented editing samples with detailed reasoning annotations, and GroundEdit-Bench for grounding-aware editing evaluation. Extensive experiments substantiate the superiority of our approach in highly precise edits under spatially intricate and multi-entity scenes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 53 of its 67 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
53 of 67 references.
References · 53
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Segment Anythingcited by 8,158
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
38 more
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 160
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 124
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 78
- 2023Open-Set Image Tagging with Multi-Grained Text Supervisioncited by 67
- 2025Ovis-U1 Technical Reportcited by 65
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 52
- 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 40
- 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 35
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
- 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
- 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Modelcited by 31
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 23
- 2025Consistent Image Layout Editing with Diffusion Modelscited by 9
- 2025RePlan: Reasoning-guided Region Planning for Complex Instruction-based Image Editingcited by 9
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CoEvolve: Construct-to-Edit Visual Grounding with Bidirectional State Refinement
- 2026Generative Visual Chain-of-Thought for Image Editing
- 2025Connecting the Dots: Training-Free Visual Grounding via Agentic Reasoning
- 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing
- 2025Region in Context: Text-condition Image editing with Human-like semantic reasoning
- 2026PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning
- 2023Advancing Visual Grounding with Scene Knowledge: Benchmark and Method
- 2025SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understanding