mlsanityData to 7 Oct 2026

InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning

arXiv 2603.01586 ↗First posted 2 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Emerging unified editing models have demonstrated strong capabilities in general object editing tasks. However, it remains a significant challenge to perform fine-grained editing in complex multi-entity scenes, particularly those where targets are not visually salient and require spatial reasoning. To this end, we propose InterCoG, a novel text-vision Interleaved Chain-of-Grounding reasoning framework for fine-grained image editing in complex real-world scenes. The key insight of InterCoG is to first perform object position reasoning solely within text that includes spatial relation details to explicitly deduce the location and identity of the edited target. It then conducts visual grounding via highlighting the editing targets with generated bounding boxes and masks in pixel space, and finally rewrites the editing description to specify the intended outcomes. To further facilitate this paradigm, we propose two auxiliary training modules: multimodal grounding reconstruction supervision and multimodal grounding reasoning alignment to enforce spatial localization accuracy and reasoning interpretability, respectively. We also construct GroundEdit-45K, a dataset comprising 45K grounding-oriented editing samples with detailed reasoning annotations, and GroundEdit-Bench for grounding-aware editing evaluation. Extensive experiments substantiate the superiority of our approach in highly precise edits under spatially intricate and multi-entity scenes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 53 of its 67 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

53 of 67 references.

References · 53

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2023Segment Anythingcited by 8,158
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2025Qwen-Image Technical Reportcited by 973
  10. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  11. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
38 more
  1. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
  2. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
  3. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  4. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  6. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
  7. 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
  8. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  9. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  10. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  11. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  12. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  13. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
  14. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  15. 2025Transfer between Modalities with MetaQueriescited by 231
  16. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  17. 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
  18. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  19. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
  20. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
  21. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
  22. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 160
  23. 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 124
  24. 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
  25. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
  26. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
  27. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 78
  28. 2023Open-Set Image Tagging with Multi-Grained Text Supervisioncited by 67
  29. 2025Ovis-U1 Technical Reportcited by 65
  30. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 52
  31. 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 40
  32. 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 35
  33. 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
  34. 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
  35. 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Modelcited by 31
  36. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 23
  37. 2025Consistent Image Layout Editing with Diffusion Modelscited by 9
  38. 2025RePlan: Reasoning-guided Region Planning for Complex Instruction-based Image Editingcited by 9

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CoEvolve: Construct-to-Edit Visual Grounding with Bidirectional State Refinement
  2. 2026Generative Visual Chain-of-Thought for Image Editing
  3. 2025Connecting the Dots: Training-Free Visual Grounding via Agentic Reasoning
  4. 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing
  5. 2025Region in Context: Text-condition Image editing with Human-like semantic reasoning
  6. 2026PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning
  7. 2023Advancing Visual Grounding with Scene Knowledge: Benchmark and Method
  8. 2025SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understanding