mlsanityData to 7 Oct 2026

Meta-CoT: Enhancing Granularity and Generalization in Image Editing

arXiv 2604.24625 ↗First posted 27 Apr 2026cs.CV cs.AI cs.LGcited by 3

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Unified multi-modal understanding/generative models have shown improved image editing performance by incorporating fine-grained understanding into their Chain-of-Thought (CoT) process. However, a critical question remains underexplored: what forms of CoT and training strategy can jointly enhance both the understanding granularity and generalization? To address this, we propose Meta-CoT, a paradigm that performs a two-level decomposition of any single-image editing operation with two key properties: (1) Decomposability. We observe that any editing intention can be represented as a triplet - (task, target, required understanding ability). Inspired by this, Meta-CoT decomposes both the editing task and the target, generating task-specific CoT and traversing editing operations on all targets. This decomposition enhances the model's understanding granularity of editing operations and guides it to learn each element of the triplet during training, substantially improving the editing capability. (2) Generalizability. In the second decomposition level, we further break down editing tasks into five fundamental meta-tasks. We find that training on these five meta-tasks, together with the other two elements of the triplet, is sufficient to achieve strong generalization across diverse, unseen editing tasks. To further align the model's editing behavior with its CoT reasoning, we introduce the CoT-Editing Consistency Reward, which encourages more accurate and effective utilization of CoT information during editing. Experiments demonstrate that our method achieves an overall 15.8% improvement across 21 editing tasks, and generalizes effectively to unseen editing tasks when trained on only a small set of meta-tasks. Our code, benchmark, and model are released at https://shiyi-zh0408.github.io/projectpages/Meta-CoT/

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 78 of its 84 references that are in the map. First posted on arXiv 27 Apr 2026.

Builds on

78 of 84 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025ControlThinker: Unveiling Latent Semantics for Controllable Image Generation through Visual Reasoning4 Jun
  2. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning22 May
  3. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
  4. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
  5. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
  6. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
  7. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale6 Dec
  8. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  9. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  10. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
  11. 2022Visual Programming: Compositional visual reasoning without training18 Nov
  12. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep

Other references · 66

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  11. 2025Qwen-Image Technical Reportcited by 973
  12. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
38 more
  1. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  3. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  4. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  5. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  6. 2022Large Language Models Can Self-Improvecited by 656
  7. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  8. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  9. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  10. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  11. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  12. 2024OmniGen: Unified Image Generationcited by 388
  13. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  14. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  15. 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 301
  16. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
  17. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  18. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  19. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  20. 2025Transfer between Modalities with MetaQueriescited by 231
  21. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  22. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
  23. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 200
  24. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  25. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
  26. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  27. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
  28. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  29. 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 123
  30. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  31. 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
  32. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
  33. 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generationcited by 64
  34. 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Modelcited by 60
  35. 2025BLIP3o-NEXT: Next Frontier of Native Image Generationcited by 50
  36. 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 47
  37. 2025Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Modelscited by 40
  38. 2025Interleaving Reasoning for Better Text-to-Image Generationcited by 40

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Instruction-based Image Editing with Planning, Reasoning, and Generation
  2. 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision
  3. 2026Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuning
  4. 2026CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning
  5. 2025Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Builder
  6. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learning
  7. 2026Generative Visual Chain-of-Thought for Image Editing
  8. 2026CoT-Edit: Let CoT Guide Instruction Video Editing