PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Image editing instructions are heterogeneous: a color swap, an object insertion, and a physical-action edit all demand different spatial coverage and different reasoning depth, yet existing reasoning-based editors apply a single fixed inference recipe to every instruction. We argue that adaptivity along both the spatial and temporal axes is the missing degree of freedom, and we present PhysEdit, an editing framework built around this principle. PhysEdit introduces two inference-time modules that compose without retraining the backbone. At its core, (1) Complexity-Adaptive Reasoning Depth (CARD) predicts edit complexity directly from the instruction and reference image and allocates the reasoning step count N_r and reasoning-token length r per sample -- turning a previously fixed inference schedule into a conditional-computation problem. CARD is supported by (2) a Spatial Reasoning Mask (SRM) that extracts an instruction-conditioned spatial prior from cross-attention to confine reasoning to regions that semantically require it. On the full 737-case ImgEdit Basic-Edit Suite, PhysEdit delivers a 1.18x wall-clock speedup (64.3s vs. 76.1s per sample) over a strong reasoning baseline while slightly improving instruction adherence (CLIP-T 0.2283 vs. 0.2266, +0.7%) and matching identity preservation within noise (CLIP-I 0.8246 vs. 0.8280). The speedup is category-dependent and reaches 1.52x on appearance-level edits, validating CARD's adaptive allocation as the principal source of efficiency gain. A 30-sample pilot with full ablations isolates the contribution of each module.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 27 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
26 of 27 references.
Closest ancestors · 1
Same direction, newest first
Other references · 25
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025Qwen-Image Technical Reportcited by 973
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
13 more
- 2024OmniGen: Unified Image Generationcited by 388
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2023Token Merging for Fast Stable Diffusioncited by 220
- 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 106
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 100
- 2024Pathways on the Image Manifold: Image Editing via Video Generationcited by 27
- 2024A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Modelscited by 13
- 2025EditIDv2: Editable ID Customization with Data-Lubricated ID Feature Integration for Text-to-Image Generationcited by 8
- 2026Dual-Channel Attention Guidance for Training-Free Image Editing Control in Diffusion Transformerscited by 6
- 2026Inject Where It Matters: Training-Free Spatially-Adaptive Identity Preservation for Text-to-Image Personalizationcited by 3
- 2026Frequency-Aware Error-Bounded Caching for Accelerating Diffusion Transformerscited by 3
- 2026AdaEdit: Adaptive Temporal and Channel Modulation for Flow-Based Image Editingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2025RePlan: Reasoning-guided Region Planning for Complex Instruction-based Image Editing
- 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning
- 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
- 2026Generative Visual Chain-of-Thought for Image Editing
- 2026PrismGPT: Proxy-Guided Learning for Region-Aware Photo Editing with Self-Synthesized Reasoning
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
- 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing