PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editing
Not on the map. Why?
Abstract (arXiv)
While instruction-based image editing, enabled by multi-modal generative models, has advanced significantly, existing benchmarks lack a comprehensive evaluation of physics-based reasoning, a critical capability for handling real-world scenarios. To address this, we introduce PhyEditBench, a benchmark designed to assess the physical understanding of editing models. Guided by a hierarchical taxonomy, we establish 4 primary classes and 12 subclasses. It comprises 238 high-quality, high-resolution, real-world instances meticulously extracted from videos to capture authentic physical dynamics, alongside 35 synthetic Anti-Physics instances. Our empirical analysis of current SOTA editing methods exposes substantial limitations in their physics-based reasoning. We further propose a training-free baseline named PhyWorld that uses test-time scaling and a latent reduction strategy. PhyWorld outperforms comparable models and suggests that the video generation process can effectively serve as a reasoning mechanism for image editing. The project page is available at https://github.com/Previsior/PhyEditBench.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 59 of its 66 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
59 of 66 references.
References · 59
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
38 more
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 195
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 56
- 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 40
- 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulationcited by 29
- 2024Pathways on the Image Manifold: Image Editing via Video Generationcited by 27
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 25
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 25
- 2025PhyGDPO: Physics-Aware Groupwise Direct Preference Optimization for Physically Consistent Text-to-Video Generationcited by 23
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Modelscited by 19
- 2025ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generationcited by 17
- 2025ThinkGen: Generalized Thinking for Visual Generationcited by 13
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026TransPhy: Visual In-Context Learning for Physically Grounded Image Editingcited by 0
- 2026Do Vision Models Learn Physical Constraints or Rendering Shortcuts? A Counterfactual Benchmark for Grounded Physical Consistencycited by 0
- 2026Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Auditcited by 0
- 2026Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Audit7 Oct 2026
- 2026Do Vision Models Learn Physical Constraints or Rendering Shortcuts? A Counterfactual Benchmark for Grounded Physical Consistency6 Oct 2026
- 2026TransPhy: Visual In-Context Learning for Physically Grounded Image Editing25 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs
- 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM
- 2026PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning
- 2026PhyEdit: Towards Real-World Object Manipulation via Physically-Grounded Image Editing
- 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation
- 2025PICABench: How Far Are We from Physically Realistic Image Editing?
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models