PICABench: How Far Are We from Physically Realistic Image Editing?
Not on the map. Why?
Abstract (arXiv)
Image editing has achieved remarkable progress recently. Modern editing models could already follow complex instructions to manipulate the original content. However, beyond completing the editing instructions, the accompanying physical effects are the key to the generation realism. For example, removing an object should also remove its shadow, reflections, and interactions with nearby objects. Unfortunately, existing models and benchmarks mainly focus on instruction completion but overlook these physical effects. So, at this moment, how far are we from physically realistic image editing? To answer this, we introduce PICABench, which systematically evaluates physical realism across eight sub-dimension (spanning optics, mechanics, and state transitions) for most of the common editing operations (add, remove, attribute change, etc.). We further propose the PICAEval, a reliable evaluation protocol that uses VLM-as-a-judge with per-case, region-level human annotations and questions. Beyond benchmarking, we also explore effective solutions by learning physics from videos and construct a training dataset PICA-100K. After evaluating most of the mainstream models, we observe that physical realism remains a challenging problem with large rooms to explore. We hope that our benchmark and proposed solutions can serve as a foundation for future work moving from naive content editing toward physically consistent realism.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 20 Oct 2025.
Builds on
38 of 46 references.
References · 38
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
26 more
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
- 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 146
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2024AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmarkcited by 140
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversioncited by 79
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
- 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selectioncited by 65
- 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
- 2024EditWorld: Simulating World Dynamics for Instruction-Following Image Editingcited by 38
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generationcited by 38
- 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
- 2025ObjectMover: Generative Object Movement with Video Priorcited by 30
- 2024Pathways on the Image Manifold: Image Editing via Video Generationcited by 27
- 2025Factuality Matters: When Image Generation and Editing Meet Structured Visualscited by 20
- 2025ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid Motionscited by 19
- 2024ReasonPix2Pix: Instruction Reasoning Dataset for Advanced Image Editingcited by 14
- 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Visioncited by 14
- 2024Instruction-based Image Manipulation by Watching How Things Movecited by 12
- 2025Understanding Generative AI Capabilities in Everyday Image Editing Taskscited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 15.
16 papers.
Sort:
By area:
- 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Timecited by 14
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 12
- 2026Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Frameworkcited by 5
- 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priorscited by 3
- 2026ViGoR-Bench: How Far Are Visual Generative Models From Zero-Shot Visual Reasoners?cited by 2
- 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executionscited by 2
- 2026Do Image Editing Models Understand Lighting?cited by 1
- 2025Do-Undo Bench: Reversibility for Action Understanding in Image Generationcited by 0
- 2026DataEvolver: Let Your Data Build and Improve Itself via Goal-Driven Loop Agentscited by 0
- 2026LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretationcited by 0
- 2026Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysiscited by 0
- 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoningcited by 0
4 more
- 2026TransPhy: Visual In-Context Learning for Physically Grounded Image Editingcited by 0
- 2026PAWBench: How Far Are We from Probabilistically Aligned World Modeling?cited by 0
- 2026Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessmentcited by 0
- 2026Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Auditcited by 0
- 2026Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Audit7 Oct 2026
- 2026Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment29 Sep 2026
- 2026PAWBench: How Far Are We from Probabilistically Aligned World Modeling?27 Aug 2026
- 2026TransPhy: Visual In-Context Learning for Physically Grounded Image Editing25 Aug 2026
- 2026Do Image Editing Models Understand Lighting?25 Jun 2026
- 2026Are Text-to-Image Models Inductivist Turkeys? A Counterfactual Benchmark for Causal Reasoning23 Jun 2026
- 2026Taming I2V models for Image HOI Editing: A Cognitive Benchmark and Agentic Self-Correcting Framework17 Jun 2026
- 2026Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysis14 May 2026
- 2026LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretation8 May 2026
- 2026DataEvolver: Let Your Data Build and Improve Itself via Goal-Driven Loop Agents3 May 2026
- 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions17 Apr 2026
- 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Time13 Apr 2026
4 more
- 2026ViGoR-Bench: How Far Are Visual Generative Models From Zero-Shot Visual Reasoners?26 Mar 2026
- 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priors25 Feb 2026
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Models2 Feb 2026
- 2025Do-Undo Bench: Reversibility for Action Understanding in Image Generation15 Dec 2025
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 12
- 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priorscited by 3
- 2026Do Image Editing Models Understand Lighting?cited by 1
- 2026DataEvolver: Let Your Data Build and Improve Itself via Goal-Driven Loop Agentscited by 0
- 2026LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretationcited by 0
- 2026Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysiscited by 0
- 2026Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Auditcited by 0
- 2026Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Audit7 Oct 2026
- 2026Do Image Editing Models Understand Lighting?25 Jun 2026
- 2026Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysis14 May 2026
- 2026LithoBench: Benchmarking Large Multimodal Models for Remote-Sensing Lithology Interpretation8 May 2026
- 2026DataEvolver: Let Your Data Build and Improve Itself via Goal-Driven Loop Agents3 May 2026
- 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priors25 Feb 2026
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Models2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editing
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
- 2026PhyEdit: Towards Real-World Object Manipulation via Physically-Grounded Image Editing
- 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting
- 2026DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model
- 2026How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editing
- 2024Towards a Training Free Approach for 3D Scene Editing