Edit Spillover as a Probe: Do Image Editing Models Implicitly Understand World Relations?
Not on the map. Why?
Abstract (arXiv)
Instruction-following image editing models are expected to modify only the specified region while keeping the rest of the image unchanged. However, in practice, we observe a pervasive phenomenon -- edit spillover: models alter semantically related but unspecified content outside the edit region. This raises a fundamental question -- does spillover reflect genuine implicit world understanding, or is it merely attention leakage? We propose EditSpilloverProbe, a systematic framework that repurposes edit spillover as a natural probe for world knowledge in image editing models. We introduce a spillover taxonomy (spatial, semantic, mixed, random), an automated detection-and-classification pipeline, and a benchmark dataset constructed from real-world Chinese text editing tasks, EditSpilloverBench. Systematic evaluation of 5 representative editing models reveals three core findings: (1) spillover rates vary dramatically across architectures, from 3.49% to 11.46%, with a 3.3x ratio; (2) absolute semantic spillover quantity reveals models' world understanding capability -- nano_banana produces the most semantic spillover (27.8 per image), while qwen_2511 has the most precise editing control but lower semantic spillover (16.3 per image), revealing a trade-off between editing control and world understanding; (3) spatial decay analysis shows spillover area density decays exponentially with distance, but the proportion of semantically relevant spillover remains constant (40%-58%), providing direct evidence that semantic spillover reflects genuine world understanding rather than spatial diffusion.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
15 of 23 references.
References · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 61
Built on by
Citing papers per year: 2026: 1.
1 paper.