mlsanityData to 7 Oct 2026

Edit Spillover as a Probe: Do Image Editing Models Implicitly Understand World Relations?

arXiv 2603.17876 ↗First posted 18 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Instruction-following image editing models are expected to modify only the specified region while keeping the rest of the image unchanged. However, in practice, we observe a pervasive phenomenon -- edit spillover: models alter semantically related but unspecified content outside the edit region. This raises a fundamental question -- does spillover reflect genuine implicit world understanding, or is it merely attention leakage? We propose EditSpilloverProbe, a systematic framework that repurposes edit spillover as a natural probe for world knowledge in image editing models. We introduce a spillover taxonomy (spatial, semantic, mixed, random), an automated detection-and-classification pipeline, and a benchmark dataset constructed from real-world Chinese text editing tasks, EditSpilloverBench. Systematic evaluation of 5 representative editing models reveals three core findings: (1) spillover rates vary dramatically across architectures, from 3.49% to 11.46%, with a 3.3x ratio; (2) absolute semantic spillover quantity reveals models' world understanding capability -- nano_banana produces the most semantic spillover (27.8 per image), while qwen_2511 has the most precise editing control but lower semantic spillover (16.3 per image), revealing a trade-off between editing control and world understanding; (3) spatial decay analysis shows spillover area density decays exponentially with distance, but the proportion of semantically relevant spillover remains constant (40%-58%), providing direct evidence that semantic spillover reflects genuine world understanding rather than spatial diffusion.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

15 of 23 references.

References · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  6. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  7. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  8. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  9. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  10. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  11. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  12. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 61
3 more
  1. 2024EditWorld: Simulating World Dynamics for Instruction-Following Image Editingcited by 37
  2. 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editingcited by 11
  3. 2026RISE-Video: Can Video Generators Decode Implicit World Rules?cited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.