mlsanityData to 7 Oct 2026

Open-Source Image Editing Models Are Zero-Shot Vision Learners

arXiv 2605.04566 ↗First posted 6 May 2026cs.CV cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Recent studies have shown that large generative models can solve vision tasks they were not explicitly trained for. However, existing evidence relies on closed-source models~(Veo~3, Nano Banana Pro) or requires task-specific instruction tuning, leaving open whether publicly available image-editing models possess zero-shot vision abilities out of the box. We conduct a systematic evaluation of three open-source image-editing models -- Qwen-Image-Edit, FireRed-Image-Edit, and LongCat-Image-Edit -- on dense visual prediction tasks without any fine-tuning. We benchmark monocular depth estimation on NYUv2 and DIODE, surface normal estimation on NYUv2, and semantic segmentation on Cityscapes, covering both geometric and semantic scene understanding. Results show that open-source image-editing models exhibit non-trivial zero-shot visual understanding. On NYUv2 surface normals, FireRed-Image-Edit achieves a mean angular error of 17.69^circ, surpassing the fine-tuned Marigold (20.86^circ) and matching the instruction-tuned Vision Banana (17.78^circ) without any task-specific training. On NYUv2 depth estimation, LongCat-Image-Edit obtains δ1=0.822 with affine alignment, and Qwen-Image-Edit leads on DIODE Indoor (δ1=0.868). On Cityscapes semantic segmentation, Qwen-Image-Edit reaches 25.7 mIoU at the 19-class level and 49.5 mIoU at a coarser 7-category level. By comparing three independently trained editors, we test whether zero-shot vision ability is an emergent property of image-editing pretraining rather than a model-specific artifact. Code, evaluation scripts, and all results are publicly released to serve as a reproducible baseline for future work.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 8 of its 12 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

8 of 12 references.

References · 8

  1. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  2. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
  3. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
  4. 2025Video models are zero-shot learners and reasonerscited by 208
  5. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
  6. 2025LongCat-Image Technical Reportcited by 92
  7. 2026FireRed-Image-Edit-1.0 Technical Reportcited by 31
  8. 2025Is Nano Banana Pro a Low-Level Vision All-Rounder? A Comprehensive Evaluation on 14 Tasks and 40 Datasetscited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.