Image Editing Models are Numerical Solvers
Not on the map. Why?
Abstract (arXiv)
We investigate whether a pretrained generative image-editing model can provide a common interface for numerical simulation. Physical inputs and solutions are rendered as images, while scalar quantities such as material properties, diffusivity, and loading parameters enter through lightweight adapters. Using established numerical and analytic solvers for supervision, we apply the same architecture and training protocol to heterogeneous elliptic equations, forced heat and Burgers evolution, complex Ginzburg-Landau dynamics, two-dimensional Navier-Stokes prediction, potential flow, elasticity, eikonal travel time, phase-field fracture, and entropic optimal transport. The results show that a pretrained image model can represent diverse static and time-dependent physical mappings, including unstable and shock-like behavior, when each task is expressed through a suitable visual encoding. This work is a capability study rather than an attempt to surpass specialized solvers. It also identifies fundamental constraints: image and latent representations complicate numerical range selection and direct enforcement of governing equations or invariants, while a failed Kuramoto-Sivashinsky experiment indicates that representation errors prevent meaningful long-horizon simulation of chaotic systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 60 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
30 of 60 references.
References · 30
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
18 more
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023Consistency Modelscited by 1,822
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2017PDE-Net: Learning PDEs from Datacited by 311
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 152
- 2024DiffusionPDE: Generative PDE-Solving Under Partial Observationcited by 108
- 2025VideoPDE: Unified Generative PDE Solving via Video Inpainting Diffusion Modelscited by 8
- 2026Pretrained Video Models as Differentiable Physics Simulators for Urban Wind Flowscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Image-Space Rule Discoverycited by 1
- 2026Image-Space Rule Discovery1 Aug 2026