# DiffUNet^2: Bidirectional Conditional Diffusion for Probabilistic Scientific Spatiotemporal Modeling

arXiv: https://arxiv.org/abs/2606.03926 · HTML: https://mlsanity.com/paper/2606.03926/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 25 of its 35 references that are in the map.
- First posted on arXiv 2 Jun 2026.

## Builds on (most cited first, 25 of 25)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [Score-Based Generative Modeling through Stochastic Differential Equations](https://mlsanity.com/paper/2011.13456/) (2020)
- [Flow Matching for Generative Modeling](https://mlsanity.com/paper/2210.02747/) (2022)
- [Generative Adversarial Networks](https://mlsanity.com/paper/2203.00667/) (2022)
- [Improved Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2102.09672/) (2021)
- [Fourier Neural Operator for Parametric Partial Differential Equations](https://mlsanity.com/paper/2010.08895/) (2020)
- [An Introduction to Variational Autoencoders](https://mlsanity.com/paper/1906.02691/) (2019)
- [PDEBENCH: An Extensive Benchmark for Scientific Machine Learning](https://mlsanity.com/paper/2210.07182/) (2022)
- [PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers](https://mlsanity.com/paper/2308.05732/) (2023)
- [DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training](https://mlsanity.com/paper/2403.03542/) (2024)
- [DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting](https://mlsanity.com/paper/2306.01984/) (2023)
- [Neural Inverse Operators for Solving PDE Inverse Problems](https://mlsanity.com/paper/2301.11167/) (2023)
- [APEBench: A Benchmark for Autoregressive Neural Emulators of PDEs](https://mlsanity.com/paper/2411.00180/) (2024)
- [CFDBench: A Large-Scale Benchmark for Machine Learning Methods in Fluid Dynamics](https://mlsanity.com/paper/2310.05963/) (2023)
- [Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolation](https://mlsanity.com/paper/2404.12355/) (2024)
- [PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations](https://mlsanity.com/paper/2505.24717/) (2025)
- [Continuous Ensemble Weather Forecasting with Diffusion models](https://mlsanity.com/paper/2410.05431/) (2024)
- [Predicting Solar Flares Using a Long Short-Term Memory Network](https://mlsanity.com/paper/1905.07095/) (2019)
- [Invertible Fourier Neural Operators for Tackling Both Forward and Inverse Problems](https://mlsanity.com/paper/2402.11722/) (2024)
- [Improved Surrogates in Inertial Confinement Fusion with Manifold and Cycle Consistencies](https://mlsanity.com/paper/1912.08113/) (2019)
- [Zero-Shot Uncertainty Quantification using Diffusion Probabilistic Models](https://mlsanity.com/paper/2408.04718/) (2024)
- [A Probabilistic Approach to Wildfire Spread Prediction Using a Denoising Diffusion Surrogate Model](https://mlsanity.com/paper/2507.00761/) (2025)
- [Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Exploration](https://mlsanity.com/paper/2504.00904/) (2025)
- [Diffusion models as probabilistic neural operators for recovering unobserved states of dynamical systems](https://mlsanity.com/paper/2405.07097/) (2024)
- [Disentangling the Timescales of a Complex System: A Bayesian Approach to Temporal Network Analysis](https://mlsanity.com/paper/2403.05343/) (2024)

## Abstract (arXiv)

Studying the spatiotemporal evolution of scientific phenomena often relies on costly simulations and experiments. Machine learning-based surrogate models reduce this cost, but most are limited to deterministic forward prediction. Scientific temporal analysis often requires both forward prediction and backward inference, while temporal evolution is not always uniquely determined, especially for the inverse problem. We introduce DiffUNet^2, a bidirectional conditional diffusion model for probabilistic scientific temporal prediction. It supports both forward and backward prediction within a shared model. We evaluate DiffUNet^2 on four scientific temporal datasets spanning fluid dynamics, chemical reaction dynamics, and material deformation, against deterministic and probabilistic baselines. Results show that DiffUNet^2 achieves strong predictive performance in both temporal directions and high probabilistic ensemble quality compared with existing baselines. To support practical scientific exploration beyond prediction, we further extend DiffUNet^2's generation ability with target-guided state editing, allowing states of interest to be specified and explored in both temporal directions.
