Physics-informed Deep Super-resolution for Spatiotemporal Data
Not on the map. Why?
Abstract (arXiv)
High-fidelity simulation of complex physical systems is exorbitantly expensive and inaccessible across spatiotemporal scales. Recently, there has been an increasing interest in leveraging deep learning to augment scientific data based on the coarse-grained simulations, which is of cheap computational expense and retains satisfactory solution accuracy. However, the major existing work focuses on data-driven approaches which rely on rich training datasets and lack sufficient physical constraints. To this end, we propose a novel and efficient spatiotemporal super-resolution framework via physics-informed learning, inspired by the independence between temporal and spatial derivatives in partial differential equations (PDEs). The general principle is to leverage the temporal interpolation for flow estimation, and then introduce convolutional-recurrent neural networks for learning temporal refinement. Furthermore, we employ the stacked residual blocks with wide activation and sub-pixel layers with pixelshuffle for spatial reconstruction, where feature extraction is conducted in a low-resolution latent space. Moreover, we consider hard imposition of boundary conditions in the network to improve reconstruction accuracy. Results demonstrate the superior effectiveness and efficiency of the proposed method compared with baseline algorithms through extensive numerical experiments.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 53 of its 69 references that are in the map. First posted on arXiv 2 Aug 2022.
Builds on
53 of 69 references.
References · 53
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
38 more
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2020Pre-Trained Image Processing Transformercited by 891
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2013Generating Sequences With Recurrent Neural Networkscited by 549
- 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
- 2021Machine learning accelerated computational fluid dynamicscited by 461
- 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
- 2017PDE-Net: Learning PDEs from Datacited by 304
- 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
- 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
- 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
- 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
- 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
- 2020Physics-informed learning of governing equations from scarce datacited by 167
- 2018Frame-Recurrent Video Super-Resolutioncited by 160
- 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
- 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
- 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
- 2019Quadratic video interpolationcited by 143
- 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
- 2020Transformers for Modeling Physical Systemscited by 105
- 2021Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problemscited by 100
- 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
- 2020Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolutioncited by 91
- 2020Physics informed deep learning for computational elastodynamics without labeled datacited by 79
- 2020MeshfreeFlowNet: A Physics-Constrained Deep Continuous Space-Time Super-Resolution Frameworkcited by 78
- 2018Wide Activation for Efficient and Accurate Image Super-Resolutioncited by 64
- 2018PhaseNet for Video Frame Interpolationcited by 61
- 2020Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structurescited by 52
- 2020Enhanced Quadratic Video Interpolationcited by 48
- 2019Physics-guided Convolutional Neural Network (PhyCNN) for Data-driven Seismic Response Modelingcited by 40
- 2022Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learningcited by 24
- 2018HybridNet: Integrating Model-based and Data-driven Learning to Predict Evolution of Dynamical Systemscited by 21
- 2020Turbulence Enrichment using Physics-informed Generative Adversarial Networkscited by 18
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 1.
9 papers.
- 2023Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flowscited by 30
- 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
- 2023SuperBench: A Super-Resolution Benchmark Dataset for Scientific Machine Learningcited by 18
- 2022SeismicNet: Physics-informed neural networks for seismic wave modeling in semi-infinite domaincited by 16
- 2023NeuralStagger: Accelerating Physics-constrained Neural PDE Solver with Spatial-temporal Decompositioncited by 11
- 2022Spatio-Temporal Super-Resolution of Dynamical Systems using Physics-Informed Deep-Learningcited by 3
- 2023Physics-informed neural network for seismic wave inversion in layered semi-infinite domaincited by 2
- 2024Mitigating distribution shift in machine learning-augmented hybrid simulationcited by 2
- 2023An Operator Learning Framework for Spatiotemporal Super-resolution of Scientific Simulationscited by 0
- 2024Mitigating distribution shift in machine learning-augmented hybrid simulation17 Jan 2024
- 2023An Operator Learning Framework for Spatiotemporal Super-resolution of Scientific Simulations4 Nov 2023
- 2023SuperBench: A Super-Resolution Benchmark Dataset for Scientific Machine Learning24 Jun 2023
- 2023Physics-Informed Computer Vision: A Review and Perspectives29 May 2023
- 2023Physics-informed neural network for seismic wave inversion in layered semi-infinite domain9 May 2023
- 2023NeuralStagger: Accelerating Physics-constrained Neural PDE Solver with Spatial-temporal Decomposition20 Feb 2023
- 2023Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flows26 Jan 2023
- 2022Spatio-Temporal Super-Resolution of Dynamical Systems using Physics-Informed Deep-Learning8 Dec 2022
- 2022SeismicNet: Physics-informed neural networks for seismic wave modeling in semi-infinite domain25 Oct 2022