mlsanityData to 7 Oct 2026

Physics-informed Deep Super-resolution for Spatiotemporal Data

arXiv 2208.01462 ↗First posted 2 Aug 2022cs.LG physics.comp-ph physics.data-ancited by 9

Not on the map. Why?

Abstract (arXiv)

High-fidelity simulation of complex physical systems is exorbitantly expensive and inaccessible across spatiotemporal scales. Recently, there has been an increasing interest in leveraging deep learning to augment scientific data based on the coarse-grained simulations, which is of cheap computational expense and retains satisfactory solution accuracy. However, the major existing work focuses on data-driven approaches which rely on rich training datasets and lack sufficient physical constraints. To this end, we propose a novel and efficient spatiotemporal super-resolution framework via physics-informed learning, inspired by the independence between temporal and spatial derivatives in partial differential equations (PDEs). The general principle is to leverage the temporal interpolation for flow estimation, and then introduce convolutional-recurrent neural networks for learning temporal refinement. Furthermore, we employ the stacked residual blocks with wide activation and sub-pixel layers with pixelshuffle for spatial reconstruction, where feature extraction is conducted in a low-resolution latent space. Moreover, we consider hard imposition of boundary conditions in the network to improve reconstruction accuracy. Results demonstrate the superior effectiveness and efficiency of the proposed method compared with baseline algorithms through extensive numerical experiments.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 53 of its 69 references that are in the map. First posted on arXiv 2 Aug 2022.

Builds on

53 of 69 references.

References · 53

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  6. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  7. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  8. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  9. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  10. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  11. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  12. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
38 more
  1. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  2. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  3. 2020Pre-Trained Image Processing Transformercited by 891
  4. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  5. 2013Generating Sequences With Recurrent Neural Networkscited by 549
  6. 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
  7. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
  8. 2021Machine learning accelerated computational fluid dynamicscited by 461
  9. 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
  10. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  11. 2017PDE-Net: Learning PDEs from Datacited by 304
  12. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  13. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
  14. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  15. 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
  16. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
  17. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
  18. 2020Physics-informed learning of governing equations from scarce datacited by 167
  19. 2018Frame-Recurrent Video Super-Resolutioncited by 160
  20. 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
  21. 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
  22. 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
  23. 2019Quadratic video interpolationcited by 143
  24. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  25. 2020Transformers for Modeling Physical Systemscited by 105
  26. 2021Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problemscited by 100
  27. 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
  28. 2020Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolutioncited by 91
  29. 2020Physics informed deep learning for computational elastodynamics without labeled datacited by 79
  30. 2020MeshfreeFlowNet: A Physics-Constrained Deep Continuous Space-Time Super-Resolution Frameworkcited by 78
  31. 2018Wide Activation for Efficient and Accurate Image Super-Resolutioncited by 64
  32. 2018PhaseNet for Video Frame Interpolationcited by 61
  33. 2020Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structurescited by 52
  34. 2020Enhanced Quadratic Video Interpolationcited by 48
  35. 2019Physics-guided Convolutional Neural Network (PhyCNN) for Data-driven Seismic Response Modelingcited by 40
  36. 2022Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learningcited by 24
  37. 2018HybridNet: Integrating Model-based and Data-driven Learning to Predict Evolution of Dynamical Systemscited by 21
  38. 2020Turbulence Enrichment using Physics-informed Generative Adversarial Networkscited by 18

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 6; 2024: 1.

9 papers.