# Spatio-Temporal Turbulence Mitigation: A Translational Perspective

arXiv: https://arxiv.org/abs/2401.04244 · HTML: https://mlsanity.com/paper/2401.04244/

## Key facts

- Cited by 22 papers in the map (data through 14 Oct 2026).
- Builds on 33 of its 91 references that are in the map.
- First posted on arXiv 8 Jan 2024.

## Builds on (most cited first, 30 of 33)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [SGDR: Stochastic Gradient Descent with Warm Restarts](https://mlsanity.com/paper/1608.03983/) (2016)
- [CBAM: Convolutional Block Attention Module](https://mlsanity.com/paper/1807.06521/) (2018)
- [Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling](https://mlsanity.com/paper/1412.3555/) (2014)
- [Residual Dense Network for Image Super-Resolution](https://mlsanity.com/paper/1802.08797/) (2018)
- [An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition](https://mlsanity.com/paper/1507.05717/) (2015)
- [Optical Flow Estimation using a Spatial Pyramid Network](https://mlsanity.com/paper/1611.00850/) (2016)
- [AdaFace: Quality Adaptive Margin for Face Recognition](https://mlsanity.com/paper/2204.00964/) (2022)
- [VRT: A Video Restoration Transformer](https://mlsanity.com/paper/2201.12288/) (2022)
- [Recurrent Video Restoration Transformer with Guided Deformable Attention](https://mlsanity.com/paper/2206.02146/) (2022)
- [Delving Deeper into Convolutional Networks for Learning Video Representations](https://mlsanity.com/paper/1511.06432/) (2015)
- [Investigating Tradeoffs in Real-World Video Super-Resolution](https://mlsanity.com/paper/2111.12704/) (2021)
- [Decoupled Attention Network for Text Recognition](https://mlsanity.com/paper/1912.10205/) (2019)
- [Expanding Accurate Person Recognition to New Altitudes and Ranges: The BRIAR Dataset](https://mlsanity.com/paper/2211.01917/) (2022)
- [Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space Transform](https://mlsanity.com/paper/2107.11627/) (2021)
- [Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Model](https://mlsanity.com/paper/2207.10040/) (2022)
- [AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2208.11284/) (2022)
- [Imaging through the Atmosphere using Turbulence Mitigation Transformer](https://mlsanity.com/paper/2207.06465/) (2022)
- [Image Reconstruction of Static and Dynamic Scenes through Anisoplanatic Turbulence](https://mlsanity.com/paper/2009.00071/) (2020)
- [Simulating Anisoplanatic Turbulence by Sampling Inter-modal and Spatially Correlated Zernike Coefficients](https://mlsanity.com/paper/2004.11210/) (2020)
- [Real-world Video Deblurring: A Benchmark Dataset and An Efficient Recurrent Neural Network](https://mlsanity.com/paper/2106.16028/) (2021)
- [Deep Recurrent Neural Network with Multi-scale Bi-directional Propagation for Video Deblurring](https://mlsanity.com/paper/2112.05150/) (2021)
- [Physics-Driven Turbulence Image Restoration with Stochastic Refinement](https://mlsanity.com/paper/2307.10603/) (2023)
- [Subsampled Turbulence Removal Network](https://mlsanity.com/paper/1807.04418/) (2018)
- [LTT-GAN: Looking Through Turbulence by Inverting GANs](https://mlsanity.com/paper/2112.02379/) (2021)
- [Atmospheric Turbulence Removal with Complex-Valued Convolutional Neural Network](https://mlsanity.com/paper/2204.06989/) (2022)
- [Restoration of Atmospheric Turbulence-distorted Images via RPCA and Quasiconformal Maps](https://mlsanity.com/paper/1704.03140/) (2017)
- [Atmospheric turbulence mitigation for sequences with moving objects using recursive image fusion](https://mlsanity.com/paper/1808.03550/) (2018)
- [Tilt-then-Blur or Blur-then-Tilt? Clarifying the Atmospheric Turbulence Model](https://mlsanity.com/paper/2207.06377/) (2022)
- [Real-Time Dense Field Phase-to-Space Simulation of Imaging through Atmospheric Turbulence](https://mlsanity.com/paper/2210.06713/) (2022)

## Built on by (most cited first, 22 of 22)

- [Person Recognition at Altitude and Range: Fusion of Face, Body Shape and Gait](https://mlsanity.com/paper/2505.04616/) (2025)
- [Deep Learning Techniques for Atmospheric Turbulence Removal: A Review](https://mlsanity.com/paper/2409.14587/) (2024)
- [Learning Phase Distortion with Selective State Space Models for Video Turbulence Mitigation](https://mlsanity.com/paper/2504.02697/) (2025)
- [Long-range Turbulence Mitigation: A Large-scale Dataset and A Coarse-to-fine Framework](https://mlsanity.com/paper/2407.08377/) (2024)
- [DeTurb: Atmospheric Turbulence Mitigation with Deformable 3D Convolutions and 3D Swin Transformers](https://mlsanity.com/paper/2407.20855/) (2024)
- [MAMAT: 3D Mamba-Based Atmospheric Turbulence Removal and its Object Detection Capability](https://mlsanity.com/paper/2503.17700/) (2025)
- [EvTurb: Event Camera Guided Turbulence Removal](https://mlsanity.com/paper/2508.10582/) (2025)
- [EGTM: Event-guided Efficient Turbulence Mitigation](https://mlsanity.com/paper/2509.03808/) (2025)
- [DMAT: An End-to-End Framework for Joint Atmospheric Turbulence Mitigation and Object Detection](https://mlsanity.com/paper/2507.04323/) (2025)
- [Reconstructing Satellites in 3D from Amateur Telescope Images](https://mlsanity.com/paper/2404.18394/) (2024)
- [Astrophotography turbulence mitigation via generative models](https://mlsanity.com/paper/2506.02981/) (2025)
- [JDATT: A Joint Distillation Framework for Atmospheric Turbulence Mitigation and Target Detection](https://mlsanity.com/paper/2507.19780/) (2025)
- [RMFAT: Recurrent Multi-scale Feature Atmospheric Turbulence Mitigator](https://mlsanity.com/paper/2508.11409/) (2025)
- [HATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-Resolution](https://mlsanity.com/paper/2601.04682/) (2026)
- [Continuous Exposure-Time Modeling for Realistic Atmospheric Turbulence Synthesis](https://mlsanity.com/paper/2603.01398/) (2026)
- [GSTurb: Gaussian Splatting for Atmospheric Turbulence Mitigation](https://mlsanity.com/paper/2602.22800/) (2026)
- [High-speed Imaging through Turbulence with Event-based Light Fields](https://mlsanity.com/paper/2603.14023/) (2026)
- [High-Quality and Efficient Turbulence Mitigation with Events](https://mlsanity.com/paper/2603.20708/) (2026)
- [A unified Benchmark for Multi-Frame Image Restoration under Severe Refractive Warping](https://mlsanity.com/paper/2605.05079/) (2026)
- [ReMATF: Recurrent Motion-Adaptive Multi-scale Turbulence Mitigation for Dynamic Scenes](https://mlsanity.com/paper/2605.21440/) (2026)
- [D2Turb: Depth-Aware Simulation and Decoupled Learning for Single-Frame Atmospheric Turbulence Mitigation](https://mlsanity.com/paper/2605.27460/) (2026)
- [Restore What Matters: Lessons from Joint Restoration and Recognition](https://mlsanity.com/paper/2609.13791/) (2026)

## Abstract (arXiv)

Recovering images distorted by atmospheric turbulence is a challenging inverse problem due to the stochastic nature of turbulence. Although numerous turbulence mitigation (TM) algorithms have been proposed, their efficiency and generalization to real-world dynamic scenarios remain severely limited. Building upon the intuitions of classical TM algorithms, we present the Deep Atmospheric TUrbulence Mitigation network (DATUM). DATUM aims to overcome major challenges when transitioning from classical to deep learning approaches. By carefully integrating the merits of classical multi-frame TM methods into a deep network structure, we demonstrate that DATUM can efficiently perform long-range temporal aggregation using a recurrent fashion, while deformable attention and temporal-channel attention seamlessly facilitate pixel registration and lucky imaging. With additional supervision, tilt and blur degradation can be jointly mitigated. These inductive biases empower DATUM to significantly outperform existing methods while delivering a tenfold increase in processing speed. A large-scale training dataset, ATSyn, is presented as a co-invention to enable generalization in real turbulence. Our code and datasets are available at https://xg416.github.io/DATUM.