mlsanityData to 7 Oct 2026

High-Quality and Efficient Turbulence Mitigation with Events

arXiv 2603.20708 ↗First posted 21 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Turbulence mitigation (TM) is highly ill-posed due to the stochastic nature of atmospheric turbulence. Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios. However, they inevitably suffer from a trade-off between accuracy and efficiency: more frames enhance restoration at the cost of higher system latency and larger data overhead. Event cameras, equipped with microsecond temporal resolution and efficient sensing of dynamic changes, offer an opportunity to break the bottleneck. In this work, we present EHETM, a high-quality and efficient TM method inspired by the superiority of events to model motions in continuous sequences. We discover two key phenomena: (1) turbulence-induced events exhibit distinct polarity alternation correlated with sharp image gradients, providing structural cues for restoring scenes; and (2) dynamic objects form spatiotemporally coherent ``event tubes'' in contrast to irregular patterns within turbulent events, providing motion priors for disentangling objects from turbulence. Based on these insights, we design two complementary modules that respectively leverage polarity-weighted gradients for scene refinement and event-tube constraints for motion decoupling, achieving high-quality restoration with few frames. Furthermore, we construct two real-world event-frame turbulence datasets covering atmospheric and thermal cases. Experiments show that EHETM outperforms SOTA methods, especially under scenes with dynamic objects, while reducing data overhead and system latency by approximately 77.3% and 89.5%, respectively. Our code is available at: https://github.com/Xavier667/EHETM.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 85 references that are in the map. First posted on arXiv 21 Mar 2026.

Builds on

47 of 85 references.

References · 47

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  6. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  7. 2019Event-based Vision: A Surveycited by 1,010
  8. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  9. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
  10. 2022VRT: A Video Restoration Transformercited by 219
  11. 2018Bringing a Blurry Frame Alive at High Frame-Rate with an Event Cameracited by 141
  12. 2020Back to Event Basics: Self-Supervised Learning of Image Reconstruction for Event Cameras via Photometric Constancycited by 125
35 more
  1. 2015UA-DETRAC: A New Benchmark and Protocol for Multi-Object Detection and Trackingcited by 98
  2. 2022Expanding Accurate Person Recognition to New Altitudes and Ranges: The BRIAR Datasetcited by 61
  3. 2024RainMamba: Enhanced Locality Learning with State Space Models for Video Derainingcited by 56
  4. 2022Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Modelcited by 37
  5. 2022AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Modelscited by 33
  6. 2023Learning Spatial-Temporal Implicit Neural Representations for Event-Guided Video Super-Resolutioncited by 33
  7. 2024Seeing Motion at Nighttime with an Event Cameracited by 33
  8. 2022Imaging through the Atmosphere using Turbulence Mitigation Transformercited by 31
  9. 2020Image Reconstruction of Static and Dynamic Scenes through Anisoplanatic Turbulencecited by 30
  10. 2023Physics-Driven Turbulence Image Restoration with Stochastic Refinementcited by 24
  11. 2022Learning to restore images degraded by atmospheric turbulence using uncertaintycited by 23
  12. 2018Subsampled Turbulence Removal Networkcited by 22
  13. 2024Spatio-Temporal Turbulence Mitigation: A Translational Perspectivecited by 22
  14. 2021LTT-GAN: Looking Through Turbulence by Inverting GANscited by 21
  15. 2022Atmospheric Turbulence Removal with Complex-Valued Convolutional Neural Networkcited by 21
  16. 2023Generalizing Event-Based Motion Deblurring in Real-World Scenarioscited by 20
  17. 2022Tilt-then-Blur or Blur-then-Tilt? Clarifying the Atmospheric Turbulence Modelcited by 17
  18. 2019Bridging the Gap Between Computational Photography and Visual Recognitioncited by 15
  19. 2024Bring Event into RGB and LiDAR: Hierarchical Visual-Motion Fusion for Scene Flowcited by 15
  20. 2024LED: A Large-scale Real-world Paired Dataset for Event Camera Denoisingcited by 12
  21. 2022TurbuGAN: An Adversarial Learning Approach to Spatially-Varying Multiframe Blind Deconvolution with Applications to Imaging Through Turbulencecited by 11
  22. 2024Deep Learning Techniques for Atmospheric Turbulence Removal: A Reviewcited by 10
  23. 2024CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurringcited by 9
  24. 2025Learning Phase Distortion with Selective State Space Models for Video Turbulence Mitigationcited by 9
  25. 2025TimeTracker: Event-based Continuous Point Tracking for Video Frame Interpolation with Non-linear Motioncited by 9
  26. 2024Long-range Turbulence Mitigation: A Large-scale Dataset and A Coarse-to-fine Frameworkcited by 8
  27. 2024Turb-Seg-Res: A Segment-then-Restore Pipeline for Dynamic Videos with Atmospheric Turbulencecited by 7
  28. 2024DeTurb: Atmospheric Turbulence Mitigation with Deformable 3D Convolutions and 3D Swin Transformerscited by 6
  29. 2025Event-Enhanced Blurry Video Super-Resolutioncited by 6
  30. 2024Real-World Atmospheric Turbulence Correction via Domain Adaptationcited by 4
  31. 2024Open Turbulent Image Set (OTIS)cited by 3
  32. 2025EvTurb: Event Camera Guided Turbulence Removalcited by 3
  33. 2025EGTM: Event-guided Efficient Turbulence Mitigationcited by 3
  34. 2024Source-free Domain Adaptation for Video Object Detection Under Adverse Image Conditionscited by 2
  35. 2024Physical prior guided cooperative learning framework for joint turbulence degradation estimation and infrared video restorationcited by 1

Built on by

Not cited yet.