mlsanityData to 14 Oct 2026

Probabilistic Prior Driven Attention Mechanism Based on Diffusion Model for Imaging Through Atmospheric Turbulence

arXiv 2411.10321 ↗First posted 15 Nov 2024cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Atmospheric turbulence introduces severe spatial and geometric distortions, challenging traditional image restoration methods. We propose the Probabilistic Prior Turbulence Removal Network (PPTRN), which combines probabilistic diffusion-based prior modeling with Transformer-driven feature extraction to address this issue. PPTRN employs a two-stage approach: first, a latent encoder and Transformer are jointly trained on clear images to establish robust feature representations. Then, a Denoising Diffusion Probabilistic Model (DDPM) models prior distributions over latent vectors, guiding the Transformer in capturing diverse feature variations essential for restoration. A key innovation in PPTRN is the Probabilistic Prior Driven Cross Attention mechanism, which integrates the DDPM-generated prior with feature embeddings to reduce artifacts and enhance spatial coherence. Extensive experiments validate that PPTRN significantly improves restoration quality on turbulence-degraded images, setting a new benchmark in clarity and structural fidelity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 24 of its 46 references that are in the map. First posted on arXiv 15 Nov 2024.

Builds on

24 of 46 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey18 Aug
  2. 2023DiffIR: Efficient Diffusion Model for Image Restoration16 Mar
  3. 2022Denoising Diffusion Restoration Models27 Jan
  4. 2021Deblurring via Stochastic Refinement5 Dec

Other references · 20

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  5. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  6. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  7. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  8. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  9. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  10. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  11. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  12. 2021Multi-Stage Progressive Image Restorationcited by 816
8 more
  1. 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 140
  2. 2019Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Trainingcited by 112
  3. 2021Accelerating Atmospheric Turbulence Simulation via Learned Phase-to-Space Transformcited by 50
  4. 2022Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Modelcited by 37
  5. 2020Image Reconstruction of Static and Dynamic Scenes through Anisoplanatic Turbulencecited by 30
  6. 2023Physics-Driven Turbulence Image Restoration with Stochastic Refinementcited by 24
  7. 2022Learning to restore images degraded by atmospheric turbulence using uncertaintycited by 23
  8. 2022Atmospheric Turbulence Removal with Complex-Valued Convolutional Neural Networkcited by 21

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models
  2. 2023Atmospheric Turbulence Correction via Variational Deep Diffusion
  3. 2023A Unified Conditional Framework for Diffusion-based Image Restoration
  4. 2024A Modular Conditional Diffusion Framework for Image Reconstruction
  5. 2023Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Models
  6. 2022Multiscale Structure Guided Diffusion for Image Deblurring
  7. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
  8. 2024Single-image reflection removal via self-supervised diffusion models