Beware of Aliases -- Signal Preservation is Crucial for Robust Image Restoration
Not on the map. Why?
Abstract (arXiv)
Image restoration networks are usually comprised of an encoder and a decoder, responsible for aggregating image content from noisy, distorted data and to restore clean, undistorted images, respectively. Data aggregation as well as high-resolution image generation both usually come at the risk of involving aliases, i.e.~standard architectures put their ability to reconstruct the model input in jeopardy to reach high PSNR values on validation data. The price to be paid is low model robustness. In this work, we show that simply providing alias-free paths in state-of-the-art reconstruction transformers supports improved model robustness at low costs on the restoration performance. We do so by proposing BOA-Restormer, a transformer-based image restoration model that executes downsampling and upsampling operations partly in the frequency domain to ensure alias-free paths along the entire model while potentially preserving all relevant high-frequency information.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 39 of its 64 references that are in the map. First posted on arXiv 11 Jun 2024.
Builds on
39 of 64 references.
References · 39
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2022Generative Adversarial Networkscited by 5,627
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
27 more
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2016Adversarial Machine Learning at Scalecited by 936
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2022Simple Baselines for Image Restorationcited by 708
- 2018Pyramid Stereo Matching Networkcited by 489
- 2019Making Convolutional Networks Shift-Invariant Againcited by 391
- 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
- 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2021Global Filter Networks for Image Classificationcited by 260
- 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
- 2021Intriguing Findings of Frequency Selection for Image Deblurringcited by 81
- 2022SegPGD: An Effective and Efficient Adversarial Attack for Evaluating and Boosting Segmentation Robustnesscited by 74
- 2020Delving Deeper into Anti-aliasing in ConvNetscited by 60
- 2020Spectral Distribution Aware Image Generationcited by 29
- 2021WaveCNet: Wavelet Integrated CNNs to Suppress Aliasing Effect for Noise-Robust Image Classificationcited by 29
- 2022FrequencyLowCut Pooling -- Plug & Play against Catastrophic Overfittingcited by 28
- 2023CosPGD: an efficient white-box adversarial attack for pixel-wise prediction taskscited by 27
- 2022A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flowcited by 16
- 2021Towards Understanding Adversarial Robustness of Optical Flow Networkscited by 15
- 2021Anti-aliasing Deep Image Classifiers using Novel Depth Adaptive Blurring and Activation Functioncited by 11
- 2023On the unreasonable vulnerability of transformers for image restoration -- and an easy fixcited by 11
- 2022Attacking Motion Estimation with Adversarial Snowcited by 9
- 2023As large as it gets: Learning infinitely large Filters via Neural Implicit Functions in the Fourier Domaincited by 8
- 2023Differentiable Sensor Layouts for End-to-End Learning of Task-Specific Camera Parameterscited by 6
- 2022Periodic Artifact Reduction in Fourier transforms of Full Field Atomic Resolution Imagescited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 1.
6 papers.
- 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereocited by 7
- 2025Are Synthetic Corruptions A Reliable Proxy For Real-World Corruptions?cited by 5
- 2024How Do Training Methods Influence the Utilization of Vision Models?cited by 3
- 2025Smart Eyes for Silent Threats: VLMs and In-Context Learning for THz Imagingcited by 2
- 2025DispBench: Benchmarking Disparity Estimation to Synthetic Corruptionscited by 0
- 2026Failure or Drift? Evaluating Monocular SLAM under Synthetic and Real-World Corruptionscited by 0
- 2026Failure or Drift? Evaluating Monocular SLAM under Synthetic and Real-World Corruptions31 Aug 2026
- 2025Smart Eyes for Silent Threats: VLMs and In-Context Learning for THz Imaging21 Jul 2025
- 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereo14 May 2025
- 2025DispBench: Benchmarking Disparity Estimation to Synthetic Corruptions8 May 2025
- 2025Are Synthetic Corruptions A Reliable Proxy For Real-World Corruptions?7 May 2025
- 2024How Do Training Methods Influence the Utilization of Vision Models?18 Oct 2024