Frequency-Domain Fusion Transformer for Image Inpainting
Not on the map. Why?
Abstract (arXiv)
Image inpainting plays a vital role in restoring missing image regions and supporting high-level vision tasks, but traditional methods struggle with complex textures and large occlusions. Although Transformer-based approaches have demonstrated strong global modeling capabilities, they often fail to preserve high-frequency details due to the low-pass nature of self-attention and suffer from high computational costs. To address these challenges, this paper proposes a Transformer-based image inpainting method incorporating frequency-domain fusion. Specifically, an attention mechanism combining wavelet transform and Gabor filtering is introduced to enhance multi-scale structural modeling and detail preservation. Additionally, a learnable frequency-domain filter based on the fast Fourier transform is designed to replace the feedforward network, enabling adaptive noise suppression and detail retention. The model adopts a four-level encoder-decoder structure and is guided by a novel loss strategy to balance global semantics and fine details. Experimental results demonstrate that the proposed method effectively improves the quality of image inpainting by preserving more high-frequency information.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 45 references that are in the map. First posted on arXiv 23 Jun 2025.
Builds on
33 of 45 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
- 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
21 more
- 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 272
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 260
- 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 205
- 2023Image Restoration with Mean-Reverting Stochastic Differential Equationscited by 183
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2020Recurrent Feature Reasoning for Image Inpaintingcited by 107
- 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
- 2022SwinFIR: Revisiting the SwinIR with Fast Fourier Convolution and Improved Training for Image Super-Resolutioncited by 68
- 2019Image Inpainting with Learnable Bidirectional Attention Mapscited by 64
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2021Bridging Global Context Interactions for High-Fidelity Image Completioncited by 40
- 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpaintingcited by 40
- 2022Reduce Information Loss in Transformers for Pluralistic Image Inpaintingcited by 36
- 2022MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpaintingcited by 35
- 2021FT-TDR: Frequency-guided Transformer and Top-Down Refinement Network for Blind Face Inpaintingcited by 11
- 2024HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attentioncited by 11
- 2023TransRef: Multi-Scale Reference Embedding Transformer for Reference-Guided Image Inpaintingcited by 5
- 2024Multi-dimensional Visual Prompt Enhanced Image Restoration via Mamba-Transformer Aggregationcited by 2
- 2024Gabor-guided transformer for single image derainingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.