StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Not on the map. Why?
Abstract (arXiv)
Image inpainting techniques have shown significant improvements by using deep neural networks recently. However, most of them may either fail to reconstruct reasonable structures or restore fine-grained textures. In order to solve this problem, in this paper, we propose a two-stage model which splits the inpainting task into two parts: structure reconstruction and texture generation. In the first stage, edge-preserved smooth images are employed to train a structure reconstructor which completes the missing structures of the inputs. In the second stage, based on the reconstructed structures, a texture generator using appearance flow is designed to yield image details. Experiments on multiple publicly available datasets show the superior performance of the proposed network.
Key facts. Cited by 118 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 40; 2022: 29; 2023: 26; 2024: 12; 2025: 11.
118 papers.
Sort:
By area:
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2021Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAEcited by 106
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
- 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
38 more
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2022CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Trainingcited by 49
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2021WaveFill: A Wavelet-based Generation Network for Image Inpaintingcited by 44
- 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
- 2021Recurrent Video Deblurring with Blur-Invariant Motion Estimation and Pixel Volumescited by 41
- 2021Image Inpainting by End-to-End Cascaded Refinement with Mask Awarenesscited by 35
- 2022MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpaintingcited by 35
- 2021ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priorscited by 34
- 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 32
- 2021Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenescited by 25
- 2023Learning Generative Structure Prior for Blind Text Image Super-resolutioncited by 24
- 2021Image Inpainting with External-internal Learning and Monochromic Bottleneckcited by 21
- 2022ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priorscited by 21
- 2023Improving Cross-modal Alignment for Text-Guided Image Inpaintingcited by 21
- 2021Internal Video Inpainting by Implicit Long-range Propagationcited by 19
- 2022Don't Forget Me: Accurate Background Recovery for Text Removal via Modeling Local-Global Contextcited by 18
- 2021JPGNet: Joint Predictive Filtering and Generative Network for Image Inpaintingcited by 17
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypointscited by 17
- 2024Magic Insert: Style-Aware Drag-and-Dropcited by 17
- 2021Layout-Guided Novel View Synthesis from a Single Indoor Panoramacited by 16
- 2023ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectoriescited by 14
- 2022Delving Globally into Texture and Structure for Image Inpaintingcited by 13
- 2023Learning Image-Adaptive Codebooks for Class-Agnostic Image Restorationcited by 13
- 2025Precise Object and Effect Removal with Adaptive Target-Aware Attentioncited by 13
- 2021Bridging the Visual Gap: Wide-Range Image Blendingcited by 12
- 2023RGI: robust GAN-inversion for mask-free image inpainting and unsupervised pixel-wise anomaly detectioncited by 12
- 2021Structure-aware Person Image Generation with Pose Decomposition and Semantic Correlationcited by 11
- 2021FT-TDR: Frequency-guided Transformer and Top-Down Refinement Network for Blind Face Inpaintingcited by 11
- 2022Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule Augmentation and Detectioncited by 11
- 2023Reference-Guided Large-Scale Face Inpainting with Identity and Texture Controlcited by 10
- 2023Delving into Crispness: Guided Label Refinement for Crisp Edge Detectioncited by 10
- 2024HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attentioncited by 10
- 2021Context-Aware Image Inpainting with Learned Semantic Priorscited by 9
- 2022GeoFill: Reference-Based Image Inpainting with Better Geometric Understandingcited by 9
- 2022Image Inpainting via Iteratively Decoupled Probabilistic Modelingcited by 9
- 2023Clutter Detection and Removal in 3D Scenes with View-Consistent Inpaintingcited by 9
- 2025Hadamard product in deep learning: Introduction, Advances and Challengescited by 9
50 most cited of 118 All 118 (JSON)
- 2025PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement2 Dec 2025
- 2025CSF-Net: Context-Semantic Fusion Network for Large Mask Inpainting11 Nov 2025
- 2025Enhanced Generative Structure Prior for Chinese Text Image Super-resolution11 Aug 2025
- 2025ControlMambaIR: Conditional Controls with State-Space Model for Image Restoration3 Jun 2025
- 2025Precise Object and Effect Removal with Adaptive Target-Aware Attention28 May 2025
- 2025Shape-Guided Clothing Warping for Virtual Try-On21 Apr 2025
- 2025Towards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Design18 Apr 2025
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2025Limb-Aware Virtual Try-On Network with Progressive Clothing Warping18 Mar 2025
- 2025Progressive Limb-Aware Virtual Try-On16 Mar 2025
- 2025HOMER: Homography-Based Efficient Multi-view 3D Object Removal29 Jan 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
38 more
- 2024MGAN-CRCM: A Novel Multiple Generative Adversarial Network and Coarse-Refinement Based Cognizant Method for Image Inpainting25 Dec 2024
- 2024Combining Generative and Geometry Priors for Wide-Angle Portrait Correction13 Oct 2024
- 2024Deep Generative Adversarial Network for Occlusion Removal from a Single Image20 Sep 2024
- 2024Look Through Masks: Towards Masked Face Recognition with De-Occlusion Distillation19 Sep 2024
- 2024CLII: Visual-Text Inpainting via Cross-Modal Predictive Interaction23 Jul 2024
- 2024Magic Insert: Style-Aware Drag-and-Drop2 Jul 2024
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion27 Mar 2024
- 2024Inpainting-Driven Mask Optimization for Object Removal23 Mar 2024
- 2024Generative AI in Vision: A Survey on Models, Metrics and Applications26 Feb 2024
- 2024HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attention22 Feb 2024
- 2024Deep Learning-based Image and Video Inpainting: A Survey7 Jan 2024
- 2023DI-Net : Decomposed Implicit Garment Transfer Network for Digital Clothed 3D Human28 Nov 2023
- 2023Seeing through the Mask: Multi-task Generative Mask Decoupling Face Recognition20 Nov 2023
- 2023SAIR: Learning Semantic-aware Implicit Representation13 Oct 2023
- 2023SuperInpaint: Learning Detail-Enhanced Attentional Implicit Representation for Super-resolutional Image Inpainting26 Jul 2023
- 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesis22 Jul 2023
- 2023Reference-based Painterly Inpainting via Diffusion: Crossing the Wild Reference Domain Gap20 Jul 2023
- 2023Delving into Crispness: Guided Label Refinement for Crisp Edge Detection27 Jun 2023
- 2023Deep image prior inpainting of ancient frescoes in the Mediterranean Alpine arc25 Jun 2023
- 2023TransRef: Multi-Scale Reference Embedding Transformer for Reference-Guided Image Inpainting20 Jun 2023
- 2023Learning Image-Adaptive Codebooks for Class-Agnostic Image Restoration10 Jun 2023
- 2023TextDiffuser: Diffusion Models as Text Painters18 May 2023
- 2023T-former: An Efficient Transformer for Image Inpainting12 May 2023
- 2023Multi-stage Progressive Reasoning for Dunhuang Murals Inpainting10 May 2023
- 2023GRIG: Few-Shot Generative Residual Image Inpainting24 Apr 2023
- 2023PATMAT: Person Aware Tuning of Mask-Aware Transformer for Face Inpainting12 Apr 2023
- 2023Clutter Detection and Removal in 3D Scenes with View-Consistent Inpainting7 Apr 2023
- 2023Synthesizing Anyone, Anywhere, in Any Pose6 Apr 2023
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generation5 Apr 2023
- 2023Learning Generative Structure Prior for Blind Text Image Super-resolution26 Mar 2023
- 2023Reference-Guided Large-Scale Face Inpainting with Identity and Texture Control13 Mar 2023
- 2023Self-Supervised CSF Inpainting with Synthetic Atrophy for Improved Accuracy Validation of Cortical Surface Analyses10 Mar 2023
- 2023RGI: robust GAN-inversion for mask-free image inpainting and unsupervised pixel-wise anomaly detection24 Feb 2023
- 2023ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectories5 Feb 2023
- 2023Improving Cross-modal Alignment for Text-Guided Image Inpainting26 Jan 2023
- 2023Layout-guided Indoor Panorama Inpainting with Plane-aware Normalization13 Jan 2023
- 2023Structure-Informed Shadow Removal Networks9 Jan 2023
- 2022Internal Diverse Image Completion18 Dec 2022
50 newest of 118 All 118 (JSON)
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2023ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectoriescited by 14
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generationcited by 4
- 2023PATMAT: Person Aware Tuning of Mask-Aware Transformer for Face Inpaintingcited by 4
- 2024Generative AI in Vision: A Survey on Models, Metrics and Applicationscited by 4
- 2025PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinementcited by 2
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completioncited by 1
- 2025ControlMambaIR: Conditional Controls with State-Space Model for Image Restorationcited by 0
- 2025PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement2 Dec 2025
- 2025ControlMambaIR: Conditional Controls with State-Space Model for Image Restoration3 Jun 2025
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion27 Mar 2024
- 2024Generative AI in Vision: A Survey on Models, Metrics and Applications26 Feb 2024
- 2023TextDiffuser: Diffusion Models as Text Painters18 May 2023
- 2023PATMAT: Person Aware Tuning of Mask-Aware Transformer for Face Inpainting12 Apr 2023
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generation5 Apr 2023
- 2023ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectories5 Feb 2023
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completion18 Nov 2022
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan 2022
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2021Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAEcited by 106
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
- 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2022CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Trainingcited by 49
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
12 most cited of 108 All 108 (JSON)
- 2025CSF-Net: Context-Semantic Fusion Network for Large Mask Inpainting11 Nov 2025
- 2025Enhanced Generative Structure Prior for Chinese Text Image Super-resolution11 Aug 2025
- 2025Precise Object and Effect Removal with Adaptive Target-Aware Attention28 May 2025
- 2025Shape-Guided Clothing Warping for Virtual Try-On21 Apr 2025
- 2025Towards Scale-Aware Low-Light Enhancement via Structure-Guided Transformer Design18 Apr 2025
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2025Limb-Aware Virtual Try-On Network with Progressive Clothing Warping18 Mar 2025
- 2025Progressive Limb-Aware Virtual Try-On16 Mar 2025
- 2025HOMER: Homography-Based Efficient Multi-view 3D Object Removal29 Jan 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
- 2024MGAN-CRCM: A Novel Multiple Generative Adversarial Network and Coarse-Refinement Based Cognizant Method for Image Inpainting25 Dec 2024
- 2024Combining Generative and Geometry Priors for Wide-Angle Portrait Correction13 Oct 2024
12 newest of 108 All 108 (JSON)