Painting Outside the Box: Image Outpainting with GANs
Not on the map. Why?
Abstract (arXiv)
The challenging task of image outpainting (extrapolation) has received comparatively little attention in relation to its cousin, image inpainting (completion). Accordingly, we present a deep learning approach based on Iizuka et al. for adversarially training a network to hallucinate past image boundaries. We use a three-phase training schedule to stably train a DCGAN architecture on a subset of the Places365 dataset. In line with Iizuka et al., we also use local discriminators to enhance the quality of our output. Once trained, our model is able to outpaint 128 × 128 color images relatively realistically, thus allowing for recursive outpainting. Our results show that deep learning approaches to image outpainting are both feasible and promising.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 9; 2023: 7; 2024: 2; 2025: 3; 2026: 2.
30 papers.
Sort:
By area:
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
- 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generationcited by 33
- 2022Guided Co-Modulated GAN for 360deg Field of View Extrapolationcited by 32
- 2025Neighboring Autoregressive Modeling for Efficient Visual Generationcited by 29
- 2023DiffInfinite: Large Mask-Image Synthesis via Parallel Random Patch Diffusion in Histopathologycited by 28
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoderscited by 25
- 2024Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approachcited by 18
- 2022Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolationcited by 16
- 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generationcited by 14
18 more
- 2022Cylin-Painting: Seamless 360textdegree Panoramic Image Outpainting and Beyondcited by 12
- 2022Outpainting by Queriescited by 12
- 2022Generalised Image Outpainting with U-Transformercited by 11
- 2022Scene Graph Expansion for Semantics-Guided Image Outpaintingcited by 11
- 2023Beyond Image Borders: Learning Feature Extrapolation for Unbounded Image Compositioncited by 9
- 2023RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learningcited by 8
- 2023Fast Full-frame Video Stabilization with Iterative Optimizationcited by 8
- 2024VIP: Versatile Image Outpainting Empowered by Multimodal Large Language Modelcited by 8
- 2023FishDreamer: Towards Fisheye Semantic Completion via Unified Image Outpainting and Segmentationcited by 6
- 2022Beyond the Field-of-View: Enhancing Scene Visibility and Perception with Clip-Recurrent Transformercited by 5
- 2021In-N-Out: Towards Good Initialization for Inpainting and Outpaintingcited by 4
- 2022FisheyeEX: Polar Outpainting for Extending the FoV of Fisheye Lenscited by 2
- 2025SSDD-GAN: Single-Step Denoising Diffusion GAN for Cochlear Implant Surgical Scene Completioncited by 2
- 2026M3DDM+: An improved video outpainting by a modified masking strategycited by 2
- 2021SilGAN: Generating driving maneuvers for scenario-based software-in-the-loop testingcited by 1
- 2021A self-adapting super-resolution structures framework for automatic design of GANcited by 0
- 2022Structure-guided Image Outpaintingcited by 0
- 2026High-Resolution Artwork Outpainting with Global Blueprint Guidance and Layout Controlcited by 0
- 2026High-Resolution Artwork Outpainting with Global Blueprint Guidance and Layout Control7 Jul 2026
- 2026M3DDM+: An improved video outpainting by a modified masking strategy16 Jan 2026
- 2025ComfyGPT: A Self-Optimizing Multi-Agent System for Comprehensive ComfyUI Workflow Generation22 Mar 2025
- 2025Neighboring Autoregressive Modeling for Efficient Visual Generation12 Mar 2025
- 2025SSDD-GAN: Single-Step Denoising Diffusion GAN for Cochlear Implant Surgical Scene Completion8 Feb 2025
- 2024VIP: Versatile Image Outpainting Empowered by Multimodal Large Language Model3 Jun 2024
- 2024Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approach28 Jan 2024
- 2023Beyond Image Borders: Learning Feature Extrapolation for Unbounded Image Composition21 Sep 2023
- 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generation7 Sep 2023
- 2023Fast Full-frame Video Stabilization with Iterative Optimization24 Jul 2023
- 2023DiffInfinite: Large Mask-Image Synthesis via Parallel Random Patch Diffusion in Histopathology23 Jun 2023
- 2023FishDreamer: Towards Fisheye Semantic Completion via Unified Image Outpainting and Segmentation24 Mar 2023
18 more
- 2023Street-View Image Generation from a Bird's-Eye View Layout11 Jan 2023
- 2023RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning4 Jan 2023
- 2022Structure-guided Image Outpainting21 Dec 2022
- 2022Beyond the Field-of-View: Enhancing Scene Visibility and Perception with Clip-Recurrent Transformer21 Nov 2022
- 2022Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolation14 Jul 2022
- 2022Outpainting by Queries12 Jul 2022
- 2022FisheyeEX: Polar Outpainting for Extending the FoV of Fisheye Lens12 Jun 2022
- 2022Scene Graph Expansion for Semantics-Guided Image Outpainting5 May 2022
- 2022Cylin-Painting: Seamless 360textdegree Panoramic Image Outpainting and Beyond18 Apr 2022
- 2022Guided Co-Modulated GAN for 360deg Field of View Extrapolation15 Apr 2022
- 2022Generalised Image Outpainting with U-Transformer27 Jan 2022
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learning12 Dec 2021
- 2021SilGAN: Generating driving maneuvers for scenario-based software-in-the-loop testing5 Jul 2021
- 2021In-N-Out: Towards Good Initialization for Inpainting and Outpainting26 Jun 2021
- 2021A self-adapting super-resolution structures framework for automatic design of GAN10 Jun 2021
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesis8 Apr 2021
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networks18 Mar 2021
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoders24 Feb 2021
- 2023DiffInfinite: Large Mask-Image Synthesis via Parallel Random Patch Diffusion in Histopathologycited by 28
- 2025SSDD-GAN: Single-Step Denoising Diffusion GAN for Cochlear Implant Surgical Scene Completioncited by 2
- 2026M3DDM+: An improved video outpainting by a modified masking strategycited by 2
- 2026High-Resolution Artwork Outpainting with Global Blueprint Guidance and Layout Controlcited by 0
- 2026High-Resolution Artwork Outpainting with Global Blueprint Guidance and Layout Control7 Jul 2026
- 2026M3DDM+: An improved video outpainting by a modified masking strategy16 Jan 2026
- 2025SSDD-GAN: Single-Step Denoising Diffusion GAN for Cochlear Implant Surgical Scene Completion8 Feb 2025
- 2023DiffInfinite: Large Mask-Image Synthesis via Parallel Random Patch Diffusion in Histopathology23 Jun 2023
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
- 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generationcited by 33
- 2022Guided Co-Modulated GAN for 360deg Field of View Extrapolationcited by 32
- 2025Neighboring Autoregressive Modeling for Efficient Visual Generationcited by 29
- 2021BIPS: Bi-modal Indoor Panorama Synthesis via Residual Depth-aided Adversarial Learningcited by 26
- 2021Conditional Image Generation by Conditioning Variational Auto-Encoderscited by 25
- 2024Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approachcited by 18
- 2022Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolationcited by 16
- 2022Cylin-Painting: Seamless 360textdegree Panoramic Image Outpainting and Beyondcited by 12
- 2022Outpainting by Queriescited by 12
12 most cited of 23 All 23 (JSON)
- 2025Neighboring Autoregressive Modeling for Efficient Visual Generation12 Mar 2025
- 2024Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approach28 Jan 2024
- 2023Beyond Image Borders: Learning Feature Extrapolation for Unbounded Image Composition21 Sep 2023
- 2023Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image Generation7 Sep 2023
- 2023Fast Full-frame Video Stabilization with Iterative Optimization24 Jul 2023
- 2023FishDreamer: Towards Fisheye Semantic Completion via Unified Image Outpainting and Segmentation24 Mar 2023
- 2023Street-View Image Generation from a Bird's-Eye View Layout11 Jan 2023
- 2023RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning4 Jan 2023
- 2022Structure-guided Image Outpainting21 Dec 2022
- 2022Beyond the Field-of-View: Enhancing Scene Visibility and Perception with Clip-Recurrent Transformer21 Nov 2022
- 2022Factorized and Controllable Neural Re-Rendering of Outdoor Scene for Photo Extrapolation14 Jul 2022
- 2022Outpainting by Queries12 Jul 2022
12 newest of 23 All 23 (JSON)