View Synthesis by Appearance Flow
Not on the map. Why?
Abstract (arXiv)
We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to synthesize pixels from scratch, we learn to copy them from the input image. Our approach exploits the observation that the visual appearance of different views of the same instance is highly correlated, and such correlation could be explicitly learned by training a convolutional neural network (CNN) to predict appearance flows -- 2-D coordinate vectors specifying which pixels in the input view could be used to reconstruct the target view. Furthermore, the proposed framework easily generalizes to multiple input views by learning how to optimally combine single-view predictions. We show that for both objects and scenes, our approach is able to synthesize novel views of higher perceptual quality than previous CNN-based techniques.
Key facts. Cited by 172 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 37; 2023: 33; 2024: 27; 2025: 18; 2026: 6.
172 papers.
Sort:
By area:
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2021Neural Articulated Radiance Fieldcited by 196
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 182
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 175
38 more
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2021Parser-Free Virtual Try-on via Distilling Appearance Flowscited by 143
- 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
- 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 130
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 121
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
- 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
- 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 100
- 2022Style-Based Global Appearance Flow for Virtual Try-Oncited by 88
- 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
- 2022Single Stage Virtual Try-on via Deformable Attention Flowscited by 65
- 2023Behind the Scenes: Density Fields for Single View Reconstructioncited by 63
- 2024Advances in 3D Generation: A Surveycited by 63
- 2021GAN-Supervised Dense Visual Alignmentcited by 62
- 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
- 2022Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulationcited by 57
- 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 56
- 2022Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Imagecited by 55
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2021Free-viewpoint Indoor Neural Relighting from Multi-view Stereocited by 50
- 2024Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-Oncited by 38
- 2021ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priorscited by 35
- 2021Video Autoencoder: self-supervised disentanglement of static 3D structure and motioncited by 34
- 2024TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Renderingcited by 33
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Viewscited by 31
- 2021Fast and Explicit Neural View Synthesiscited by 28
- 2022Cross-View Panorama Image Synthesiscited by 26
- 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinementcited by 24
- 2021Tracking People with 3D Representationscited by 22
- 2022Hardly Perceptible Trojan Attack against Neural Networks with Bit Flipscited by 22
- 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Promptingcited by 22
- 2021Cascaded Cross MLP-Mixer GANs for Cross-View Image Translationcited by 21
- 2021Cross-View Exocentric to Egocentric Video Synthesiscited by 20
- 2025Sharp Monocular View Synthesis in Less Than a Secondcited by 20
50 most cited of 172 All 172 (JSON)
- 2026Spackle: Completing Large View Single Image NVS with Adaptive Gaussians25 Sep 2026
- 2026Following Motion for Sequential Modeling in Video Frame Interpolation24 Aug 2026
- 2026InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis3 Aug 2026
- 2026MOFA-VTON: More Fashion Possibilities with Fine-Grained Adaptations in Virtual Try-On9 Jun 2026
- 2026M2P: Improving Visual Foundation Models with Mask-to-Point Weakly-Supervised Learning for Dense Point Tracking18 Mar 2026
- 2026OmniVTON++: Training-Free Universal Virtual Try-On with Principal Pose Guidance16 Feb 2026
- 2025Sharp Monocular View Synthesis in Less Than a Second11 Dec 2025
- 2025GeoDiffMM: Geometry-Guided Conditional Diffusion for Motion Magnification9 Dec 2025
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025Distilled-3DGS:Distilled 3D Gaussian Splatting19 Aug 2025
- 2025DualFit: A Two-Stage Virtual Try-On via Warping and Synthesis16 Aug 2025
- 2025Two-Way Garment Transfer: Unified Diffusion Framework for Dressing and Undressing Synthesis6 Aug 2025
38 more
- 2025OmniVTON: Training-Free Universal Virtual Try-On20 Jul 2025
- 2025AssetDropper: Asset Extraction via Diffusion Models with Reward-Driven Optimization6 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025Intern-GS: Vision Model Guided Sparse-View 3D Gaussian Splatting27 May 2025
- 2025CE-NPBG: Connectivity Enhanced Neural Point-Based Graphics for Novel View Synthesis in Autonomous Driving Scenes28 Apr 2025
- 2025Shape-Guided Clothing Warping for Virtual Try-On21 Apr 2025
- 2025Dysarthria Normalization via Local Lie Group Transformations for Robust ASR16 Apr 2025
- 2025Frequency-Aware Gaussian Splatting Decomposition27 Mar 2025
- 2025MultimodalStudio: A Heterogeneous Sensor Dataset and Framework for Neural Rendering across Multiple Imaging Modalities25 Mar 2025
- 2025Limb-Aware Virtual Try-On Network with Progressive Clothing Warping18 Mar 2025
- 2025Progressive Limb-Aware Virtual Try-On16 Mar 2025
- 20253D Gaussian Splatting with Normal Information for Mesh Extraction and Improved Rendering14 Jan 2025
- 2024DiffusionTrend: A Minimalist Approach to Virtual Fashion Try-On19 Dec 2024
- 2024PanoDreamer: Optimization-Based Single Image to 360 3D Scene With Diffusion6 Dec 2024
- 2024TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models27 Nov 2024
- 2024Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View Synthesis6 Nov 2024
- 2024Self-Ensembling Gaussian Splatting for Few-Shot Novel View Synthesis31 Oct 2024
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Bias22 Oct 2024
- 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinement26 Aug 2024
- 2024Mipmap-GS: Let Gaussians Deform with Scale-specific Mipmap for Anti-aliasing Rendering12 Aug 2024
- 2024MVPbev: Multi-view Perspective Image Generation from BEV with Test-time Controllability and Generalizability28 Jul 2024
- 2024D4-VTON: Dynamic Semantics Disentangling for Differential Diffusion based Virtual Try-On21 Jul 2024
- 2024ARoFace: Alignment Robustness to Improve Low-Quality Face Recognition20 Jul 2024
- 2024Generalizable Implicit Motion Modeling for Video Frame Interpolation11 Jul 2024
- 2024MegaScenes: Scene-Level View Synthesis at Scale17 Jun 2024
- 2024Hearing Anything Anywhere11 Jun 2024
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer24 May 2024
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularization20 May 2024
- 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting13 May 2024
- 2024Synthesizing Iris Images using Generative Adversarial Networks: Survey and Comparative Analysis26 Apr 2024
- 2024LADDER: An Efficient Framework for Video Frame Interpolation17 Apr 2024
- 2024MOWA: Multiple-in-One Image Warping Model16 Apr 2024
- 2024Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-On1 Apr 2024
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalization11 Mar 2024
- 2024CMC: Few-shot Novel View Synthesis via Cross-view Multiplane Consistency26 Feb 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2024TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Rendering11 Jan 2024
- 2024A Survey on 3D Gaussian Splatting8 Jan 2024
50 newest of 172 All 172 (JSON)
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 175
- 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 2024Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-Oncited by 38
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Viewscited by 31
- 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinementcited by 24
- 2024TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Modelscited by 19
- 2023WarpDiffusion: Efficient Diffusion Model for High-Fidelity Virtual Try-oncited by 18
- 2025OmniVTON: Training-Free Universal Virtual Try-Oncited by 9
- 2023My Art My Choice: Adversarial Protection Against Unruly AIcited by 5
- 2025AssetDropper: Asset Extraction via Diffusion Models with Reward-Driven Optimizationcited by 1
12 most cited of 13 All 13 (JSON)
- 2025OmniVTON: Training-Free Universal Virtual Try-On20 Jul 2025
- 2025AssetDropper: Asset Extraction via Diffusion Models with Reward-Driven Optimization6 Jun 2025
- 2024DiffusionTrend: A Minimalist Approach to Virtual Fashion Try-On19 Dec 2024
- 2024TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models27 Nov 2024
- 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinement26 Aug 2024
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer24 May 2024
- 2024Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-On1 Apr 2024
- 2023WarpDiffusion: Efficient Diffusion Model for High-Fidelity Virtual Try-on6 Dec 2023
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On4 Dec 2023
- 2023My Art My Choice: Adversarial Protection Against Unruly AI6 Sep 2023
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Views6 Jun 2023
- 2023Consistent View Synthesis with Pose-Guided Diffusion Models30 Mar 2023
12 newest of 13 All 13 (JSON)
- 2021Parser-Free Virtual Try-on via Distilling Appearance Flowscited by 143
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2021Neural Articulated Radiance Fieldcited by 196
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 182
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
12 most cited of 157 All 157 (JSON)
- 2026Spackle: Completing Large View Single Image NVS with Adaptive Gaussians25 Sep 2026
- 2026InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis3 Aug 2026
- 2026MOFA-VTON: More Fashion Possibilities with Fine-Grained Adaptations in Virtual Try-On9 Jun 2026
- 2026M2P: Improving Visual Foundation Models with Mask-to-Point Weakly-Supervised Learning for Dense Point Tracking18 Mar 2026
- 2026OmniVTON++: Training-Free Universal Virtual Try-On with Principal Pose Guidance16 Feb 2026
- 2025Sharp Monocular View Synthesis in Less Than a Second11 Dec 2025
- 2025GeoDiffMM: Geometry-Guided Conditional Diffusion for Motion Magnification9 Dec 2025
- 2025StealthAttack: Robust 3D Gaussian Splatting Poisoning via Density-Guided Illusions2 Oct 2025
- 2025Distilled-3DGS:Distilled 3D Gaussian Splatting19 Aug 2025
- 2025DualFit: A Two-Stage Virtual Try-On via Warping and Synthesis16 Aug 2025
- 2025Two-Way Garment Transfer: Unified Diffusion Framework for Dressing and Undressing Synthesis6 Aug 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
12 newest of 157 All 157 (JSON)