mlsanityData to 7 Oct 2026

Ray Conditioning: Trading Photo-consistency for Photo-realism in Multi-view Image Generation

arXiv 2304.13681 ↗First posted 26 Apr 2023cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Multi-view image generation attracts particular attention these days due to its promising 3D-related applications, e.g., image viewpoint editing. Most existing methods follow a paradigm where a 3D representation is first synthesized, and then rendered into 2D images to ensure photo-consistency across viewpoints. However, such explicit bias for photo-consistency sacrifices photo-realism, causing geometry artifacts and loss of fine-scale details when these methods are applied to edit real images. To address this issue, we propose ray conditioning, a geometry-free alternative that relaxes the photo-consistency constraint. Our method generates multi-view images by conditioning a 2D GAN on a light field prior. With explicit viewpoint control, state-of-the-art photo-realism and identity consistency, our method is particularly suited for the viewpoint editing task.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 26 Apr 2023.

Builds on

35 of 47 references.

References · 35

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  9. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  10. 2018Demystifying MMD GANscited by 1,268
  11. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  12. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
23 more
  1. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  2. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  3. 2016HyperNetworkscited by 1,003
  4. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  5. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  6. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  7. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  8. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  9. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  10. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  11. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  12. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  13. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  14. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  15. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  16. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  17. 2022Novel View Synthesis with Diffusion Modelscited by 299
  18. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  19. 2019On the "steerability" of generative adversarial networkscited by 247
  20. 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
  21. 2021GAN-Supervised Dense Visual Alignmentcited by 61
  22. 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
  23. 20223D GAN Inversion with Pose Optimizationcited by 44

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 4; 2026: 2.

11 papers.

  1. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  2. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  3. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  4. 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
  5. 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulationcited by 59
  6. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
  7. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
  8. 2025Pippo: High-Resolution Multi-View Humans from a Single Imagecited by 20
  9. 2025Pl"uckeRF: A Line-based 3D Representation for Few-view Reconstructioncited by 0
  10. 2025YingVideo-MV: Music-Driven Multi-Stage Video Generationcited by 0
  11. 2026ProDiG: Progressive Diffusion-Guided Gaussian Splatting for Aerial to Ground Reconstructioncited by 0