Equivariant Neural Rendering
Not on the map. Why?
Abstract (arXiv)
We propose a framework for learning neural scene representations directly from images, without 3D supervision. Our key insight is that 3D structure can be imposed by ensuring that the learned representation transforms like a real 3D scene. Specifically, we introduce a loss which enforces equivariance of the scene representation with respect to 3D transformations. Our formulation allows us to infer and render scenes in real time while achieving comparable results to models requiring minutes for inference. In addition, we introduce two challenging new datasets for scene representation and neural rendering, including scenes with complex lighting and backgrounds. Through experiments, we show that our model achieves compelling results on these datasets as well as on standard ShapeNet benchmarks.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 15; 2023: 9; 2024: 6; 2025: 2; 2026: 3.
47 papers.
Sort:
By area:
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2022Novel View Synthesis with Diffusion Modelscited by 299
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
- 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Imagecited by 104
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
- 2021Generative Models as Distributions of Functionscited by 89
35 more
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2022Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translationcited by 73
- 2022SparsePose: Sparse-View Camera Pose Regression and Refinementcited by 53
- 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 43
- 2022Transframer: Arbitrary Frame Prediction with Generative Modelscited by 37
- 2021Fast and Explicit Neural View Synthesiscited by 28
- 2022Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolationcited by 26
- 2022Equivariant Representation Learning via Class-Pose Decompositioncited by 17
- 2022Neural Groundplans: Persistent Neural Scene Representations from a Single Imagecited by 17
- 2021Addressing the Topological Defects of Disentanglement via Distributed Operatorscited by 14
- 2022SymmNeRF: Learning to Explore Symmetry Prior for Single-View View Synthesiscited by 13
- 2023Neural Fourier Transform: A General Approach to Equivariant Representation Learningcited by 12
- 2022Learning Generalizable Light Field Networks from Few Imagescited by 10
- 2024On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theorycited by 10
- 2021Unsupervised Novel View Synthesis from a Single Imagecited by 8
- 2023InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modulescited by 7
- 2024CodecNeRF: Toward Fast Encoding and Decoding, Compact, and High-quality Novel-view Synthesiscited by 6
- 2021Hamiltonian latent operators for content and motion disentanglement in image sequencescited by 5
- 2023Learning Interpretable Low-dimensional Representation via Physical Symmetrycited by 4
- 2023Topological Obstructions and How to Avoid Themcited by 4
- 2023VaLID: Variable-Length Input Diffusion for Novel View Synthesiscited by 4
- 2023Unsupervised Coordinate-Based Video Denoisingcited by 3
- 2024G-NeRF: Geometry-enhanced Novel View Synthesis from Single-View Imagescited by 3
- 2024See360: Novel Panoramic View Interpolationcited by 2
- 2021Quantised Transforming Auto-Encoders: Achieving Equivariance to Arbitrary Transformations in Deep Networkscited by 1
- 2022Equivariant Light Field Convolution and Transformercited by 1
- 2024ViewFusion: Learning Composable Diffusion Models for Novel View Synthesiscited by 1
- 2025A Survey on World Models Grounded in Acoustic Physical Informationcited by 1
- 2026Constructing VAE Latent Spaces with Prescribed Topologycited by 1
- 2021Self-Supervised Equivariant Scene Synthesis from Videocited by 0
- 2022Capabilities, Limitations and Challenges of Style Transfer with CycleGANs: A Study on Automatic Ring Design Generationcited by 0
- 2023Equivariant Representation Learning in the Presence of Stabilizerscited by 0
- 2025Learning Group Actions In Disentangled Latent Image Representationscited by 0
- 2026Latent Equivariant Operators for Robust Object Recognition: Promises and Challengescited by 0
- 2026Equivariant Latent Alignment via Flow Matching under Group Symmetriescited by 0
- 2026Constructing VAE Latent Spaces with Prescribed Topology5 Jun 2026
- 2026Equivariant Latent Alignment via Flow Matching under Group Symmetries29 May 2026
- 2026Latent Equivariant Operators for Robust Object Recognition: Promises and Challenges20 Feb 2026
- 2025Learning Group Actions In Disentangled Latent Image Representations3 Dec 2025
- 2025A Survey on World Models Grounded in Acoustic Physical Information16 Jun 2025
- 2024On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory16 Dec 2024
- 2024G-NeRF: Geometry-enhanced Novel View Synthesis from Single-View Images11 Apr 2024
- 2024CodecNeRF: Toward Fast Encoding and Decoding, Compact, and High-quality Novel-view Synthesis7 Apr 2024
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation18 Mar 2024
- 2024ViewFusion: Learning Composable Diffusion Models for Novel View Synthesis5 Feb 2024
- 2024See360: Novel Panoramic View Interpolation7 Jan 2024
- 2023VaLID: Variable-Length Input Diffusion for Novel View Synthesis14 Dec 2023
35 more
- 2023Topological Obstructions and How to Avoid Them12 Dec 2023
- 2023InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules26 Aug 2023
- 2023Unsupervised Coordinate-Based Video Denoising1 Jul 2023
- 2023Neural Fourier Transform: A General Approach to Equivariant Representation Learning29 May 2023
- 2023SHERF: Generalizable Human NeRF from a Single Image22 Mar 2023
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion20 Feb 2023
- 2023Learning Interpretable Low-dimensional Representation via Physical Symmetry5 Feb 2023
- 2023Equivariant Representation Learning in the Presence of Stabilizers12 Jan 2023
- 2022Equivariant Light Field Convolution and Transformer30 Dec 2022
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors6 Dec 2022
- 2022SparsePose: Sparse-View Camera Pose Regression and Refinement29 Nov 2022
- 2022Novel View Synthesis with Diffusion Models6 Oct 2022
- 2022SymmNeRF: Learning to Explore Symmetry Prior for Single-View View Synthesis29 Sep 2022
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generation27 Jul 2022
- 2022Learning Generalizable Light Field Networks from Few Images24 Jul 2022
- 2022Neural Groundplans: Persistent Neural Scene Representations from a Single Image22 Jul 2022
- 2022Capabilities, Limitations and Challenges of Style Transfer with CycleGANs: A Study on Automatic Ring Design Generation18 Jul 2022
- 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenes18 Jul 2022
- 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Image12 Jul 2022
- 2022Equivariant Representation Learning via Class-Pose Decomposition7 Jul 2022
- 2022Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation12 May 2022
- 2022Transframer: Arbitrary Frame Prediction with Generative Models17 Mar 2022
- 2022Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translation26 Feb 2022
- 2021Hamiltonian latent operators for content and motion disentanglement in image sequences2 Dec 2021
- 2021Quantised Transforming Auto-Encoders: Achieving Equivariance to Arbitrary Transformations in Deep Networks25 Nov 2021
- 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categories3 Sep 2021
- 2021Fast and Explicit Neural View Synthesis12 Jul 2021
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networks25 Apr 2021
- 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fields1 Apr 2021
- 2021COIN: COmpression with Implicit Neural representations3 Mar 2021
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single View17 Feb 2021
- 2021Addressing the Topological Defects of Disentanglement via Distributed Operators10 Feb 2021
- 2021Generative Models as Distributions of Functions9 Feb 2021
- 2021Unsupervised Novel View Synthesis from a Single Image5 Feb 2021
- 2021Self-Supervised Equivariant Scene Synthesis from Video1 Feb 2021
- 2022Novel View Synthesis with Diffusion Modelscited by 299
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
- 2024ViewFusion: Learning Composable Diffusion Models for Novel View Synthesiscited by 1
- 2026Equivariant Latent Alignment via Flow Matching under Group Symmetriescited by 0
- 2026Equivariant Latent Alignment via Flow Matching under Group Symmetries29 May 2026
- 2024ViewFusion: Learning Composable Diffusion Models for Novel View Synthesis5 Feb 2024
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors6 Dec 2022
- 2022Novel View Synthesis with Diffusion Models6 Oct 2022
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
- 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Imagecited by 104
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
- 2021Generative Models as Distributions of Functionscited by 89
- 2023SHERF: Generalizable Human NeRF from a Single Imagecited by 88
- 2022Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translationcited by 73
12 most cited of 42 All 42 (JSON)
- 2026Constructing VAE Latent Spaces with Prescribed Topology5 Jun 2026
- 2026Latent Equivariant Operators for Robust Object Recognition: Promises and Challenges20 Feb 2026
- 2025Learning Group Actions In Disentangled Latent Image Representations3 Dec 2025
- 2024On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory16 Dec 2024
- 2024G-NeRF: Geometry-enhanced Novel View Synthesis from Single-View Images11 Apr 2024
- 2024CodecNeRF: Toward Fast Encoding and Decoding, Compact, and High-quality Novel-view Synthesis7 Apr 2024
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation18 Mar 2024
- 2024See360: Novel Panoramic View Interpolation7 Jan 2024
- 2023VaLID: Variable-Length Input Diffusion for Novel View Synthesis14 Dec 2023
- 2023Topological Obstructions and How to Avoid Them12 Dec 2023
- 2023InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules26 Aug 2023
- 2023Unsupervised Coordinate-Based Video Denoising1 Jul 2023
12 newest of 42 All 42 (JSON)