mlsanityData to 7 Oct 2026

NeurMiPs: Neural Mixture of Planar Experts for View Synthesis

arXiv 2204.13696 ↗First posted 28 Apr 2022cs.CVcited by 23

Not on the map. Why?

Abstract (arXiv)

We present Neural Mixtures of Planar Experts (NeurMiPs), a novel planar-based scene representation for modeling geometry and appearance. NeurMiPs leverages a collection of local planar experts in 3D space as the scene representation. Each planar expert consists of the parameters of the local rectangular shape representing geometry and a neural radiance field modeling the color and opacity. We render novel views by calculating ray-plane intersections and composite output colors and densities at intersected points to the image. NeurMiPs blends the efficiency of explicit mesh rendering and flexibility of the neural radiance field. Experiments demonstrate superior performance and speed of our proposed method, compared to other 3D representations in novel view synthesis.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 46 of its 84 references that are in the map. First posted on arXiv 28 Apr 2022.

Builds on

46 of 84 references.

References · 46

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  4. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  6. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  7. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  8. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  9. 2020Neural Sparse Voxel Fieldscited by 959
  10. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  11. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  12. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
34 more
  1. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  2. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  3. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  4. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  5. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  6. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  7. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  8. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  9. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  10. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  11. 2019Neural Point-Based Graphicscited by 326
  12. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  13. 2020Single-View View Synthesis with Multiplane Imagescited by 263
  14. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  15. 2020Free View Synthesiscited by 231
  16. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
  17. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
  18. 2020AutoInt: Automatic Integration for Fast Neural Volume Renderingcited by 204
  19. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  20. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
  21. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  22. 2020Stable View Synthesiscited by 165
  23. 2020DeRF: Decomposed Radiance Fieldscited by 163
  24. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  25. 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
  26. 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
  27. 2020Worldsheet: Wrapping the World in a 3D Sheet for View Synthesis from a Single Imagecited by 77
  28. 2021TermiNeRF: Ray Termination Prediction for Efficient Neural Renderingcited by 70
  29. 2020World-Consistent Video-to-Video Synthesiscited by 69
  30. 2020SurfelGAN: Synthesizing Realistic Sensor Data for Autonomous Drivingcited by 68
  31. 2019Single-Image Piece-wise Planar 3D Reconstruction via Associative Embeddingcited by 56
  32. 2021NeRF in detail: Learning to sample for view synthesiscited by 35
  33. 2021Neural BRDF Representation and Importance Samplingcited by 28
  34. 2020GeLaTO: Generative Latent Textured Objectscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 9; 2024: 6; 2025: 2; 2026: 1.

23 papers.

Sort:

By area:

  1. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  2. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
  3. 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 215
  4. 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
  5. 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
  6. 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Fieldcited by 37
  7. 2022StegaNeRF: Embedding Invisible Information within Neural Radiance Fieldscited by 32
  8. 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
  9. 2023Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Expertscited by 27
  10. 2024Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Videocited by 26
  11. 2023Fast View Synthesis of Casual Videos with Soup-of-Planescited by 22
  12. 2023Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotationcited by 18
11 more
  1. 2023Structural Multiplane Image: Bridging Neural View Synthesis and 3D Reconstructioncited by 12
  2. 2023Generative Neural Fields by Mixtures of Neural Implicit Functionscited by 10
  3. 2023Canonical Factors for Hybrid Neural Fieldscited by 8
  4. 2024Planar Reflection-Aware Neural Radiance Fieldscited by 6
  5. 2024AlphaTablets: A Generic Plane Representation for 3D Planar Reconstruction from Monocular Videoscited by 6
  6. 2022Vitruvio: 3D Building Meshes via Single Perspective Sketchescited by 5
  7. 2023PARF: Primitive-Aware Radiance Fusion for Indoor Scene Novel View Synthesiscited by 5
  8. 2022Surface Normal Clustering for Implicit Representation of Manhattan Scenescited by 2
  9. 2024NGP-RT: Fusing Multi-Level Hash Features with Lightweight Attention for Real-Time Novel View Synthesiscited by 2
  10. 20253D Gaussian Flats: Hybrid 2D/3D Photometric Scene Reconstructioncited by 2
  11. 2026MME: Mixture of Mesh Experts with Random Walk Transformer Gatingcited by 0