mlsanityData to 14 Oct 2026

VMesh: Hybrid Volume-Mesh Representation for Efficient View Synthesis

arXiv 2303.16184 ↗First posted 28 Mar 2023cs.CV cs.GRcited by 25

Not on the map. Why?

Abstract (arXiv)

With the emergence of neural radiance fields (NeRFs), view synthesis quality has reached an unprecedented level. Compared to traditional mesh-based assets, this volumetric representation is more powerful in expressing scene geometry but inevitably suffers from high rendering costs and can hardly be involved in further processes like editing, posing significant difficulties in combination with the existing graphics pipeline. In this paper, we present a hybrid volume-mesh representation, VMesh, which depicts an object with a textured mesh along with an auxiliary sparse volume. VMesh retains the advantages of mesh-based assets, such as efficient rendering, compact storage, and easy editing, while also incorporating the ability to represent subtle geometric structures provided by the volumetric counterpart. VMesh can be obtained from multi-view images of an object and renders at 2K 60FPS on common consumer devices with high fidelity, unleashing new opportunities for real-time immersive applications.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 28 Mar 2023.

Builds on

30 of 45 references.

References · 30

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  7. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  8. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  9. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  10. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  11. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  12. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
18 more
  1. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  2. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
  3. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  4. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  5. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  6. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
  7. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
  8. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 221
  9. 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 218
  10. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  11. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 216
  12. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  13. 2022Instant Volumetric Head Avatarscited by 159
  14. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
  15. 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
  16. 2022EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyescited by 14
  17. 2022Artemis: Articulated Neural Pets with Appearance and Motion synthesiscited by 8
  18. 2022Neural Assets: Volumetric Object Capture and Rendering for Interactive Environmentscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 7; 2024: 12; 2025: 5; 2026: 1.

25 papers.

Sort:

  1. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  2. 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 113
  3. 2023Adaptive Shells for Efficient Neural Radiance Field Renderingcited by 69
  4. 2024Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesiscited by 41
  5. 2024Textured Gaussians for Enhanced 3D Scene Appearance Modelingcited by 40
  6. 2023Flexible Techniques for Differentiable Rendering with 3D Gaussianscited by 28
  7. 2023HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfacescited by 28
  8. 2023BakedAvatar: Baking Neural Fields for Real-Time Head Avatar Synthesiscited by 20
  9. 2024MeshGS: Adaptive Mesh-Aligned Gaussian Splatting for High-Quality Renderingcited by 19
  10. 2025Neural Radiance Fields for the Real World: A Surveycited by 12
  11. 2023Volumetric Rendering with Baked Quadrature Fieldscited by 9
  12. 2024AniSDF: Fused-Granularity Neural Surfaces with Anisotropic Encoding for High-Fidelity 3D Reconstructioncited by 6
13 more
  1. 2023Reconstructive Latent-Space Neural Radiance Fields for Efficient 3D Scene Representationscited by 5
  2. 2024ViiNeuS: Volumetric Initialization for Implicit Neural Surface reconstruction of urban scenes with limited image overlapcited by 4
  3. 2024PR-ENDO: Physically Based Relightable Gaussian Splatting for Endoscopycited by 4
  4. 2025Nexels: Neurally-Textured Surfels for Real-Time Novel View Synthesis with Sparse Geometriescited by 4
  5. 2024REFRAME: Reflective Surface Real-Time Rendering for Mobile Devicescited by 2
  6. 2024Oblique-MERF: Revisiting and Improving MERF for Oblique Photographycited by 2
  7. 2024Towards Real-Time Neural Volumetric Rendering on Mobile Devices: A Measurement Studycited by 2
  8. 2025PrismAvatar: Real-time animated 3D neural head avatars on edge devicescited by 2
  9. 2024Voxel-Mesh Hybrid Representation for Real-Time View Synthesiscited by 1
  10. 2024Multi-times Monte Carlo Rendering for Inter-reflection Reconstructioncited by 1
  11. 2025SplatCo: Structure-View Collaborative Gaussian Splatting for Detail-Preserving Rendering of Large-Scale Unbounded Scenescited by 1
  12. 2025Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstructioncited by 1
  13. 2026NeuMesh++: Towards Versatile and Efficient Volumetric Editing with Disentangled Neural Mesh-based Implicit Fieldcited by 0