Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement
Not on the map. Why?
Abstract (arXiv)
Neural Radiance Fields (NeRF) have constituted a remarkable breakthrough in image-based 3D reconstruction. However, their implicit volumetric representations differ significantly from the widely-adopted polygonal meshes and lack support from common 3D software and hardware, making their rendering and manipulation inefficient. To overcome this limitation, we present a novel framework that generates textured surface meshes from images. Our approach begins by efficiently initializing the geometry and view-dependency decomposed appearance with a NeRF. Subsequently, a coarse mesh is extracted, and an iterative surface refining algorithm is developed to adaptively adjust both vertex positions and face density based on re-projected rendering errors. We jointly refine the appearance with geometry and bake it into texture images for real-time rendering. Extensive experiments demonstrate that our method achieves superior mesh quality and competitive rendering quality.
Key facts. Cited by 106 papers in the map (data through 7 Oct 2026). Builds on 49 of its 61 references that are in the map. First posted on arXiv 3 Mar 2023.
Builds on
49 of 61 references.
References · 49
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
37 more
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
- 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
- 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
- 2021Editing Conditional Radiance Fieldscited by 222
- 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
- 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
- 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 215
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 211
- 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
- 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2019Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Researchcited by 98
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2022Compressible-composable NeRF via Rank-residual Decompositioncited by 92
- 2022Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstructioncited by 92
- 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
- 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologiescited by 62
- 2022Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulationcited by 57
- 2021DIB-R++: Learning to Predict Lighting and Material with a Hybrid Differentiable Renderercited by 52
- 2022Real-Time Neural Light Field on Mobile Devicescited by 48
- 2022Neural Density-Distance Fieldscited by 9
Built on by
Citing papers per year: 2023: 19; 2024: 59; 2025: 24; 2026: 4.
106 papers.
Sort:
By area:
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110
- 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 78
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 72
- 2023Adaptive Shells for Efficient Neural Radiance Field Renderingcited by 69
38 more
- 2024Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesiscited by 41
- 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
- 2024Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Videocited by 26
- 2023VMesh: Hybrid Volume-Mesh Representation for Efficient View Synthesiscited by 25
- 2023Uncovering and Quantifying Social Biases in Code Generationcited by 25
- 2023NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Supportcited by 25
- 2023Towards Transferable Targeted 3D Adversarial Attack in the Physical Worldcited by 25
- 2023Interactive Segment Anything NeRF with Feature Imitationcited by 24
- 2023ZeroRF: Fast Sparse View 360deg Reconstruction with Zero Pretrainingcited by 24
- 2024UW-GS: Distractor-Aware 3D Gaussian Splatting for Enhanced Underwater Scene Reconstructioncited by 23
- 2023VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streamscited by 22
- 2024Mani-GS: Gaussian Splatting Manipulation with Triangular Meshcited by 22
- 2024Thermal-NeRF: Neural Radiance Fields from an Infrared Cameracited by 21
- 2025LinPrim: Linear Primitives for Differentiable Volumetric Renderingcited by 21
- 2024MeshGS: Adaptive Mesh-Aligned Gaussian Splatting for High-Quality Renderingcited by 19
- 2024RetinaGS: Scalable Training for Dense Scene Rendering with Billion-Scale 3D Gaussianscited by 16
- 2023NTO3D: Neural Target Object 3D Reconstruction with Segment Anythingcited by 14
- 2023City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Webcited by 14
- 2024HPC: Hierarchical Progressive Coding Framework for Volumetric Videocited by 13
- 2024Neural Radiance Field-based Visual Rendering: A Comprehensive Reviewcited by 12
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priorscited by 11
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphonescited by 10
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2024Anything in Any Scene: Photorealistic Video Object Insertioncited by 9
- 2024TexRO: Generating Delicate Textures of 3D Models by Recursive Optimizationcited by 9
- 2024Direct and Adaptable Mesh-Gaussian Scene Reconstruction from Multi-View Imagescited by 9
- 2023LightSpeed: Light and Fast Neural Light Fields on Mobile Devicescited by 8
- 2024MaGS: Reconstructing and Simulating Dynamic 3D Objects with Mesh-adsorbed Gaussian Splattingcited by 8
- 2024MetaFood CVPR 2024 Challenge on Physically Informed 3D Food Reconstruction: Methods and Resultscited by 8
- 2024A Simple Approach to Differentiable Rendering of SDFscited by 7
- 20243D Gaussian Editing with A Single Imagecited by 7
- 2025GS-Cache: A GS-Cache Inference Framework for Large-scale Gaussian Splatting Modelscited by 7
- 2024OmniSDF: Scene Reconstruction using Omnidirectional Signed Distance Functions and Adaptive Binoctreescited by 6
- 2024CodecNeRF: Toward Fast Encoding and Decoding, Compact, and High-quality Novel-view Synthesiscited by 6
- 2024Proc-GS: Procedural Building Generation for City Assembly with 3D Gaussianscited by 6
- 2024Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generationcited by 5
- 2024SAID-NeRF: Segmentation-AIDed NeRF for Depth Completion of Transparent Objectscited by 5
50 most cited of 106 All 106 (JSON)
- 2026Evaluating Mesh Reconstruction Methods for Crop Phenotyping15 Sep 2026
- 2026NeuMesh++: Towards Versatile and Efficient Volumetric Editing with Disentangled Neural Mesh-based Implicit Field17 Jun 2026
- 2026THOM: Generating Physically Plausible Hand-Object Meshes From Text3 Apr 2026
- 2026LegacyAvatars: Volumetric Face Avatars For Traditional Graphics Pipelines18 Jan 2026
- 2025SDFoam: Signed-Distance Foam for explicit surface reconstruction18 Dec 2025
- 2025TagSplat: Topology-Aware Gaussian Splatting for Dynamic Mesh Modeling and Tracking1 Dec 2025
- 2025RePose-NeRF: Robust Radiance Fields for Mesh Reconstruction under Noisy Camera Poses11 Nov 2025
- 2025Improving Multi-View Reconstruction via Texture-Guided Gaussian-Mesh Joint Optimization6 Nov 2025
- 20252DGS-R: Revisiting the Normal Consistency Regularization in 2D Gaussian Splatting19 Oct 2025
- 2025OMeGa: Joint Optimization of Explicit Meshes and Gaussian Splats for Robust Scene-Level Surface Reconstruction29 Sep 2025
- 2025ARGS: Advanced Regularization on Aligning Gaussians over the Surface29 Aug 2025
- 2025Disentangled Geometry and Appearance for Efficient Multi-View Surface Reconstruction and Rendering24 Aug 2025
38 more
- 2025NeuralMeshing: Complete Object Mesh Extraction from Casual Captures22 Aug 2025
- 2025HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguity30 Jun 2025
- 2025Squeeze3D: Extreme Neural Compression with Latent Space Bridging9 Jun 2025
- 2025VolTex: Food Volume Estimation using Text-Guided Segmentation and Neural Surface Reconstruction3 Jun 2025
- 2025FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations28 Apr 2025
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realism21 Apr 2025
- 2025NeRFlex: Resource-aware Real-time High-quality Rendering of Complex Scenes on Mobile Devices4 Apr 2025
- 2025Uni-Render: A Unified Accelerator for Real-Time Rendering Across Diverse Neural Renderers31 Mar 2025
- 2025Automating 3D Dataset Generation with Neural Radiance Fields20 Mar 2025
- 2025BG-Triangle: B'ezier Gaussian Triangle for 3D Vectorization and Rendering18 Mar 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025MVGSR: Multi-View Consistency Gaussian Splatting for Robust Surface Reconstruction11 Mar 2025
- 2025A self-supervised cyclic neural-analytic approach for novel view synthesis and 3D reconstruction5 Mar 2025
- 2025GS-Cache: A GS-Cache Inference Framework for Large-scale Gaussian Splatting Models20 Feb 2025
- 2025LinPrim: Linear Primitives for Differentiable Volumetric Rendering27 Jan 2025
- 2025CaPa: Carve-n-Paint Synthesis for Efficient 4K Textured Mesh Generation16 Jan 2025
- 2024ARSGaussian: 3D Gaussian Splatting with LiDAR for Aerial Remote Sensing Novel View Synthesis24 Dec 2024
- 2024GURecon: Learning Detailed 3D Geometric Uncertainties for Neural Surface Reconstruction19 Dec 2024
- 2024Proc-GS: Procedural Building Generation for City Assembly with 3D Gaussians10 Dec 2024
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphones28 Nov 2024
- 2024Neural Surface Priors for Editable Gaussian Splatting27 Nov 2024
- 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splats23 Nov 2024
- 2024DyGASR: Dynamic Generalized Exponential Splatting with Surface Alignment for Accelerated 3D Mesh Reconstruction14 Nov 2024
- 2024MeshGS: Adaptive Mesh-Aligned Gaussian Splatting for High-Quality Rendering11 Oct 2024
- 2024UW-GS: Distractor-Aware 3D Gaussian Splatting for Enhanced Underwater Scene Reconstruction2 Oct 2024
- 2024AniSDF: Fused-Granularity Neural Surfaces with Anisotropic Encoding for High-Fidelity 3D Reconstruction2 Oct 2024
- 2024G-NeLF: Memory- and Data-Efficient Hybrid Neural Light Field for Novel View Synthesis9 Sep 2024
- 2024Volumetric Surfaces: Representing Fuzzy Geometries with Layered Meshes4 Sep 2024
- 2024Towards Realistic Example-based Modeling via 3D Gaussian Stitching28 Aug 2024
- 2024R2-Mesh: Reinforcement Learning Powered Mesh Reconstruction via Geometry and Appearance Refinement19 Aug 2024
- 20243D Gaussian Editing with A Single Image14 Aug 2024
- 2024ActiveNeRF: Learning Accurate 3D Geometry by Active Pattern Projection13 Aug 2024
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities24 Jul 2024
- 2024Integrating Meshes and 3D Gaussians for Indoor Scene Reconstruction with SAM Mask Guidance23 Jul 2024
- 2024NGP-RT: Fusing Multi-Level Hash Features with Lightweight Attention for Real-Time Novel View Synthesis15 Jul 2024
- 2024MetaFood CVPR 2024 Challenge on Physically Informed 3D Food Reconstruction: Methods and Results12 Jul 2024
- 2024HPC: Hierarchical Progressive Coding Framework for Volumetric Video12 Jul 2024
- 2024Drantal-NeRF: Diffusion-Based Restoration for Anti-aliasing Neural Radiance Field10 Jul 2024
50 newest of 106 All 106 (JSON)
- 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
- 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 72
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2024PointDreamer: Zero-shot 3D Textured Mesh Reconstruction from Colored Point Cloudcited by 3
- 2023EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Priorcited by 2
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2024PointDreamer: Zero-shot 3D Textured Mesh Reconstruction from Colored Point Cloud22 Jun 2024
- 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priors4 Mar 2024
- 2023EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Prior25 Aug 2023
- 2023TextMesh: Generation of Realistic 3D Meshes From Text Prompts24 Apr 2023
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110
- 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 78
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2023Adaptive Shells for Efficient Neural Radiance Field Renderingcited by 69
- 2024Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesiscited by 41
- 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
12 most cited of 101 All 101 (JSON)
- 2026Evaluating Mesh Reconstruction Methods for Crop Phenotyping15 Sep 2026
- 2026NeuMesh++: Towards Versatile and Efficient Volumetric Editing with Disentangled Neural Mesh-based Implicit Field17 Jun 2026
- 2026THOM: Generating Physically Plausible Hand-Object Meshes From Text3 Apr 2026
- 2026LegacyAvatars: Volumetric Face Avatars For Traditional Graphics Pipelines18 Jan 2026
- 2025SDFoam: Signed-Distance Foam for explicit surface reconstruction18 Dec 2025
- 2025TagSplat: Topology-Aware Gaussian Splatting for Dynamic Mesh Modeling and Tracking1 Dec 2025
- 2025RePose-NeRF: Robust Radiance Fields for Mesh Reconstruction under Noisy Camera Poses11 Nov 2025
- 2025Improving Multi-View Reconstruction via Texture-Guided Gaussian-Mesh Joint Optimization6 Nov 2025
- 20252DGS-R: Revisiting the Normal Consistency Regularization in 2D Gaussian Splatting19 Oct 2025
- 2025OMeGa: Joint Optimization of Explicit Meshes and Gaussian Splats for Robust Scene-Level Surface Reconstruction29 Sep 2025
- 2025ARGS: Advanced Regularization on Aligning Gaussians over the Surface29 Aug 2025
- 2025Disentangled Geometry and Appearance for Efficient Multi-View Surface Reconstruction and Rendering24 Aug 2025
12 newest of 101 All 101 (JSON)