Multispectral-NeRF:a multispectral modeling approach based on neural radiance fields
Not on the map. Why?
Abstract (arXiv)
3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality systems. Traditional 3D reconstruction techniques based on 2D images typically relies on RGB spectral information. With advances in sensor technology, additional spectral bands beyond RGB have been increasingly incorporated into 3D reconstruction workflows. Existing methods that integrate these expanded spectral data often suffer from expensive scheme prices, low accuracy and poor geometric features. Three - dimensional reconstruction based on NeRF can effectively address the various issues in current multispectral 3D reconstruction methods, producing high - precision and high - quality reconstruction results. However, currently, NeRF and some improved models such as NeRFacto are trained on three - band data and cannot take into account the multi - band information. To address this problem, we propose Multispectral-NeRF, an enhanced neural architecture derived from NeRF that can effectively integrates multispectral information. Our technical contributions comprise threefold modifications: Expanding hidden layer dimensionality to accommodate 6-band spectral inputs; Redesigning residual functions to optimize spectral discrepancy calculations between reconstructed and reference images; Adapting data compression modules to address the increased bit-depth requirements of multispectral imagery. Experimental results confirm that Multispectral-NeRF successfully processes multi-band spectral features while accurately preserving the original scenes' spectral characteristics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 49 references that are in the map. First posted on arXiv 14 Sep 2025.
Builds on
20 of 49 references.
References · 20
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 398
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 196
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 2020Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Reviewcited by 116
8 more
- 2023Grid-guided Neural Radiance Fields for Large Urban Scenescited by 100
- 20183D-LMNet: Latent Embedding Matching for Accurate and Diverse 3D Point Cloud Reconstruction from a Single Imagecited by 40
- 2022Cross-Spectral Neural Radiance Fieldscited by 27
- 2021LegoFormer: Transformers for Block-by-Block Multi-view 3D Reconstructioncited by 25
- 2023UE4-NeRF:Neural Radiance Field for Real-Time Rendering of Large-Scale Scenecited by 25
- 2018Dense 3D Object Reconstruction from a Single Depth Viewcited by 24
- 2023Spec-NeRF: Multi-spectral Neural Radiance Fieldscited by 13
- 2025Neural Radiance Fields for the Real World: A Surveycited by 12
Built on by
Not cited yet.