mlsanityData to 7 Oct 2026

Cross-Spectral Neural Radiance Fields

arXiv 2209.00648 ↗First posted 1 Sep 2022cs.CVcited by 27

Not on the map. Why?

Abstract (arXiv)

We propose X-NeRF, a novel method to learn a Cross-Spectral scene representation given images captured from cameras with different light spectrum sensitivity, based on the Neural Radiance Fields formulation. X-NeRF optimizes camera poses across spectra during training and exploits Normalized Cross-Device Coordinates (NXDC) to render images of different modalities from arbitrary viewpoints, which are aligned and at the same resolution. Experiments on 16 forward-facing scenes, featuring color, multi-spectral and infrared images, confirm the effectiveness of X-NeRF at modeling Cross-Spectral scene representations.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 44 of its 67 references that are in the map. First posted on arXiv 1 Sep 2022.

Builds on

44 of 67 references.

References · 44

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  2. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  4. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  6. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  7. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  8. 2020Neural Sparse Voxel Fieldscited by 959
  9. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  10. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  11. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  12. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
32 more
  1. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  2. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  3. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  4. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  5. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  6. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  7. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  8. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
  9. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  10. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  11. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
  12. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  13. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  14. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  15. 2020Single-View View Synthesis with Multiplane Imagescited by 263
  16. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  17. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
  18. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
  19. 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
  20. 2021Neural Articulated Radiance Fieldcited by 196
  21. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  22. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  23. 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
  24. 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
  25. 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
  26. 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
  27. 2019PST900: RGB-Thermal Calibration, Dataset and Segmentation Networkcited by 85
  28. 2020Crowdsampling the Plenoptic Functioncited by 62
  29. 2022Improved Direct Voxel Grid Optimization for Radiance Fields Reconstructioncited by 61
  30. 2017Learning Cross-Modal Deep Representations for Robust Pedestrian Detectioncited by 34
  31. 2016DASC: Robust Dense Descriptor for Multi-modal and Multi-spectral Correspondence Estimationcited by 10
  32. 2022RGB-Multispectral Matching: Dataset, Learning Methodology, Evaluationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 13; 2025: 7; 2026: 2.

27 papers.

Sort:

  1. 2023NeRF-Supervised Deep Stereocited by 46
  2. 2023LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFscited by 33
  3. 2023NeISF: Neural Incident Stokes Field for Geometry and Material Estimationcited by 25
  4. 2024Thermal-NeRF: Neural Radiance Fields from an Infrared Cameracited by 21
  5. 2024Exploring Multi-modal Neural Scene Representations With Applications on Thermal Imagingcited by 15
  6. 2023Spec-NeRF: Multi-spectral Neural Radiance Fieldscited by 13
  7. 2024AONeuS: A Neural Rendering Framework for Acoustic-Optical Sensor Fusioncited by 13
  8. 2024ThermalNeRF: Thermal Radiance Fieldscited by 13
  9. 2024Leveraging Thermal Modality to Enhance Reconstruction in Low-Light Conditionscited by 12
  10. 2024Hyperspectral Neural Radiance Fieldscited by 11
  11. 2024NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectricscited by 9
  12. 2024SpectralGaussians: Semantic, spectral 3D Gaussian splatting for multi-spectral scene representation, visualization and analysiscited by 7
15 more
  1. 2024Pixel-aligned RGB-NIR Stereo Imaging and Dataset for Robot Visioncited by 7
  2. 2023ChromaDistill: Colorizing Monochrome Radiance Fields with Knowledge Distillationcited by 5
  3. 2024CombiNeRF: A Combination of Regularization Techniques for Few-Shot Neural Radiance Field View Synthesiscited by 4
  4. 2025MultimodalStudio: A Heterogeneous Sensor Dataset and Framework for Neural Rendering across Multiple Imaging Modalitiescited by 3
  5. 2025MMOne: Representing Multiple Modalities in One Scenecited by 3
  6. 2025Towards Integrating Multi-Spectral Imaging with Gaussian Splattingcited by 2
  7. 2024SGCNeRF: Few-Shot Neural Rendering via Sparse Geometric Consistency Guidancecited by 1
  8. 2024Novel View Synthesis with Neural Radiance Fields for Industrial Robot Applicationscited by 1
  9. 2024TeX-NeRF: Neural Radiance Fields from Pseudo-TeX Visioncited by 1
  10. 2025Beyond Darkness: Thermal-Supervised 3D Gaussian Splatting for Low-Light Novel View Synthesiscited by 1
  11. 2025MrGS: Multi-modal Radiance Fields with 3D Gaussian Splatting for RGB-Thermal Novel View Synthesiscited by 1
  12. 2025Diffusion-Denoised Hyperspectral Gaussian Splattingcited by 0
  13. 2025Multispectral-NeRF:a multispectral modeling approach based on neural radiance fieldscited by 0
  14. 2026MSGS: Multispectral 3D Gaussian Splattingcited by 0
  15. 2026Learning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesiscited by 0