# Dispersed Structured Light for Hyperspectral 3D Imaging

arXiv: https://arxiv.org/abs/2311.18287 · HTML: https://mlsanity.com/paper/2311.18287/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 51 references that are in the map.
- First posted on arXiv 30 Nov 2023.

## Builds on (most cited first, 10 of 10)

- [Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction](https://mlsanity.com/paper/2203.04845/) (2022)
- [Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics](https://mlsanity.com/paper/2009.00463/) (2020)
- [HerosNet: Hyperspectral Explicable Reconstruction and Optimal Sampling Deep Network for Snapshot Compressive Imaging](https://mlsanity.com/paper/2112.06238/) (2021)
- [Polka Lines: Learning Structured Illumination and Reconstruction for Active Stereo](https://mlsanity.com/paper/2011.13117/) (2020)
- [Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction](https://mlsanity.com/paper/2308.10820/) (2023)
- [Pro-Cam SSfM: Projector-Camera System for Structure and Spectral Reflectance from Motion](https://mlsanity.com/paper/1908.08185/) (2019)
- [Spectral MVIR: Joint Reconstruction of 3D Shape and Spectral Reflectance](https://mlsanity.com/paper/2104.07308/) (2021)
- [Real-time Hyperspectral Imaging in Hardware via Trained Metasurface Encoders](https://mlsanity.com/paper/2204.02084/) (2022)
- [Hyperspectral Light Field Stereo Matching](https://mlsanity.com/paper/1709.00835/) (2017)
- [Deep Hyperspectral-Depth Reconstruction Using Single Color-Dot Projection](https://mlsanity.com/paper/2204.03929/) (2022)

## Built on by (most cited first, 4 of 4)

- [GS-ProCams: Gaussian Splatting-based Projector-Camera Systems](https://mlsanity.com/paper/2412.11762/) (2024)
- [Dense Dispersed Structured Light for Hyperspectral 3D Imaging of Dynamic Scenes](https://mlsanity.com/paper/2412.01140/) (2024)
- [Towards Imperceptible Watermarking Via Environment Illumination for Consumer Cameras](https://mlsanity.com/paper/2510.17114/) (2025)
- [Broadband Hyperspectral 3D Imaging using Dispersed Structured Light](https://mlsanity.com/paper/2605.25757/) (2026)

## Abstract (arXiv)

Hyperspectral 3D imaging aims to acquire both depth and spectral information of a scene. However, existing methods are either prohibitively expensive and bulky or compromise on spectral and depth accuracy. In this work, we present Dispersed Structured Light (DSL), a cost-effective and compact method for accurate hyperspectral 3D imaging. DSL modifies a traditional projector-camera system by placing a sub-millimeter thick diffraction grating film front of the projector. The grating disperses structured light based on light wavelength. To utilize the dispersed structured light, we devise a model for dispersive projection image formation and a per-pixel hyperspectral 3D reconstruction method. We validate DSL by instantiating a compact experimental prototype. DSL achieves spectral accuracy of 18.8nm full-width half-maximum (FWHM) and depth error of 1mm. We demonstrate that DSL outperforms prior work on practical hyperspectral 3D imaging. DSL promises accurate and practical hyperspectral 3D imaging for diverse application domains, including computer vision and graphics, cultural heritage, geology, and biology.
