Video-rate multispectral imaging in laparoscopic surgery: First-in-human application
Not on the map. Why?
Abstract (arXiv)
Multispectral and hyperspectral imaging (MSI/HSI) can provide clinically relevant information on morphological and functional tissue properties. Application in the operating room (OR), however, has so far been limited by complex hardware setups and slow acquisition times. To overcome these limitations, we propose a novel imaging system for video-rate spectral imaging in the clinical workflow. The system integrates a small snapshot multispectral camera with a standard laparoscope and a clinically commonly used light source, enabling the recording of multispectral images with a spectral dimension of 16 at a frame rate of 25 Hz. An ongoing in patient study shows that multispectral recordings from this system can help detect perfusion changes in partial nephrectomy surgery, thus opening the doors to a wide range of clinical applications.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 13 of its 84 references that are in the map. First posted on arXiv 28 May 2021.
Builds on
13 of 84 references.
References · 13
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2016Density estimation using Real NVPcited by 2,042
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 242
- 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
- 2016Discriminative Correlation Filter with Channel and Spatial Reliabilitycited by 45
- 2019Neural Network Generalization: The impact of camera parameterscited by 14
- 2021Medical Imaging and Machine Learningcited by 12
- 2019Estimation of blood oxygenation with learned spectral decoloring for quantitative photoacoustic imaging (LSD-qPAI)cited by 7
- 2019Uncertainty-aware performance assessment of optical imaging modalities with invertible neural networkscited by 5
- 2019Estimation of Tissue Oxygen Saturation from RGB images and Sparse Hyperspectral Signals based on Conditional Generative Adversarial Networkcited by 1
1 more
Built on by
Citing papers per year: 2024: 4; 2025: 2.
6 papers.
- 2024A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Modelscited by 19
- 2024OOD-SEG: Exploiting out-of-distribution detection techniques for learning image segmentation from sparse multi-class positive-only annotationscited by 2
- 2025CARL: Camera-Agnostic Representation Learning for Spectral Image Analysiscited by 2
- 2024Deep intra-operative illumination calibration of hyperspectral camerascited by 1
- 2024Xeno-learning: knowledge transfer across species in deep learning-based spectral image analysiscited by 0
- 2025Clinical Validation of Deep Learning for Real-Time Tissue Oxygenation Estimation Using Spectral Imagingcited by 0
- 2025Clinical Validation of Deep Learning for Real-Time Tissue Oxygenation Estimation Using Spectral Imaging23 May 2025
- 2025CARL: Camera-Agnostic Representation Learning for Spectral Image Analysis27 Apr 2025
- 2024OOD-SEG: Exploiting out-of-distribution detection techniques for learning image segmentation from sparse multi-class positive-only annotations14 Nov 2024
- 2024Xeno-learning: knowledge transfer across species in deep learning-based spectral image analysis15 Oct 2024
- 2024Deep intra-operative illumination calibration of hyperspectral cameras11 Sep 2024
- 2024A Comprehensive Survey for Hyperspectral Image Classification: The Evolution from Conventional to Transformers and Mamba Models23 Apr 2024