Optimizing Retinal Prosthetic Stimuli with Conditional Invertible Neural Networks
Not on the map. Why?
Abstract (arXiv)
Implantable retinal prostheses offer a promising solution to restore partial vision by circumventing damaged photoreceptor cells in the retina and directly stimulating the remaining functional retinal cells. However, the information transmission between the camera and retinal cells is often limited by the low resolution of the electrode array and the lack of specificity for different ganglion cell types, resulting in suboptimal stimulations. In this work, we propose to utilize normalizing flow-based conditional invertible neural networks to optimize retinal implant stimulation in an unsupervised manner. The invertibility of these networks allows us to use them as a surrogate for the computational model of the visual system, while also encoding input camera signals into optimized electrical stimuli on the electrode array. Compared to other methods, such as trivial downsampling, linear models, and feed-forward convolutional neural networks, the flow-based invertible neural network and its conditional extension yield better visual reconstruction qualities w.r.t. various metrics using a physiologically validated simulation tool.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 63 references that are in the map. First posted on arXiv 7 Mar 2024.
Builds on
23 of 63 references.
References · 23
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2016Density estimation using Real NVPcited by 2,042
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2017Wasserstein Auto-Encoderscited by 373
- 2016Kernel Mean Embedding of Distributions: A Review and Beyondcited by 364
- 2015A note on the evaluation of generative modelscited by 292
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 242
11 more
- 2019Guided Image Generation with Conditional Invertible Neural Networkscited by 147
- 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
- 2021Conditional Invertible Neural Networks for Diverse Image-to-Image Translationcited by 24
- 2023Lifting Architectural Constraints of Injective Flowscited by 18
- 2022Hybrid Neural Autoencoders for Stimulus Encoding in Visual and Other Sensory Neuroprosthesescited by 10
- 2023Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prosthesescited by 8
- 2022Deep Learning-Based Perceptual Stimulus Encoder for Bionic Visioncited by 6
- 2023Unsupervised Domain Transfer with Conditional Invertible Neural Networkscited by 4
- 2023Training Invertible Neural Networks as Autoencoderscited by 4
- 2023A Deep Learning-based in silico Framework for Optimization on Retinal Prosthetic Stimulationcited by 3
- 2024Deep Learning for Visual Neuroprosthesiscited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Visual Fixation-Based Retinal Prosthetic Simulationcited by 0
- 2024Visual Fixation-Based Retinal Prosthetic Simulation15 Oct 2024