NeuRegenerate: A Framework for Visualizing Neurodegeneration
Not on the map. Why?
Abstract (arXiv)
Recent advances in high-resolution microscopy have allowed scientists to better understand the underlying brain connectivity. However, due to the limitation that biological specimens can only be imaged at a single timepoint, studying changes to neural projections is limited to general observations using population analysis. In this paper, we introduce NeuRegenerate, a novel end-to-end framework for the prediction and visualization of changes in neural fiber morphology within a subject, for specified age-timepoints.To predict projections, we present neuReGANerator, a deep-learning network based on cycle-consistent generative adversarial network (cycleGAN) that translates features of neuronal structures in a region, across age-timepoints, for large brain microscopy volumes. We improve the reconstruction quality of neuronal structures by implementing a density multiplier and a new loss function, called the hallucination loss.Moreover, to alleviate artifacts that occur due to tiling of large input volumes, we introduce a spatial-consistency module in the training pipeline of neuReGANerator. We show that neuReGANerator has a reconstruction accuracy of 94% in predicting neuronal structures. Finally, to visualize the predicted change in projections, NeuRegenerate offers two modes: (1) neuroCompare to simultaneously visualize the difference in the structures of the neuronal projections, across the age timepoints, and (2) neuroMorph, a vesselness-based morphing technique to interactively visualize the transformation of the structures from one age-timepoint to the other. Our framework is designed specifically for volumes acquired using wide-field microscopy. We demonstrate our framework by visualizing the structural changes in neuronal fibers within the cholinergic system of the mouse brain between a young and old specimen.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 49 references that are in the map. First posted on arXiv 2 Feb 2022.
Builds on
12 of 49 references.
References · 12
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2018Distribution Matching Losses Can Hallucinate Features in Medical Image Translationcited by 99
- 2016Medical Image Synthesis with Context-Aware Generative Adversarial Networkscited by 91
- 2017CycleGAN, a Master of Steganographycited by 65
- 2017Detecting Cancer Metastases on Gigapixel Pathology Imagescited by 52
- 2020Augmenting Colonoscopy using Extended and Directional CycleGAN for Lossy Image Translationcited by 29
- 2019Three-dimensional virtual refocusing of fluorescence microscopy images using deep learningcited by 11
Built on by
Citing papers per year: 2023: 1.
1 paper.