mlsanityData to 14 Oct 2026

Freqformer: Frequency-Domain Transformer for 3-D Reconstruction and Quantification of Human Retinal Vasculature

arXiv 2411.11189 ↗First posted 17 Nov 2024eess.IV cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Objective: To achieve accurate 3-D reconstruction and quantitative analysis of human retinal vasculature from a single optical coherence tomography angiography (OCTA) scan. Methods: We introduce Freqformer, a novel Transformer-based model featuring a dual-branch architecture that integrates a Transformer layer for capturing global spatial context with a complex-valued frequency-domain module designed for adaptive frequency enhancement. Freqformer was trained using single depth-plane OCTA images, utilizing volumetrically merged OCTA as the ground truth. Performance was evaluated quantitatively through 2-D and 3-D image quality metrics. 2-D networks and their 3-D counterparts were compared to assess the differences between enhancing volume slice by slice and enhancing it by 3-D patches. Furthermore, 3-D quantitative vascular metrics were conducted to quantify human retinal vasculature. Results: Freqformer substantially outperformed existing convolutional neural networks and Transformer-based methods, achieving superior image metrics. Importantly, the enhanced OCTA volumes show strong correlation with the merged volumes on vascular segment count, density, length, and flow index, further underscoring its reliability for quantitative vascular analysis. 3-D counterparts did not yield additional gains in image metrics or downstream 3-D vascular quantification but incurred nearly an order-of-magnitude longer inference time, supporting our 2-D slice-wise enhancement strategy. Additionally, Freqformer showed excellent generalization capability on larger field-of-view scans, surpassing the quality of conventional volumetric merging methods. Conclusion: Freqformer reliably generates high-definition 3-D retinal microvasculature from single-scan OCTA, enabling precise vascular quantification comparable to standard volumetric merging methods.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 43 references that are in the map. First posted on arXiv 17 Nov 2024.

Builds on

17 of 43 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  4. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  5. 2022Simple Baselines for Image Restorationcited by 708
  6. 2021XCiT: Cross-Covariance Image Transformerscited by 338
  7. 2022How Do Vision Transformers Work?cited by 307
  8. 2017Deep Complex Networkscited by 217
  9. 2013Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Indexcited by 195
  10. 2019Real Image Denoising with Feature Attentioncited by 176
  11. 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
  12. 2020Spatial-Adaptive Network for Single Image Denoisingcited by 64
5 more
  1. 2023Mimetic Initialization of Self-Attention Layerscited by 54
  2. 2023Xformer: Hybrid X-Shaped Transformer for Image Denoisingcited by 37
  3. 2020Reconstruction of high-resolution 6x6-mm OCT angiograms using deep learningcited by 7
  4. 2022Normalized Blood Flow Index in Optical Coherence Tomography Angiography Provides a Sensitive Biomarker of Early Diabetic Retinopathycited by 1
  5. 2023Frequency-aware optical coherence tomography image super-resolution via conditional generative adversarial neural networkcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.