Fourier-Based 3D Multistage Transformer for Aberration Correction in Multicellular Specimens
Not on the map. Why?
Abstract (arXiv)
High-resolution tissue imaging is often compromised by sample-induced optical aberrations that degrade resolution and contrast. While wavefront sensor-based adaptive optics (AO) can measure these aberrations, such hardware solutions are typically complex, expensive to implement, and slow when serially mapping spatially varying aberrations across large fields of view. Here, we introduce AOViFT (Adaptive Optical Vision Fourier Transformer) -- a machine learning-based aberration sensing framework built around a 3D multistage Vision Transformer that operates on Fourier domain embeddings. AOViFT infers aberrations and restores diffraction-limited performance in puncta-labeled specimens with substantially reduced computational cost, training time, and memory footprint compared to conventional architectures or real-space networks. We validated AOViFT on live gene-edited zebrafish embryos, demonstrating its ability to correct spatially varying aberrations using either a deformable mirror or post-acquisition deconvolution. By eliminating the need for the guide star and wavefront sensing hardware and simplifying the experimental workflow, AOViFT lowers technical barriers for high-resolution volumetric microscopy across diverse biological samples.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 40 references that are in the map. First posted on arXiv 16 Mar 2025.
Builds on
16 of 40 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2016Layer Normalizationcited by 5,669
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2016Deep Networks with Stochastic Depthcited by 979
- 2021Multiscale Vision Transformerscited by 897
4 more
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
- 2023Coordinate-based neural representations for computational adaptive optics in widefield microscopycited by 10
- 2023Universal adaptive optics for microscopy through embedded neural network controlcited by 3
Built on by
Not cited yet.