mlsanityData to 7 Oct 2026

Modality-Invariant Coarse-to-Fine Retinal Image Registration

arXiv 2608.14829 ↗First posted 14 Aug 2026eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Retinal image registration is essential for ophthalmic diagnosis, longitudinal disease monitoring, and multimodal retinal image analysis. Existing retinal registration methods are typically modality-dependent: they are designed or optimized either for a single imaging modality in mono-modal registration or for a fixed pair of modalities in cross-modal registration. This limits their flexibility and applicability in practical scenarios involving diverse retinal imaging modalities and different combinations of them. In this work, we propose a generalizable two-stage, modality-invariant framework for retinal image registration. First, we introduce a sparse feature-matching model driven by a universal retinal vessel segmentation to achieve robust coarse global alignment across modalities. Second, we develop a modality-invariant optical flow estimation network, termed MI-RAFT, to refine the alignment through dense local registration. Extensive experiments demonstrate that the proposed method can handle diverse combinations of commonly used retinal imaging modalities, exhibiting strong modality invariance while outperforming state-of-the-art modality-dependent registration methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 47 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

21 of 47 references.

References · 21

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  3. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  4. 2015Spatial Transformer Networkscited by 1,423
  5. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  6. 2025DINOv3cited by 1,297
  7. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  8. 2023Emergent Correspondence from Image Diffusioncited by 437
  9. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
  10. 2017Learning to Find Good Correspondencescited by 176
  11. 2024MINIMA: Modality Invariant Image Matchingcited by 44
  12. 2022Semi-Supervised Keypoint Detector and Descriptor for Retinal Image Matchingcited by 27
9 more
  1. 2024RetinaRegNet: A Zero-Shot Approach for Retinal Image Registrationcited by 7
  2. 2024Progressive Retinal Image Registration via Global and Local Deformable Transformationscited by 6
  3. 2025MIFNet: Learning Modality-Invariant Features for Generalizable Multimodal Image Matchingcited by 6
  4. 2025GDROS: A Geometry-Guided Dense Registration Framework for Optical-SAR Images under Large Geometric Transformationscited by 4
  5. 2024Medical Image Registration and Its Application in Retinal Images: A Reviewcited by 3
  6. 2025Universal Vessel Segmentation for Multi-Modality Retinal Imagescited by 3
  7. 2026CRFT: Consistent-Recurrent Feature Flow Transformer for Cross-Modal Image Registrationcited by 3
  8. 2025Rethinking Unsupervised Cross-modal Flow Estimation: Learning from Decoupled Optimization and Consistency Constraintcited by 1
  9. 2026Establishing Robust Retinal Eye Tracking: A Weakly Supervised Algorithmic Frameworkcited by 1

Built on by

Not cited yet.