# Novel OCT mosaicking pipeline with Feature- and Pixel-based registration

arXiv: https://arxiv.org/abs/2311.13052 · HTML: https://mlsanity.com/paper/2311.13052/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 26 references that are in the map.
- First posted on arXiv 21 Nov 2023.

## Builds on (most cited first, 9 of 9)

- [Segment Anything](https://mlsanity.com/paper/2304.02643/) (2023)
- [SuperGlue: Learning Feature Matching with Graph Neural Networks](https://mlsanity.com/paper/1911.11763/) (2019)
- [SuperPoint: Self-Supervised Interest Point Detection and Description](https://mlsanity.com/paper/1712.07629/) (2017)
- [LoFTR: Detector-Free Local Feature Matching with Transformers](https://mlsanity.com/paper/2104.00680/) (2021)
- [LightGlue: Local Feature Matching at Light Speed](https://mlsanity.com/paper/2306.13643/) (2023)
- [OCTA-500: A Retinal Dataset for Optical Coherence Tomography Angiography Study](https://mlsanity.com/paper/2012.07261/) (2020)
- [Deep Placental Vessel Segmentation for Fetoscopic Mosaicking](https://mlsanity.com/paper/2007.04349/) (2020)
- [Assessing Test-time Variability for Interactive 3D Medical Image Segmentation with Diverse Point Prompts](https://mlsanity.com/paper/2311.07806/) (2023)
- [Deep Angiogram: Trivializing Retinal Vessel Segmentation](https://mlsanity.com/paper/2307.00245/) (2023)

## Built on by (most cited first, 5 of 5)

- [Retinal IPA: Iterative KeyPoints Alignment for Multimodal Retinal Imaging](https://mlsanity.com/paper/2407.18362/) (2024)
- [Interactive Segmentation Model for Placenta Segmentation from 3D Ultrasound images](https://mlsanity.com/paper/2407.08020/) (2024)
- [SynStitch: a Self-Supervised Learning Network for Ultrasound Image Stitching Using Synthetic Training Pairs and Indirect Supervision](https://mlsanity.com/paper/2411.06750/) (2024)
- [PRISM Lite: A lightweight model for interactive 3D placenta segmentation in ultrasound](https://mlsanity.com/paper/2408.05372/) (2024)
- [Fidelity-Imposed Displacement Editing for the Learn2Reg 2024 SHG-BF Challenge](https://mlsanity.com/paper/2410.20812/) (2024)

## Abstract (arXiv)

High-resolution Optical Coherence Tomography (OCT) images are crucial for ophthalmology studies but are limited by their relatively narrow field of view (FoV). Image mosaicking is a technique for aligning multiple overlapping images to obtain a larger FoV. Current mosaicking pipelines often struggle with substantial noise and considerable displacement between the input sub-fields. In this paper, we propose a versatile pipeline for stitching multi-view OCT/OCTA textiten face projection images. Our method combines the strengths of learning-based feature matching and robust pixel-based registration to align multiple images effectively. Furthermore, we advance the application of a trained foundational model, Segment Anything Model (SAM), to validate mosaicking results in an unsupervised manner. The efficacy of our pipeline is validated using an in-house dataset and a large public dataset, where our method shows superior performance in terms of both accuracy and computational efficiency. We also made our evaluation tool for image mosaicking and the corresponding pipeline publicly available at urlhttps://github.com/MedICL-VU/OCT-mosaicking.