# FM-OSD: Foundation Model-Enabled One-Shot Detection of Anatomical Landmarks

arXiv: https://arxiv.org/abs/2407.05412 · HTML: https://mlsanity.com/paper/2407.05412/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 27 references that are in the map.
- First posted on arXiv 7 Jul 2024.

## Builds on (most cited first, 17 of 17)

- [Segment Anything](https://mlsanity.com/paper/2304.02643/) (2023)
- [DINOv2: Learning Robust Visual Features without Supervision](https://mlsanity.com/paper/2304.07193/) (2023)
- [Emerging Properties in Self-Supervised Vision Transformers](https://mlsanity.com/paper/2104.14294/) (2021)
- [Deep ViT Features as Dense Visual Descriptors](https://mlsanity.com/paper/2112.05814/) (2021)
- [Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imaging](https://mlsanity.com/paper/2304.04155/) (2023)
- [Integrating Spatial Configuration into Heatmap Regression Based CNNs for Landmark Localization](https://mlsanity.com/paper/1908.00748/) (2019)
- [SAM: Self-supervised Learning of Pixel-wise Anatomical Embeddings in Radiological Images](https://mlsanity.com/paper/2012.02383/) (2020)
- [One-Shot Medical Landmark Detection](https://mlsanity.com/paper/2103.04527/) (2021)
- [You Only Learn Once: Universal Anatomical Landmark Detection](https://mlsanity.com/paper/2103.04657/) (2021)
- [X-ray-transform Invariant Anatomical Landmark Detection for Pelvic Trauma Surgery](https://mlsanity.com/paper/1803.08608/) (2018)
- [Which images to label for few-shot medical landmark detection?](https://mlsanity.com/paper/2112.04386/) (2021)
- [One-shot Localization and Segmentation of Medical Images with Foundation Models](https://mlsanity.com/paper/2310.18642/) (2023)
- [SHaRPose: Sparse High-Resolution Representation for Human Pose Estimation](https://mlsanity.com/paper/2312.10758/) (2023)
- [UOD: Universal One-shot Detection of Anatomical Landmarks](https://mlsanity.com/paper/2306.07615/) (2023)
- [One-Shot Medical Landmark Localization by Edge-Guided Transform and Noisy Landmark Refinement](https://mlsanity.com/paper/2208.00453/) (2022)
- [Learn Fine-grained Adaptive Loss for Multiple Anatomical Landmark Detection in Medical Images](https://mlsanity.com/paper/2105.09124/) (2021)
- [Structure-Guided Self-Supervised Matching for One-Shot Medical Landmark Detection](https://mlsanity.com/paper/2203.01687/) (2022)

## Built on by (most cited first, 4 of 4)

- [Self-supervised pre-training with diffusion model for few-shot landmark detection in x-ray images](https://mlsanity.com/paper/2407.18125/) (2024)
- [Geometric-Guided Few-Shot Dental Landmark Detection with Human-Centric Foundation Model](https://mlsanity.com/paper/2507.04710/) (2025)
- [MedSapiens: Taking a Pose to Rethink Medical Imaging Landmark Detection](https://mlsanity.com/paper/2511.04255/) (2025)
- [Landmarks Are Alike Yet Distinct: Harnessing Similarity and Individuality for One-Shot Medical Landmark Detection](https://mlsanity.com/paper/2503.16058/) (2025)

## Abstract (arXiv)

One-shot detection of anatomical landmarks is gaining significant attention for its efficiency in using minimal labeled data to produce promising results. However, the success of current methods heavily relies on the employment of extensive unlabeled data to pre-train an effective feature extractor, which limits their applicability in scenarios where a substantial amount of unlabeled data is unavailable. In this paper, we propose the first foundation model-enabled one-shot landmark detection (FM-OSD) framework for accurate landmark detection in medical images by utilizing solely a single template image without any additional unlabeled data. Specifically, we use the frozen image encoder of visual foundation models as the feature extractor, and introduce dual-branch global and local feature decoders to increase the resolution of extracted features in a coarse to fine manner. The introduced feature decoders are efficiently trained with a distance-aware similarity learning loss to incorporate domain knowledge from the single template image. Moreover, a novel bidirectional matching strategy is developed to improve both robustness and accuracy of landmark detection in the case of scattered similarity map obtained by foundation models. We validate our method on two public anatomical landmark detection datasets. By using solely a single template image, our method demonstrates significant superiority over strong state-of-the-art one-shot landmark detection methods.