# VerteNet -- A Multi-Context Hybrid CNN Transformer for Accurate Vertebral Landmark Localization in Lateral Spine DXA Images

arXiv: https://arxiv.org/abs/2502.02097 · HTML: https://mlsanity.com/paper/2502.02097/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 14 of its 39 references that are in the map.
- First posted on arXiv 4 Feb 2025.

## Builds on (most cited first, 14 of 14)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Restormer: Efficient Transformer for High-Resolution Image Restoration](https://mlsanity.com/paper/2111.09881/) (2021)
- [Deep High-Resolution Representation Learning for Human Pose Estimation](https://mlsanity.com/paper/1902.09212/) (2019)
- [EfficientNetV2: Smaller Models and Faster Training](https://mlsanity.com/paper/2104.00298/) (2021)
- [Vision Transformer with Deformable Attention](https://mlsanity.com/paper/2201.00520/) (2022)
- [Dual Aggregation Transformer for Image Super-Resolution](https://mlsanity.com/paper/2308.03364/) (2023)
- [Fast Vision Transformers with HiLo Attention](https://mlsanity.com/paper/2205.13213/) (2022)
- [Integrating Spatial Configuration into Heatmap Regression Based CNNs for Landmark Localization](https://mlsanity.com/paper/1908.00748/) (2019)
- [A Recent Survey of Vision Transformers for Medical Image Segmentation](https://mlsanity.com/paper/2312.00634/) (2023)
- [Automatic Vertebra Labeling in Large-Scale 3D CT using Deep Image-to-Image Network with Message Passing and Sparsity Regularization](https://mlsanity.com/paper/1705.05998/) (2017)
- [Vertebra-Focused Landmark Detection for Scoliosis Assessment](https://mlsanity.com/paper/2001.03187/) (2020)
- [SCOL: Supervised Contrastive Ordinal Loss for Abdominal Aortic Calcification Scoring on Vertebral Fracture Assessment Scans](https://mlsanity.com/paper/2307.12006/) (2023)

## Abstract (arXiv)

Vertebral Landmarks Localization in Dual-Energy X-ray Absorptiometry based Lateral Spine Imaging plays a critical role in evaluating spinal alignment, Vertebral Fracture Assessment, and facilitating intervertebral guide placement for Abdominal Aortic Calcification quantification. While lateral spine DXA scans offer advantages such as reduced cost and lower radiation exposure, its analysis remains challenging due to a low signal-to-noise ratio and imaging artifacts. Artificial Intelligence presents a promising approach for improving the precision and accuracy of VLL. In this study, we introduce a novel architecture that employs dual-resolution attention mechanisms to capture both fine-grained local details and broader contextual information. Our approach enhances feature integration by leveraging skip connections and decoder layers through dual-resolution self-attention and cross-attention mechanisms. This design improves the ability of the model to learn complex patterns, enabling precise vertebral corner localization while maintaining both local and global contextual awareness. We evaluated the proposed framework on DXA LSI images acquired from multiple machines and found that it outperforms recent state-of-the-art architectures for VLL, achieving a normalized mean error of 4.92 and a normalized median error of 2.35. The proposed framework, VerteNet, enables highly accurate VLL in DXA LSI images from diverse acquisition systems and demonstrates strong robustness to low signal-to-noise ratios, owing to its enhanced ability to capture both fine-grained local details and broader contextual information.