mlsanityData to 7 Oct 2026

Hierarchical Attention for Sparse Volumetric Anomaly Detection in Subclinical Keratoconus

arXiv 2512.03346 ↗First posted 3 Dec 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The detection of weak, spatially distributed anomalies in volumetric medical imaging remains challenging due to the difficulty of integrating subtle signals across non-adjacent regions. This study presents a controlled comparison of sixteen architectures spanning convolutional, hybrid, and transformer families for subclinical keratoconus detection from three-dimensional anterior segment optical coherence tomography (AS-OCT). The results demonstrate that hierarchical architectures achieve 21-23% higher sensitivity and specificity, particularly in the difficult subclinical regime, outperforming both convolutional neural networks (CNNs) and global-attention Vision Transformer (ViT) baselines. Mechanistic analyses indicate that this advantage arises from spatial scale alignment: hierarchical windowing produces effective receptive fields matched to the intermediate extent of subclinical abnormalities, avoiding the excessive locality observed in convolutional models and the diffuse integration characteristic of pure global attention. Attention-distance measurements show that subclinical cases require longer spatial integration than healthy or overtly pathological volumes, with hierarchical models exhibiting lower variance and more anatomically coherent focus. Representational similarity further indicates that hierarchical attention learns a distinct feature space that balances local structure sensitivity with flexible long-range interactions. Auxiliary age and sex prediction tasks demonstrate moderately high cross-task consistency, supporting the generalizability of these inductive principles. The findings provide design guidance for volumetric anomaly detection and highlight hierarchical attention as a principled approach for early pathological change analysis in medical imaging.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 53 references that are in the map. First posted on arXiv 3 Dec 2025.

Builds on

24 of 53 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  5. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  6. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  7. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  8. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  9. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  10. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
  11. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
  12. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
12 more
  1. 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 549
  2. 2015Towards Open Set Deep Networkscited by 533
  3. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
  4. 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
  5. 2021When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentationscited by 259
  6. 2017Generative OpenMax for Multi-Class Open Set Classificationcited by 157
  7. 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
  8. 2018Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Imagescited by 146
  9. 2014A New 2.5D Representation for Lymph Node Detection using Random Sets of Deep Convolutional Neural Network Observationscited by 56
  10. 2018GeoDesc: Learning Local Descriptors by Integrating Geometry Constraintscited by 52
  11. 2020Spatial Context-Aware Self-Attention Model For Multi-Organ Segmentationcited by 16
  12. 2021Transformed CNNs: recasting pre-trained convolutional layers with self-attentioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.