mlsanityData to 13 Oct 2026

AEGIS: A Multi-Task Joint-Embedding Predictive Architecture for Mammography

arXiv 2607.00277 ↗First posted 30 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present Aegis, a joint-embedding predictive architecture for breast cancer detection and density assessment in mammography. We train three Vision Transformer variants (Small/Base/Large) using self-supervised joint-embedding predictive architecture (JEPA) pre-training on 71,103 studies from 14 clinical sites, followed by supervised fine-tuning with progressive resolution scaling up to 2048x1536. On a curated 785-study test set, our largest model achieves area under the receiver operating characteristic curve (AUC) 0.949 for breast cancer triage with 93% sensitivity and 75% specificity at the optimal operating point. An ensemble combining our model with a U.S. Food and Drug Administration-cleared baseline further improves discrimination to 0.952 AUC. For breast density classification, the model achieves 0.953 AUC for binary (dense vs. non-dense) classification and 62.6% exact accuracy across four Breast Imaging Reporting and Data System (BI-RADS) categories, with 98.8% adjacent accuracy comparable to reported human inter-reader agreement. External validation on the public VinDr-Mammo dataset provides evidence of cross-population transfer under a different reference standard, with the largest model achieving 0.871 AUC for triage in a zero-shot setting.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

26 of 43 references.

References · 26

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,915
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,730
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,628
  9. 2020Training data-efficient image transformers & distillation through attentioncited by 4,574
  10. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,368
  11. 2020GLU Variants Improve Transformercited by 1,759
  12. 2019Root Mean Square Layer Normalizationcited by 1,449
14 more
  1. 2025DINOv3cited by 1,355
  2. 2019Objects as Pointscited by 1,173
  3. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,018
  4. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 895
  5. 2023Vision Transformers Need Registerscited by 850
  6. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 514
  7. 2021Escaping the Big Data Paradigm with Compact Transformerscited by 263
  8. 2022Transformers in Medical Imaging: A Surveycited by 245
  9. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 243
  10. 2022VinDr-Mammo: A large-scale benchmark dataset for computer-aided diagnosis in full-field digital mammographycited by 83
  11. 2025Cluster and Predict Latent Patches for Improved Masked Image Modelingcited by 17
  12. 2024MamT4: Multi-view Attention Networks for Mammography Cancer Classificationcited by 1
  13. 2025Optimizing Breast Cancer Detection in Mammograms: A Comprehensive Study of Transfer Learning, Resolution Reduction, and Multi-View Classificationcited by 1
  14. 2025T-SYNTH: A Knowledge-Based Dataset of Synthetic Breast Imagescited by 1

Built on by

Not cited yet.