mlsanityData to 7 Oct 2026

B-MIM: Biased Masked Image Modeling for Generalizable Segmentation of Fine-Grained Anatomical Structures

arXiv 2608.24364 ↗First posted 25 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised pretraining enables transferable representations for medical imaging, yet most CT encoders remain biased toward coarse semantic understanding, limiting their sensitivity to fine-grained anatomical structures such as vessels or small tumors. In this paper, we introduce Biased Masked Image Modeling (B-MIM), a modification of the iBOT objective that stochastically reduces global semantic alignment to prioritize local patch reconstruction. This bias encourages the encoder to capture high-frequency morphological details and structural continuity. We curate a multi-institutional CT abdominal dataset of 9,955 filtered studies from 17 public sources and pretrain a 3D Swin Transformer backbone using B-MIM. Across inter-dataset experiments on liver vessel segmentation, the proposed encoder improves topological fidelity (clDice) and achieves competitive Dice scores in tumor segmentation, compared to fully fine-tuned baselines, despite updating only a fraction of the parameters. Our results suggest that reducing global semantic pressure during pretraining enhances generalization to intricate anatomical structures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

17 of 24 references.

References · 17

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  7. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  8. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
  9. 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
  10. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
  11. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 147
  12. 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
5 more
  1. 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 71
  2. 2021How I failed machine learning in medical imaging -- shortcomings and recommendationscited by 37
  3. 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 34
  4. 2024Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learningcited by 18
  5. 2025UKBOB: One Billion MRI Labeled Masks for Generalizable 3D Medical Image Segmentationcited by 4

Built on by

Not cited yet.