mlsanityData to 7 Oct 2026

Fake It Right: Injecting Anatomical Logic into Synthetic Supervised Pre-training for Medical Segmentation

arXiv 2603.00979 ↗First posted 1 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision Transformers (ViTs) excel in 3D medical segmentation but require massive annotated datasets. While Self-Supervised Learning (SSL) mitigates this using unlabeled data, it still faces strict privacy and logistical barriers. Formula-Driven Supervised Learning (FDSL) offers a privacy-preserving alternative by pre-training on synthetic mathematical primitives. However, a critical semantic gap limits its efficacy: generic shapes lack the morphological fidelity, fixed spatial layouts, and inter-organ relationships of real anatomy, preventing models from learning essential global structural priors. To bridge this gap, we propose an Anatomy-Informed Synthetic Supervised Pre-training framework unifying FDSL's infinite scalability with anatomical realism. We replace basic primitives with a lightweight shape bank with de-identified, label-only segmentation masks from 5 subjects. Furthermore, we introduce a structure-aware sequential placement strategy to govern the patch synthesis process. Instead of random placement, we enforce physiological plausibility using spatial anchors for correct localization and a topological graph to manage inter-organ interactions (e.g., preventing impossible overlaps). Extensive experiments on BTCV and MSD datasets demonstrate that our method significantly outperforms state-of-the-art FDSL baselines and SSL methods by 1.74% and up to 1.66%, while exhibiting a robust scaling effect where performance improves with increased synthetic data volume. This provides a data-efficient, privacy-compliant solution for medical segmentation. The code will be made publicly available upon acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 18 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

14 of 18 references.

References · 14

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  4. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
  5. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  6. 2021The Medical Segmentation Decathloncited by 620
  7. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
  8. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
  9. 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
  10. 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 71
  11. 2023SwinMM: Masked Multi-view with Swin Transformers for 3D Medical Image Segmentationcited by 34
  12. 2023Visual Atoms: Pre-training Vision Transformers with Sinusoidal Wavescited by 20
2 more
  1. 2023Pre-training Vision Transformers with Very Limited Synthesized Imagescited by 12
  2. 2023SegRCDB: Semantic Segmentation via Formula-Driven Supervised Learningcited by 8

Built on by

Not cited yet.