mlsanityData to 14 Oct 2026

Universal CT Representations from Anatomy to Disease Phenotype through Agglomerative Pretraining

arXiv 2605.21906 ↗First posted 21 May 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Computed tomography (CT) is a central to three-dimensional medical imaging, yet CT-based artificial intelligence remains fragmented across task-specific models for segmentation, classification, registration, and report analysis. Here we present FlexiCT, a family of CT foundation models trained by agglomerative continual pretraining on 266,227 CT volumes from 56 publicly available datasets, forming a large-scale public resource for CT representation learning. FlexiCT uses agglomerative pretraining across three stages: two-dimensional axial pretraining, three-dimensional anatomical pretraining and report-guided semantic alignment. This training strategy supports slice-level, volume-level and vision-language analysis. Across five downstream task families (segmentation, classification, registration, vision-language understanding and clinical retrieval), FlexiCT matches or exceeds prior task-specific approaches on multiple benchmarks. Its embeddings further organize CT scans along gradients associated with various tumor stages, suggesting that CT foundation models can capture imaging features relevant to disease phenotype characterization. Project page and code are available at: https://ricklisz.github.io/flexict.github.io and https://github.com/ricklisz/FlexiCT.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 50 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

28 of 50 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2025DINOv3cited by 1,414
  7. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  8. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
  9. 2023Vision Transformers Need Registerscited by 871
  10. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
  11. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
  12. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
16 more
  1. 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
  2. 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 351
  3. 2016Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challengecited by 201
  4. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 199
  5. 2019The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 Challengecited by 190
  6. 2022FlexiViT: One Model for All Patch Sizescited by 152
  7. 2024Merlin: A Computed Tomography Vision-Language Foundation Model and Datasetcited by 102
  8. 2025Vision Foundation Models for Computed Tomographycited by 47
  9. 2024TIPS: Text-Image Pretraining with Spatial awarenesscited by 37
  10. 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 36
  11. 2021COVID-Net CT-2: Enhanced Deep Neural Networks for Detection of COVID-19 from Chest CT Images Through Bigger, More Diverse Learningcited by 29
  12. 2025Primus: Enforcing Attention Usage for 3D Medical Image Segmentationcited by 24
  13. 2024Automatic Organ and Pan-cancer Segmentation in Abdomen CT: the FLARE 2023 Challengecited by 23
  14. 2025Comprehensive language-image pre-training for 3D medical image understandingcited by 22
  15. 2025Curia: A Multi-Modal Foundation Model for Radiologycited by 15
  16. 2025Scaling Self-Supervised and Cross-Modal Pretraining for Volumetric CT Transformerscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.