PlaneCycle: Training-Free 2D-to-3D Lifting of Foundation Models Without Adapters
Not on the map. Why?
Abstract (arXiv)
Large-scale 2D foundation models exhibit strong transferable representations, yet extending them to 3D volumetric data typically requires retraining, adapters, or architectural redesign. We introduce PlaneCycle, a training-free, adapter-free operator for architecture-agnostic 2D-to-3D lifting of foundation models. PlaneCycle reuses the original pretrained 2D backbone by cyclically distributing spatial aggregation across orthogonal HW, DW, and DH planes throughout network depth, enabling progressive 3D fusion while preserving pretrained inductive biases. The method introduces no additional parameters and is applicable to arbitrary 2D networks. Using pretrained DINOv3 models, we evaluate PlaneCycle on six 3D classification and three 3D segmentation benchmarks. Without any training, the lifted models exhibit intrinsic 3D fusion capability and, under linear probing, outperform slice-wise 2D baselines and strong 3D counterparts, approaching the performance of fully trained models. With full fine-tuning, PlaneCycle matches standard 3D architectures, highlighting its potential as a seamless and practical 2D-to-3D lifting operator. These results demonstrate that 3D capability can be unlocked from pretrained 2D foundation models without structural modification or retraining. Code is available at https://github.com/HINTLab/PlaneCycle.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
25 of 35 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2025DINOv3cited by 1,297
- 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 682
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 504
13 more
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 485
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 310
- 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 235
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2019Evaluation of Algorithms for Multi-Modality Whole Heart Segmentation: An Open-Access Grand Challengecited by 100
- 2025VideoRoPE: What Makes for Good Video Rotary Position Embedding?cited by 63
- 2020IntrA: 3D Intracranial Aneurysm Dataset for Deep Learningcited by 41
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 34
- 2025MedDINOv3: How to adapt vision foundation models for medical image segmentation?cited by 25
- 2025Primus: Enforcing Attention Usage for 3D Medical Image Segmentationcited by 22
- 2021Asymmetric 3D Context Fusion for Universal Lesion Detectioncited by 14
- 2025Revisiting 2D Foundation Models for Scalable 3D Medical Image Classificationcited by 9
- 2025MedNeXt-v2: Scaling 3D ConvNeXts for Large-Scale Supervised Representation Learning in Medical Image Segmentationcited by 5
Built on by
Not cited yet.