mlsanityData to 13 Oct 2026

3D MRI Image Pretraining via Controllable 2D Slice Navigation Task

arXiv 2605.06487 ↗First posted 7 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised pretraining has become the mainstream approach for learning MRI representations from unlabeled scans. However, most existing objectives still treat each scan primarily as static aggregations of slices, patches or volumes. We ask whether there exists an intrinsic form of self-supervision signal that is different from reconstructing the masked patches, through transforming the 3D volumes into controllable 2D rendered sequences: by rendering slices at continuous positions, orientations, and scales, a 3D volume can be converted into dense video-action sequences whose controls are the action trajectories. We study this formulation with an action-conditioned pretraining objective, where a tokenizer encodes slice observations and a latent dynamics model predicts the evolution of latent features. Across representative anatomical and spatial downstream tasks, the proposed pretraining is evaluated against standard static-volume baselines, tokenizer-only pretraining, and dynamics variants without aligned actions. These results suggest that controllable MRI slice navigation provides a useful complementary pretraining interface for learning anatomical and spatial representations from large unlabeled MRI collections.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

16 of 27 references.

References · 16

  1. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 957
  2. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 769
  3. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 256
  4. 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
  5. 2025Training Agents Inside of Scalable World Modelscited by 131
  6. 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 108
  7. 2019Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Predictioncited by 70
  8. 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
  9. 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
  10. 2024Revisiting MAE pre-training for 3D medical image segmentationcited by 33
  11. 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planningcited by 33
  12. 2025A generalizable 3D framework and model for self-supervised learning in medical imagingcited by 27
4 more
  1. 2025CheXWorld: Exploring Image World Modeling for Radiograph Representation Learningcited by 18
  2. 2024Self-Supervised Learning for Medical Image Data with Anatomy-Oriented Imaging Planescited by 17
  3. 2024Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Modelcited by 15
  4. 2025From Generation to Generalization: Emergent Few-Shot Learning in Video Diffusion Modelscited by 7

Built on by

Not cited yet.