Registration is a Representation Problem: Solving Whole-Body PET/CT Registration
Not on the map. Why?
Abstract (arXiv)
Raw image intensities are a poor surrogate for similarity across images in correspondence problems. Further, while auxiliary segmentation labels can provide semantic identification and improve matching, they can assign only coarse identities to fine-grained anatomy and often cover only a subset of structures, particularly in whole-body settings. We present an approach that instead establishes correspondence using complementary representations of anatomy and demonstrate its utility for longitudinal whole-body PET/CT registration in the Learn2Reg 2026 PSMAReg Challenge. Our 3D foundation model, anatomix, is used to derive fine-grained, per-voxel semantic representations that are consistent across volumes, and we further employ off-the-shelf segmentation models to obtain coarse anatomical identities. Together, these representations drive a GPU-accelerated iterative registration solver (FireANTs) in a hybrid multistage framework: the first stage estimates alignment from dense multi-channel features, after which a second refines the deformation using both anatomix- and segmentation-based losses. Lastly, because registration should not introduce non-biological tumor volume changes across time, we develop lesion-specific component-wise volume preservation schemes. Without any task-specific training, our system won first place in the PSMAReg Challenge leaderboard. Code and interactive visualizations are available at http://www.neeldey.com/reps-for-reg.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
10 of 26 references.
References · 10
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
- 2020SynthMorph: learning contrast-invariant registration without acquired imagescited by 140
- 2024uniGradICON: A Foundation Model for Medical Image Registrationcited by 58
- 2024Learning General-Purpose Biomedical Volume Representations using Randomized Synthesiscited by 29
- 2022On Finite Difference Jacobian Computation in Deformable Image Registrationcited by 23
- 2024Deep Learning in Medical Image Registration: Magic or Mirage?cited by 21
- 2025PolyPose: Deformable 2D/3D Registration via Polyrigid Transformationscited by 2
- 2025A Scalable Distributed Framework for Multimodal GigaVoxel Image Registrationcited by 1
Built on by
Not cited yet.