Bridging MRI and PET physiology: Untangling complementarity through orthogonal representations
Not on the map. Why?
Abstract (arXiv)
Multimodal imaging analysis often relies on joint latent representations, yet these approaches rarely define what information is shared versus modality-specific. Clarifying this distinction is clinically relevant, as it delineates the irreducible contribution of each modality and informs rational acquisition strategies. We propose a subspace decomposition framework that reframes multimodal fusion as a problem of orthogonal subspace separation rather than translation. We decompose Prostate-Specific Membrane Antigen (PSMA) PET uptake into an MRI-explainable physiological envelope and an orthogonal residual reflecting signal components not expressible within the MRI feature manifold. Using multiparametric MRI, we train an intensity-based, non-spatial implicit neural representation (INR) to map MRI feature vectors to PET uptake. We introduce a projection-based regularization using singular value decomposition to penalize residual components lying within the span of the MRI feature manifold. This enforces mathematical orthogonality between tissue-level physiological properties (structure, diffusion, perfusion) and intracellular PSMA expression. Tested on 13 prostate cancer patients, the model demonstrates that residual components spanned by MRI features are absorbed into the learned envelope, while the orthogonal residual is largest in tumour regions. This indicates that PSMA PET contains signal components not recoverable from MRI-derived physiological descriptors. The resulting decomposition provides a structured characterization of modality complementarity grounded in representation geometry rather than image translation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 18 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
10 of 18 references.
References · 10
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
- 2016Domain Separation Networkscited by 320
- 2016HeMIS: Hetero-Modal Image Segmentationcited by 103
- 2023Implicit Neural Representation in Medical Imaging: A Comparative Surveycited by 90
- 2024Robust Multimodal Learning via Representation Decouplingcited by 17
- 2024From FDG to PSMA: A Hitchhiker's Guide to Multitracer, Multicenter Lesion Segmentation in PET/CT Imagingcited by 16
- 2025Implicit neural representations for end-to-end PET reconstructioncited by 2
- 2025Physiological neural representation for personalised tracer kinetic parameter estimation from dynamic PETcited by 2
Built on by
Not cited yet.