Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathology
Not on the map. Why?
Abstract (arXiv)
In computational pathology (CPath), developing omni-modal self-supervised learning (SSL) models that integrate histology, genomics, and clinical reports enables transferable representation learning for whole slide images (WSIs). Existing approaches implicitly force heterogeneous modalities into a uniform latent space by contrastive alignment, causing modality collapse where unique, synergistic diagnostic signals (termed as Phi) are discarded in favor of trivial redundancy. We hypothesize that the strongest task-agnostic SSL training signal stems from distilling the synergistic interactions over merely aligning shared redundancy. To this end, we introduce textscPhi-Omni, a synergistic information disentanglement framework grounded in Partial Information Decomposition (PID) theory for slide representation learning. Unlike standard contrastive approaches, textscPhi-Omni employs a Synergistic Information Bottleneck (SIB) regulated by the proposed PhiID objective, which explicitly suppresses marginal redundancy while maximizing irreducible synergy, thereby distilling high-order cross-modal interactions. Following pretraining on breast (n=1031) and lung (n=919) cohorts, textscPhi-Omni demonstrates superior few-shot performance across five independent external datasets spanning eight tasks compared to supervised and SSL baselines. Source code is available here.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
18 of 29 references.
References · 18
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2025Accelerating Data Processing and Benchmarking of AI Models for Pathologycited by 65
- 2024A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Modelcited by 59
- 2024Transcriptomics-guided Slide Representation Learning in Computational Pathologycited by 51
- 2024Multistain Pretraining for Slide Representation Learning in Pathologycited by 28
- 2023Gaussian Partial Information Decomposition: Bias Correction and Application to High-dimensional Datacited by 17
- 2024Unsupervised Foundation Model-Agnostic Slide-Level Representation Learningcited by 15
- 2021Disentanglement Analysis with Partial Information Decompositioncited by 9
- 2023MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Featurescited by 8
6 more
- 2024HoneyBee: A Scalable Modular Framework for Creating Multimodal Oncology Datasets with Foundational Embedding Modelscited by 6
- 2024Unleashing the Infinity Power of Geometry: A Novel Geometry-Aware Transformer (GOAT) for Whole Slide Histopathology Image Analysiscited by 3
- 2025MIRROR: Multi-Modal Pathological Self-Supervised Representation Learning via Modality Alignment and Retentioncited by 3
- 2025MurreNet: Modeling Holistic Multimodal Interactions Between Histopathology and Genomic Profiles for Survival Predictioncited by 3
- 2017Disentangled Representations via Synergy Minimizationcited by 2
- 2025BioX-CPath: Biologically-driven Explainable Diagnostics for Multistain IHC Computational Pathologycited by 1
Built on by
Not cited yet.