mlsanityData to 14 Oct 2026

LatentVerse: A Framework for Understanding Shared and Modality-Specific Information in Multimodal Latent Representations

arXiv 2609.12364 ↗First posted 11 Sep 2026cs.LG cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Latent embeddings have become a central data abstraction in modern machine learning, especially in biomedicine, where foundation models are increasingly used to encode multimodal data like clinical text, medical images, omics, and physiological signals. However, the utility and value of these representations depends on understanding their quality, structure, and the information they encode. Existing analysis workflows for evaluating representations remain fragmented across custom scripts, isolated metrics, and most importantly lack multimodal analysis, limiting accessibility and reproducibility. We present LatentVerse, a representation analysis resource that combines a web-based visual analytics platform for accessible, report-driven exploration with a command-line interface for scalable technical workflows. LatentVerse unifies diagnostics for various representation quality metrics and extends to multimodal settings by decomposing embeddings into shared and modality-specific components. We evaluate LatentVerse through controlled unimodal and multimodal simulations, discovery-oriented analyses on real biomedical embeddings, and a user study across diverse use cases. By supporting thorough and interpretable evaluation of latent spaces, LatentVerse makes foundation model representations more understandable in biomedical and data science applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 37 references that are in the map. First posted on arXiv 11 Sep 2026.

Builds on

13 of 37 references.

References · 13

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
  3. 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
  4. 2021LogME: Practical Assessment of Pre-trained Models for Transfer Learningcited by 172
  5. 2016Embedding Projector: Interactive Visualization and Interpretation of Embeddingscited by 44
  6. 2018Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Datacited by 35
  7. 2023WizMap: Scalable Interactive Visualization for Exploring Large Machine Learning Embeddingscited by 28
  8. 2022Emblaze: Illuminating Machine Learning Representations through Interactive Comparison of Embedding Spacescited by 16
  9. 2024An Information Criterion for Controlled Disentanglement of Multimodal Datacited by 14
  10. 2025Embedding Atlas: Low-Friction, Interactive Embedding Visualizationcited by 7
  11. 2023Latent Space Explorer: Visual Analytics for Multimodal Latent Space Explorationcited by 3
  12. 2025Embedding-Based Federated Data Sharing via Differentially Private Conditional VAEscited by 2
1 more
  1. 2026MultiLoReFT: Decoupling Shared and Modality-Specific Subspaces in Multimodal Learning via Low-Rank Representation Fine-Tuningcited by 1

Built on by

Not cited yet.