ImmuVis: Hyperconvolutional Foundation Model for Imaging Mass Cytometry
Not on the map. Why?
Abstract (arXiv)
We present ImmuVis, a family of efficient foundation models for imaging mass cytometry (IMC), a high-throughput multiplex imaging technology that handles molecular marker measurements as image channels and enables large-scale spatial tissue profiling. Unlike natural images, multiplex imaging lacks a fixed channel space, as real-world marker sets vary across studies, violating a core assumption of standard vision backbones. To address this, ImmuVis introduces marker-adaptive hyperconvolutions that generate convolutional kernels from learned marker embeddings, enabling a single model to operate on arbitrary measured marker subsets without retraining. We pretrain ImmuVis on the largest dataset to date, IMC17M (28 cohorts, 24,405 images, 265 markers, over 17M patches), using self-supervised masked reconstruction. ImmuVis outperforms state-of-the-art baselines and ablations in virtual staining and downstream classification tasks at substantially lower compute cost than transformer-based alternatives, and is the sole model that provides calibrated uncertainty via a heteroscedastic likelihood objective. These results position ImmuVis as a practical framework for real-world IMC modeling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 70 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
16 of 70 references.
References · 16
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016HyperNetworkscited by 1,003
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
- 2019Dynamic Convolution: Attention over Convolution Kernelscited by 355
- 2022On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networkscited by 119
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
- 2023A survey on efficient vision transformers: algorithms, techniques, and performance benchmarkingcited by 41
- 2022Uncertainty-Informed Deep Learning Models Enable High-Confidence Predictions for Digital Histopathologycited by 37
- 2022Faithful Heteroscedastic Regression with Neural Networkscited by 36
4 more
- 2023Channel Vision Transformers: An Image Is Worth 1 x 16 x 16 Wordscited by 33
- 2025A Foundation Model for Spatial Proteomicscited by 12
- 2024KernelWarehouse: Rethinking the Design of Dynamic Convolutioncited by 6
- 2025AI-powered virtual tissues from spatial proteomics for clinical diagnostics and biomedical discoverycited by 5
Built on by
Not cited yet.