Brain-ID: Learning Contrast-agnostic Anatomical Representations for Brain Imaging
Not on the map. Why?
Abstract (arXiv)
Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where performance is highly sensitive to the differences in MR contrast, resolution, and orientation. This prevents broad applicability to diverse real-world clinical protocols. We introduce Brain-ID, an anatomical representation learning model for brain imaging. With the proposed "mild-to-severe" intra-subject generation, Brain-ID is robust to the subject-specific brain anatomy regardless of the appearance of acquired images (e.g., contrast, deformation, resolution, artifacts). Trained entirely on synthetic data, Brain-ID readily adapts to various downstream tasks through only one layer. We present new metrics to validate the intra- and inter-subject robustness of Brain-ID features, and evaluate their performance on four downstream applications, covering contrast-independent (anatomy reconstruction/contrast synthesis, brain segmentation), and contrast-dependent (super-resolution, bias field estimation) tasks. Extensive experiments on six public datasets demonstrate that Brain-ID achieves state-of-the-art performance in all tasks on different MRI modalities and CT, and more importantly, preserves its performance on low-resolution and small datasets. Code is available at https://github.com/peirong26/Brain-ID.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 31 of its 62 references that are in the map. First posted on arXiv 28 Nov 2023.
Builds on
31 of 62 references.
References · 31
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2018Deep Visual Domain Adaptation: A Surveycited by 635
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2023Towards Generalist Biomedical AIcited by 289
19 more
- 2016Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentationcited by 263
- 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 237
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2020SynthMorph: learning contrast-invariant registration without acquired imagescited by 140
- 2022SynthStrip: Skull-Stripping for Any Brain Imagecited by 127
- 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
- 2019FastSurfer -- A fast and accurate deep learning based neuroimaging pipelinecited by 112
- 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 110
- 2020Local Temperature Scaling for Probability Calibrationcited by 95
- 2020SAM: Self-supervised Learning of Pixel-wise Anatomical Embeddings in Radiological Imagescited by 67
- 2022Robust machine learning segmentation for large-scale analysis of heterogeneous clinical brain MRI datasetscited by 51
- 2021Momentum Contrastive Voxel-wise Representation Learning for Semi-supervised Volumetric Medical Image Segmentationcited by 49
- 2020Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrastcited by 45
- 2021Accurate Point Cloud Registration with Robust Optimal Transportcited by 38
- 2020A Contrast-Adaptive Method for Simultaneous Whole-Brain and Lesion Segmentation in Multiple Sclerosiscited by 17
- 2023SAMConvex: Fast Discrete Optimization for CT Registration using Self-supervised Anatomical Embedding and Correlation Pyramidcited by 14
- 2020Discovering Hidden Physics Behind Transport Dynamicscited by 8
- 2021Deep Decomposition for Stochastic Normal-Abnormal Transportcited by 4
- 2021Differential Motion Evolution for Fine-Grained Motion Deformation in Unsupervised Image Animationcited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 6; 2026: 3.
11 papers.
- 2025Conditional diffusion models for guided anomaly detection in brain images using fluid-driven anomaly randomizationcited by 6
- 2025Unraveling Normal Anatomy via Fluid-Driven Anomaly Randomizationcited by 4
- 2024Evaluating Synthetic Data Generation for Domain Generalization in Fetal Brain MRI Segmentationcited by 3
- 2025USB: Unified Synthetic Brain Framework for Bidirectional Pathology-Healthy Generation and Editingcited by 1
- 2024MS-Glance: Bio-Insipred Non-semantic Context Vectors and their Applications in Supervising Image Reconstructioncited by 0
- 2025Reference-Free 3D Reconstruction of Brain Dissection Slabs via Learned Atlas Coordinatescited by 0
- 2025BioVFM-21M: Benchmarking and Scaling Self-Supervised Vision Foundation Models for Biomedical Image Analysiscited by 0
- 2025Learning to Upscale 3D Segmentations in Neuroimagingcited by 0
- 2026Bridging Modalities: Joint Synthesis and Registration Framework for Aligning Diffusion MRI with T1-Weighted Imagescited by 0
- 2026Adapting Frozen Mono-modal Backbones for Multi-modal Registration via Contrast-Agnostic Instance Optimizationcited by 0
- 2026dMRI-F: A Foundation Model for Generalizable Diffusion MRI Analysis from Sparse Acquisitionscited by 0
- 2026dMRI-F: A Foundation Model for Generalizable Diffusion MRI Analysis from Sparse Acquisitions13 Oct 2026
- 2026Adapting Frozen Mono-modal Backbones for Multi-modal Registration via Contrast-Agnostic Instance Optimization27 Mar 2026
- 2026Bridging Modalities: Joint Synthesis and Registration Framework for Aligning Diffusion MRI with T1-Weighted Images16 Jan 2026
- 2025USB: Unified Synthetic Brain Framework for Bidirectional Pathology-Healthy Generation and Editing29 Nov 2025
- 2025Conditional diffusion models for guided anomaly detection in brain images using fluid-driven anomaly randomization11 Jun 2025
- 2025Learning to Upscale 3D Segmentations in Neuroimaging27 May 2025
- 2025BioVFM-21M: Benchmarking and Scaling Self-Supervised Vision Foundation Models for Biomedical Image Analysis14 May 2025
- 2025Reference-Free 3D Reconstruction of Brain Dissection Slabs via Learned Atlas Coordinates13 Mar 2025
- 2025Unraveling Normal Anatomy via Fluid-Driven Anomaly Randomization23 Jan 2025
- 2024Evaluating Synthetic Data Generation for Domain Generalization in Fetal Brain MRI Segmentation11 Nov 2024
- 2024MS-Glance: Bio-Insipred Non-semantic Context Vectors and their Applications in Supervising Image Reconstruction31 Oct 2024