Transformer-based normative modelling for anomaly detection of early schizophrenia
Not on the map. Why?
Abstract (arXiv)
Despite the impact of psychiatric disorders on clinical health, early-stage diagnosis remains a challenge. Machine learning studies have shown that classifiers tend to be overly narrow in the diagnosis prediction task. The overlap between conditions leads to high heterogeneity among participants that is not adequately captured by classification models. To address this issue, normative approaches have surged as an alternative method. By using a generative model to learn the distribution of healthy brain data patterns, we can identify the presence of pathologies as deviations or outliers from the distribution learned by the model. In particular, deep generative models showed great results as normative models to identify neurological lesions in the brain. However, unlike most neurological lesions, psychiatric disorders present subtle changes widespread in several brain regions, making these alterations challenging to identify. In this work, we evaluate the performance of transformer-based normative models to detect subtle brain changes expressed in adolescents and young adults. We trained our model on 3D MRI scans of neurotypical individuals (N=1,765). Then, we obtained the likelihood of neurotypical controls and psychiatric patients with early-stage schizophrenia from an independent dataset (N=93) from the Human Connectome Project. Using the predicted likelihood of the scans as a proxy for a normative score, we obtained an AUROC of 0.82 when assessing the difference between controls and individuals with early-stage schizophrenia. Our approach surpassed recent normative methods based on brain age and Gaussian Process, showing the promising use of deep generative models to help in individualised analyses.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 9 of its 37 references that are in the map. First posted on arXiv 8 Dec 2022.
Builds on
9 of 37 references.
References · 9
- 2017Attention Is All You Needcited by 60,361
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Adversarially Learned Inferencecited by 216
- 2020Autoencoders for Unsupervised Anomaly Segmentation in Brain MR Images: A Comparative Studycited by 147
- 2018Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Imagescited by 146
- 2020Unsupervised Lesion Detection via Image Restoration with a Normative Priorcited by 65
- 2021Unsupervised Brain Anomaly Detection and Segmentation with Transformerscited by 34
- 2020Scale-Space Autoencoders for Unsupervised Anomaly Segmentation in Brain MRIcited by 22
- 2022Transformer-based out-of-distribution detection for clinically safe segmentationcited by 16
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.