Foundation-Model-Boosted Multimodal Learning for fMRI-based Neuropathic Pain Drug Response Prediction
Not on the map. Why?
Abstract (arXiv)
Neuropathic pain, affecting up to 10% of adults, remains difficult to treat due to limited therapeutic efficacy and tolerability. Although resting-state functional MRI (rs-fMRI) is a promising non-invasive measurement of brain biomarkers to predict drug response in therapeutic development, the complexity of fMRI demands machine learning models with substantial capacity. However, extreme data scarcity in neuropathic pain research limits the application of high-capacity models. To address the challenge of data scarcity, we propose FMMTC, a Foundation-Model-boosted Multimodal learning framework for fMRI-based neuropathic pain drug response prediction, which leverages both internal multimodal information in pain-specific data and external knowledge from large pain-agnostic data. Specifically, to maximize the value of limited pain-specific data, FMMTC integrates complementary information from two rs-fMRI modalities: Time series and functional Connectivity. FMMTC is further boosted by an fMRI foundation model with its external knowledge from extensive pain-agnostic fMRI datasets enriching limited pain-specific information. Evaluations with an in-house dataset and a public dataset from OpenNeuro demonstrate FMMTC's superior representation ability, generalizability, and cross-dataset adaptability over existing unimodal fMRI models that only consider one of the rs-fMRI modalities. The ablation study validates the effectiveness of multimodal learning and foundation-model-powered external knowledge transfer in FMMTC. An integrated gradient-based interpretation study explains how FMMTC's cross-dataset dynamic behaviors enhance its adaptability. In conclusion, FMMTC boosts clinical trials in neuropathic pain therapeutic development by accurately predicting drug responses to improve the participant stratification efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 34 references that are in the map. First posted on arXiv 28 Feb 2025.
Builds on
7 of 34 references.
References · 7
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 471
- 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusioncited by 68
- 2024Hierarchical Spatio-Temporal State-Space Modeling for fMRI Analysiscited by 6
- 2018Brain decoding from functional MRI using long short-term memory recurrent neural networkscited by 5
Built on by
Not cited yet.