The ISLab Solution to the Algonauts Challenge 2025: A Multimodal Deep Learning Approach to Brain Response Prediction
Not on the map. Why?
Abstract (arXiv)
In this work, we present a network-specific approach for predicting brain responses to complex multimodal movies, leveraging the Yeo 7-network parcellation of the Schaefer atlas. Rather than treating the brain as a homogeneous system, we grouped the seven functional networks into four clusters and trained separate multi-subject, multi-layer perceptron (MLP) models for each. This architecture supports cluster-specific optimization and adaptive memory modeling, allowing each model to adjust temporal dynamics and modality weighting based on the functional role of its target network. Our results demonstrate that this clustered strategy significantly enhances prediction accuracy across the 1,000 cortical regions of the Schaefer atlas. The final model achieved an eighth-place ranking in the Algonauts Project 2025 Challenge, with out-of-distribution (OOD) correlation scores nearly double those of the baseline model used in the selection phase. Code is available at https://github.com/Corsi01/algo2025.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 14 references that are in the map. First posted on arXiv 25 Jul 2025.
Builds on
9 of 14 references.
References · 9
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
- 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 528
- 2020ViNet: Pushing the limits of Visual Modality for Audio-Visual Saliency Predictioncited by 43
- 2023The Algonauts Project 2023 Challenge: How the Human Brain Makes Sense of Natural Scenescited by 36
- 2024The Algonauts Project 2025 Challenge: How the Human Brain Makes Sense of Multimodal Moviescited by 20
- 2021The Algonauts Project 2021 Challenge: How the Human Brain Makes Sense of a World in Motioncited by 17
Built on by
Citing papers per year: 2026: 1.
1 paper.