# Multi-Sensory Cognitive Computing for Learning Population-level Brain Connectivity

arXiv: https://arxiv.org/abs/2508.11436 · HTML: https://mlsanity.com/paper/2508.11436/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 30 references that are in the map.
- First posted on arXiv 15 Aug 2025.

## Builds on (most cited first, 4 of 4)

- [Deep Graph Normalizer: A Geometric Deep Learning Approach for Estimating Connectional Brain Templates](https://mlsanity.com/paper/2012.14131/) (2020)
- [Comparative Survey of Multigraph Integration Methods for Holistic Brain Connectivity Mapping](https://mlsanity.com/paper/2204.05110/) (2022)
- [Deep Cross-Modality and Resolution Graph Integration for Universal Brain Connectivity Mapping and Augmentation](https://mlsanity.com/paper/2209.13529/) (2022)
- [Population Template-Based Brain Graph Augmentation for Improving One-Shot Learning Classification](https://mlsanity.com/paper/2212.07790/) (2022)

## Built on by (most cited first, 1 of 1)

- [Evidence of a Cognitive Shift in AI Education: How Students Are Rethinking Human Intelligence?](https://mlsanity.com/paper/2605.16292/) (2026)

## Abstract (arXiv)

The generation of connectional brain templates (CBTs) has recently garnered significant attention for its potential to identify unique connectivity patterns shared across individuals. However, existing methods for CBT learning such as conventional machine learning and graph neural networks (GNNs) are hindered by several limitations. These include: (i) poor interpretability due to their black-box nature, (ii) high computational cost, and (iii) an exclusive focus on structure and topology, overlooking the cognitive capacity of the generated CBT. To address these challenges, we introduce mCOCO (multi-sensory COgnitive COmputing), a novel framework that leverages Reservoir Computing (RC) to learn population-level functional CBT from BOLD (Blood-Oxygen-level-Dependent) signals. RC's dynamic system properties allow for tracking state changes over time, enhancing interpretability and enabling the modeling of brain-like dynamics, as demonstrated in prior literature. By integrating multi-sensory inputs (e.g., text, audio, and visual data), mCOCO captures not only structure and topology but also how brain regions process information and adapt to cognitive tasks such as sensory processing, all in a computationally efficient manner. Our mCOCO framework consists of two phases: (1) mapping BOLD signals into the reservoir to derive individual functional connectomes, which are then aggregated into a group-level CBT - an approach, to the best of our knowledge, not previously explored in functional connectivity studies - and (2) incorporating multi-sensory inputs through a cognitive reservoir, endowing the CBT with cognitive traits. Extensive evaluations show that our mCOCO-based template significantly outperforms GNN-based CBT in terms of centeredness, discriminativeness, topological soundness, and multi-sensory memory retention. Our source code is available at https://github.com/basiralab/mCOCO.
