When Language Models Meet NeuroGraphs: Exploring Enhanced Agentic LLM Framework Towards Brain Network Analysis
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Brain network analysis is crucial for understanding cognition and neurological disorders, yet existing deep learning methods mainly treat connectome analysis as a graph-to-logit classification problem, offering limited explanatory reasoning. Large language models (LLMs) provide a promising interface for knowledge-intensive scientific analysis, but directly applying general-purpose LLMs to brain networks remains challenging due to the structure-language gap, limited neuroscience grounding, and overconfident positive predictions. In this paper, we propose BrainAgent, an agentic LLM framework for knowledge-enhanced brain network analysis. BrainAgent reformulates connectome classification as an iterative process of topology-aware understanding, external retrieval, reasoning, and reflection. Specifically, it first converts raw brain networks into compact multi-level structural descriptions through brain-specific analysis tools, then retrieves relevant neuroscience knowledge and task-specific cases to ground the reasoning process, and finally generates structured predictions with reflective verification. Experiments on four public rs-fMRI datasets show that BrainAgent consistently improves different closed-source and open-source LLM backbones over direct prompting and standard reasoning baselines. Further ablation and interpretability analyses demonstrate the effectiveness of each component and show that BrainAgent produces more comprehensive, multi-level, and verifiable explanations.These results indicate that agentic LLMs provide a practical route toward interpretable and knowledge-grounded brain network analysis.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 53 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
34 of 53 references.
Closest ancestors · 1
Same direction, newest first
- 2024Medchain: Bridging the Gap Between LLM Agents and Clinical Practice with Interactive Sequence2 Dec
Other references · 33
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Graph Attention Networkscited by 8,854
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
21 more
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2025Small Language Models are the Future of Agentic AIcited by 254
- 2024Capabilities of Gemini Models in Medicinecited by 231
- 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
- 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 217
- 2024When Attention Sink Emerges in Language Models: An Empirical Viewcited by 200
- 2022BrainGB: A Benchmark for Brain Network Analysis with Graph Neural Networkscited by 73
- 2022Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysiscited by 58
- 2024Injecting New Knowledge into Large Language Models via Supervised Fine-Tuningcited by 56
- 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Modelscited by 43
- 2024RAGraph: A General Retrieval-Augmented Graph Learning Frameworkcited by 24
- 2024SpreadsheetLLM: Encoding Spreadsheets for Large Language Modelscited by 15
- 2023BrainNPT: Pre-training of Transformer networks for brain network classificationcited by 9
- 2023MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learningcited by 7
- 2024Multimodal Clinical Trial Outcome Prediction with Large Language Modelscited by 7
- 2025BrainPrompt: Multi-Level Brain Prompt Enhancement for Neurological Condition Identificationcited by 5
- 2025A Brain Graph Foundation Model: Pre-Training and Prompt-Tuning across Broad Atlases and Disorderscited by 3
- 2025SHERLOCK: Towards Dynamic Knowledge Adaptation in LLM-enhanced E-commerce Risk Managementcited by 1
- 2026M3D-BFS: a Multi-stage Dynamic Fusion Strategy for Sample-Adaptive Multi-Modal Brain Network Analysiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026BrainAgent: A Large Language Model-Driven Multi-Agent Framework for Autonomous Brain Signal Understanding
- 2026BLEG: LLM Functions as Powerful fMRI Graph-Enhancer for Brain Network Analysis
- 2026NS-Copilot: An LLM-Driven Agent System for Autonomous Neuroscience Analysis
- 2026NeuroAgent: LLM Agents for Multimodal Neuroimaging Analysis and Research
- 2026SABER: A Semantic-Aligned Brain Network Analysis Framework via Multi-scale Hypergraphs
- 2024The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Units
- 2026BrainPilot: Automating Brain Discovery with Agentic Research
- 2025Talking to the brain: Using Large Language Models as Proxies to Model Brain Semantic Representation