mlsanityData to 14 Oct 2026

Network Representation Learning for Biophysical Neural Network Analysis

arXiv 2410.11503 ↗First posted 15 Oct 2024cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The analysis of biophysical neural networks (BNNs) has been a longstanding focus in computational neuroscience. A central yet unresolved challenge in BNN analysis lies in deciphering the correlations between neuronal and synaptic dynamics, their connectivity patterns, and learning process. To address this, we introduce a novel BNN analysis framework grounded in network representation learning (NRL), which leverages attention scores to uncover intricate correlations between network components and their features. Our framework integrates a new computational graph (CG)-based BNN representation, a bio-inspired graph attention network (BGAN) that enables multiscale correlation analysis across BNN representations, and an extensive BNN dataset. The CG-based representation captures key computational features, information flow, and structural relationships underlying neuronal and synaptic dynamics, while BGAN reflects the compositional structure of neurons, including dendrites, somas, and axons, as well as bidirectional information flows between BNN components. The dataset comprises publicly available models from ModelDB, reconstructed using the Python and standardized in NeuroML format, and is augmented with data derived from canonical neuron and synapse models. To our knowledge, this study is the first to apply an NRL-based approach to the full spectrum of BNNs and their analysis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 71 references that are in the map. First posted on arXiv 15 Oct 2024.

Builds on

27 of 71 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  6. 2017Graph Attention Networkscited by 8,923
  7. 2017Inductive Representation Learning on Large Graphscited by 6,320
  8. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  9. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  10. 2019Event-based Vision: A Surveycited by 1,016
  11. 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
  12. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
15 more
  1. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 609
  2. 2017Network Representation Learning: A Surveycited by 101
  3. 2018Disease Prediction using Graph Convolutional Networks: Application to Autism Spectrum Disorder and Alzheimer's Diseasecited by 99
  4. 2023Robust Scheduling with GFlowNetscited by 69
  5. 2017Spectral Graph Convolutions for Population-based Disease Predictioncited by 42
  6. 2022The BrainScaleS-2 accelerated neuromorphic system with hybrid plasticitycited by 42
  7. 2023Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependenciescited by 41
  8. 2019Graph Neural Network for Interpreting Task-fMRI Biomarkerscited by 40
  9. 2017Structural Deep Embedding for Hyper-Networkscited by 33
  10. 2020Transferable Graph Optimizers for ML Compilerscited by 29
  11. 2020Artificial neural networks for neuroscientists: A primercited by 26
  12. 2023DYNAP-SE2: a scalable multi-core dynamic neuromorphic asynchronous spiking neural network processorcited by 21
  13. 2022Neural Topological Ordering for Computation Graphscited by 12
  14. 2023Uncovering the Representation of Spiking Neural Networks Trained with Surrogate Gradientcited by 11
  15. 2019Multimodal Deep Network Embedding with Integrated Structure and Attribute Informationcited by 4

Built on by

Not cited yet.