Analysis of structure and dynamics in three-neuron motifs
Not on the map. Why?
Abstract (arXiv)
In neural networks with identical neurons, the matrix of connection weights completely describes the network structure and thereby determines how it is processing information. However, due to the non-linearity of these systems, it is not clear if similar microscopic connection structures also imply similar functional properties, or if a network is impacted more by macroscopic structural quantities, such as the ratio of excitatory and inhibitory connections (balance), or the ratio of non-zero connections (density). To clarify these questions, we focus on motifs of three binary neurons with discrete ternary connection strengths, an important class of network building blocks that can be analyzed exhaustively. We develop new, permutation-invariant metrics to quantify the structural and functional distance between two given network motifs. We then use multidimensional scaling to identify and visualize clusters of motifs with similar structural and functional properties. Our comprehensive analysis reveals that the function of a neural network is only weakly correlated with its microscopic structure, but depends strongly on the balance of the connections.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 3; 2023: 5; 2024: 2; 2025: 1.
11 papers.
- 2022Neural Network based Successor Representations of Space and Languagecited by 9
- 2023Word class representations spontaneously emerge in a deep neural network trained on next word predictioncited by 9
- 2022Neural Network based Formation of Cognitive Maps of Semantic Spaces and the Emergence of Abstract Conceptscited by 8
- 2022Classification at the Accuracy Limit -- Facing the Problem of Data Ambiguitycited by 6
- 2023Conceptual Cognitive Maps Formation with Neural Successor Networks and Word Embeddingscited by 4
- 2023Multi-Modal Cognitive Maps based on Neural Networks trained on Successor Representationscited by 3
- 2024Analysis of Argument Structure Constructions in a Deep Recurrent Language Modelcited by 3
- 2024Analysis of Argument Structure Constructions in the Large Language Model BERTcited by 3
- 2023Generating Oscillation Activity with Echo State Network to Mimic the Behavior of a Simple Central Pattern Generatorcited by 1
- 2023Excitatory/Inhibitory Balance Emerges as a Key Factor for RBN Performance, Overriding Attractor Dynamicscited by 0
- 2025Author-Specific Linguistic Patterns Unveiled: A Deep Learning Study on Word Class Distributionscited by 0
- 2025Author-Specific Linguistic Patterns Unveiled: A Deep Learning Study on Word Class Distributions17 Jan 2025
- 2024Analysis of Argument Structure Constructions in the Large Language Model BERT8 Aug 2024
- 2024Analysis of Argument Structure Constructions in a Deep Recurrent Language Model6 Aug 2024
- 2023Multi-Modal Cognitive Maps based on Neural Networks trained on Successor Representations22 Dec 2023
- 2023Excitatory/Inhibitory Balance Emerges as a Key Factor for RBN Performance, Overriding Attractor Dynamics2 Aug 2023
- 2023Conceptual Cognitive Maps Formation with Neural Successor Networks and Word Embeddings4 Jul 2023
- 2023Generating Oscillation Activity with Echo State Network to Mimic the Behavior of a Simple Central Pattern Generator19 Jun 2023
- 2023Word class representations spontaneously emerge in a deep neural network trained on next word prediction15 Feb 2023
- 2022Neural Network based Formation of Cognitive Maps of Semantic Spaces and the Emergence of Abstract Concepts28 Oct 2022
- 2022Classification at the Accuracy Limit -- Facing the Problem of Data Ambiguity4 Jun 2022
- 2022Neural Network based Successor Representations of Space and Language22 Feb 2022