mlsanityData to 7 Oct 2026

Integrated representational signatures strengthen specificity in brains and models

arXiv 2510.20847 ↗First posted 21 Oct 2025q-bio.NC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The extent to which different neural or artificial neural networks (models) rely on equivalent representations to support similar tasks remains a central question in neuroscience and machine learning. Prior work has typically compared systems using a single representational similarity metric, yet each captures only one facet of representational structure. To address this, we leverage a suite of representational similarity metrics-each capturing a distinct facet of representational correspondence, such as geometry, unit-level tuning, or linear decodability-and assess brain region or model separability using multiple complementary measures. Metrics that preserve geometric or tuning structure (e.g., RSA, Soft Matching) yield stronger region-based discrimination, whereas more flexible mappings such as Linear Predictivity show weaker separation. These findings suggest that geometry and tuning encode brain-region- or model-family-specific signatures, while linearly decodable information tends to be more globally shared across regions or models. To integrate these complementary representational facets, we adapt Similarity Network Fusion (SNF), a framework originally developed for multi-omics data integration. SNF produces substantially sharper regional and model family-level separation than any single metric and yields robust composite similarity profiles. Moreover, clustering cortical regions using SNF-derived similarity scores reveals a clearer hierarchical organization that aligns closely with established anatomical and functional hierarchies of the visual cortex-surpassing the correspondence achieved by individual metrics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 14 references that are in the map. First posted on arXiv 21 Oct 2025.

Builds on

6 of 14 references.

References · 6

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  2. 2022A ConvNet for the 2020scited by 3,545
  3. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  4. 2018Insights on representational similarity in neural networks with canonical correlationcited by 318
  5. 2023Soft Matching Distance: A metric on neural representations that captures single-neuron tuningcited by 16
  6. 2025Model-brain comparison using inter-animal transformscited by 3

Built on by

Not cited yet.