mlsanityData to 14 Oct 2026

MAPS: Masked Attribution-based Probing of Strategies- A computational framework to align human and model explanations

arXiv 2510.12141 ↗First posted 14 Oct 2025q-bio.NC cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human core object recognition depends on the selective use of visual information, but the strategies guiding these choices are difficult to measure directly. We present MAPS (Masked Attribution-based Probing of Strategies), a behaviorally validated computational tool that tests whether explanations derived from artificial neural networks (ANNs) can also explain human vision. MAPS converts attribution maps into explanation-masked images (EMIs) and compares image-by-image human accuracies on these minimal images with limited pixel budgets with accuracies on the full stimuli. MAPS provides a principled way to evaluate and choose among competing ANN interpretability methods. In silico, EMI-based behavioral similarity between models reliably recovers the ground-truth similarity computed from their attribution maps, establishing which explanation methods best capture the model's strategy. When applied to humans and macaques, MAPS identifies ANN-explanation combinations whose explanations align most closely with biological vision, achieving the behavioral validity of Bubble masks while requiring far fewer behavioral trials. Because it needs only access to model attributions and a modest set of behavioral data on the original images, MAPS avoids exhaustive psychophysics while offering a scalable tool for adjudicating explanations and linking human behavior, neural activity, and model decisions under a common standard.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 12 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

4 of 12 references.

References · 4

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  2. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  3. 2023The Quest for an Integrated Set of Neural Mechanisms Underlying Object Recognition in Primatescited by 8
  4. 2023Better Understanding Differences in Attribution Methods via Systematic Evaluationscited by 4

Built on by

Not cited yet.