mlsanityData to 14 Oct 2026

Feature Visualization Recovers Known Cortical Selectivity from TRIBE v2

arXiv 2605.13904 ↗First posted 13 May 2026q-bio.NC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Brain encoder models predict cortical fMRI responses from the internal activations of pretrained vision and language networks, and are typically evaluated by held-out prediction accuracy. This is a useful signal for training but a poor one for interpretation: it tells us an encoder fits the data without telling us whether it has internalized the functional organization of the brain. We propose feature visualization -- gradient ascent on the encoder's predicted activation for a target region of interest (ROI) -- as a complementary interpretability technique, and apply it to TRIBE v2 composed with V-JEPA 2 (ViT-G, 40 layers), holding both frozen and synthesizing still images for seven regions spanning the ventral and dorsal visual hierarchies. Under identical hyperparameters, the probe recovers a visible progression of increasing spatial scale and feature complexity across V1 to V4, matching the ventral-stream hierarchy. It also produces three distinctive downstream regimes: radial "frozen-motion" streaks for the middle temporal area (MT) despite static-only optimization, face-like features for the fusiform face area (FFA), and consistent rectilinear line patterns for the parahippocampal place area (PPA). Optimized FFA stimuli drive the predicted region ~4x as much as a natural face photograph, consistent with feature visualization producing adversarial super-stimuli rather than canonical exemplars. The probe is simple, differentiable, and applicable to any brain encoder with a differentiable backbone, allowing for qualitative evaluation of brain encoders.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 23 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

5 of 23 references.

References · 5

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  2. 2013Intriguing properties of neural networkscited by 5,155
  3. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  4. 2025TRIBE: TRImodal Brain Encoder for whole-brain fMRI response predictioncited by 19
  5. 2026A foundation model of vision, audition, and language for in-silico neurosciencecited by 13

Built on by

Not cited yet.