Purrturbed but Stable: Human-Cat Invariant Representations Across CNNs, ViTs and Self-Supervised ViTs
Not on the map. Why?
Abstract (arXiv)
Cats and humans differ in ocular anatomy. Most notably, Felis Catus (domestic cats) have vertically elongated pupils linked to ambush predation; yet, how such specializations manifest in downstream visual representations remains incompletely understood. We present a unified, frozen-encoder benchmark that quantifies feline-human cross-species representational alignment in the wild, across convolutional networks, supervised Vision Transformers, windowed transformers, and self-supervised ViTs (DINO), using layer-wise Centered Kernel Alignment (linear and RBF) and Representational Similarity Analysis, with additional distributional and stability tests reported in the paper. Across models, DINO ViT-B/16 attains the most substantial alignment (mean CKA-RBF ≈0.814, mean CKA-linear ≈0.745, mean RSA ≈0.698), peaking at early blocks, indicating that token-level self-supervision induces early-stage features that bridge species-specific statistics. Supervised ViTs are competitive on CKA yet show weaker geometric correspondence than DINO (e.g., ViT-B/16 RSA ≈0.53 at block8; ViT-L/16 ≈0.47 at block14), revealing depth-dependent divergences between similarity and representational geometry. CNNs remain strong baselines but below plain ViTs on alignment, and windowed transformers underperform plain ViTs, implicating architectural inductive biases in cross-species alignment. Results indicate that self-supervision coupled with ViT inductive biases yields representational geometries that more closely align feline and human visual systems than widely used CNNs and windowed Transformers, providing testable neuroscientific hypotheses about where and how cross-species visual computations converge. We release our code and dataset for reference and reproducibility.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 52 references that are in the map. First posted on arXiv 4 Nov 2025.
Builds on
22 of 52 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
10 more
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
- 2019Searching for MobileNetV3cited by 1,994
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2019Natural Adversarial Examplescited by 1,408
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2020Measuring Robustness to Natural Distribution Shifts in Image Classificationcited by 454
- 2018Insights on representational similarity in neural networks with canonical correlationcited by 324
- 2024EgoPet: Egomotion and Interaction Data from an Animal's Perspectivecited by 11
Built on by
Not cited yet.