mlsanityData to 7 Oct 2026

Representation Trajectories Matters: Complementary Evidence for OOD Detection and Image Classification

arXiv 2607.26565 ↗First posted 29 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision models do not form a representation at once; each block revises it. We ask whether the resulting computation path contains evidence that the final representation discards, and whether that evidence improves OOD detection and image classification on clean and shifted data. Unlike approaches that treat intermediate layers as separate snapshots, we retain sample identity across depth and study the transformations connecting successive states. We separate class-coherent transport from input-specific innovation, and coordinate movement from relational reorganization. Across supervised, self-supervised, vision--language, hierarchical, and convolutional encoders, these paths show strong sample-specific continuity and architecture-specific depth profiles that recur across datasets. They are also practically useful. An ID-only transition-surprise score complements strong final-state detectors, reducing FPR95 in 131/152 non-saturated comparisons on a balanced OpenOOD grid; gains are largest for visually disruptive and semantically far shifts, and remain positive on near-OOD for most detectors. Frozen update probes improve 71/72 clean model--dataset cases, while shifted-data gains vary with architecture and corruption type. Computation paths therefore provide a broadly useful reliability signal whose value is determined jointly by model organization and the shift encountered.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 45 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

25 of 45 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  5. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  6. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  7. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  8. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  9. 2025DINOv3cited by 1,297
  10. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  11. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
  12. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
13 more
  1. 2020Designing Network Design Spacescited by 954
  2. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
  3. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
  4. 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
  5. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
  6. 2022DeiT III: Revenge of the ViTcited by 417
  7. 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
  8. 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
  9. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
  10. 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 298
  11. 2025Intermediate Layer Classifiers for OOD generalizationcited by 14
  12. 2022Neural Networks as Paths through the Space of Representationscited by 5
  13. 2025An empirical study of the effect of video encoders on Temporal Video Groundingcited by 1

Built on by

Not cited yet.