Dimensional Coactivation for Representational Consistency in Frozen Vision Foundation Models
Not on the map. Why?
Abstract (arXiv)
Frozen vision foundation models do not merely extract features; they organize images through a learned coordinate system. We ask whether that coordinate system remains internally coherent within a single input. This leads to Representational Consistency: the study of whether a frozen foundation model represents one sample coherently across its semantic subregions. We introduce Dimensional Coactivation (DCA), a per-dimension instrument for measuring this coherence. DCA compares semantic regions by asking whether the same feature dimensions coactivate across them. Unlike classical similarity measures, it deliberately avoids centering, L2 normalization, and full Gram coupling. These operations are useful when comparing different models or distributions, but they are mismatched to the intra-sample setting, where the coordinate system is fixed and raw magnitude carries signal. Deepfake detection provides a natural validation task. Synthetic faces may reproduce plausible eyes, noses, and mouths while breaking the representational structure that links those regions in real faces. Using frozen DINOv3 features, DCA exposes this break: an eyes-mouth-nose fingerprint achieves 0.9106 AUC on CelebDF-v2 and 0.9289 on DFD under FF++ c23 cross-dataset transfer. The design is also sharply validated by ablation: reintroducing centering collapses CelebDF-v2 AUC to 0.459, L2 normalization reduces it to 0.862, and cross-dimension coupling reduces it to 0.478. Finally, replacing DINOv3 with FaRL collapses CelebDF-v2 AUC to 0.582. DCA therefore depends on a stable per-dimension coordinate system, not on region extraction alone. These results position DCA as an instrument for measuring intra-sample representational coherence in frozen foundation models, with deepfake detection as the first validation task.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
12 of 18 references.
References · 12
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
Built on by
Citing papers per year: 2026: 1.
1 paper.