mlsanityData to 14 Oct 2026

Emergent Region-Level Facial Correspondence in Frozen Vision Foundation Models

arXiv 2607.14423 ↗First posted 15 Jul 2026cs.CV eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Frozen self-supervised vision models can align parts of generic objects, but it remains unclear whether this correspondence extends to human faces, where global layout is shared while identity-specific appearance varies sharply. We test whether frozen DINOv3 features define a region-level facial coordinate system: a feature space in which eyes, brows, nose, mouth, skin, and hair remain distinguishable across people and across time without face-specific training. Using DINOv3 ViT-L/16 patch embeddings and FaRL only as a face-part labeling interface, we evaluate cross-identity nearest-neighbor matching and temporal label propagation on 200 CelebDF-v2 real videos. DINOv3 achieves 83.0% region-level semantic accuracy under unconstrained cross-identity matching, compared with a 23.0% area-weighted random baseline, and 95.5% temporal tracking accuracy without a learned temporal module. A no-FaRL control collapses to 0.9%, showing that FaRL supplies semantic initialization while DINOv3 supplies dense spatial correspondence. The strongest correspondence appears at an intermediate layer: block 18 gives a 4.93x same-region versus cross-region discrimination ratio, compared with 1.48x at the final block. Against CLIP ViT-L/14, DINOv3 shows only a small aggregate advantage but a +16.8 pp gain on anatomical regions, indicating that image-level contrastive supervision captures coarse facial layout but not fine-grained anatomical identity. These results establish frozen DINOv3 as a strong zero-shot representation for region-level facial correspondence and identify intermediate self-supervised features as the most useful layer for dense face analysis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 16 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

15 of 16 references.

References · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  4. 2025DINOv3cited by 1,414
  5. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  6. 2023Emergent Correspondence from Image Diffusioncited by 446
  7. 2021Deep ViT Features as Dense Visual Descriptorscited by 330
  8. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
  9. 2019Learning Correspondence from the Cycle-Consistency of Timecited by 269
  10. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
  11. 2020Space-Time Correspondence as a Contrastive Random Walkcited by 239
  12. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
3 more
  1. 2019RetinaFace: Single-stage Dense Face Localisation in the Wildcited by 165
  2. 2025Exploring Temporally-Aware Features for Point Trackingcited by 15
  3. 2025Semantic Correspondence: Unified Benchmarking and a Strong Baselinecited by 3

Built on by

Not cited yet.