Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping
Not on the map. Why?
Abstract (arXiv)
Video face swapping has no natural paired supervision: no real footage exists of one person's face performing another person's video. The strongest current answer, DreamID-V's SyncID-Pipe, mints pairs by replacing the identity in exactly two frames of a real clip -- the first and the last -- and regenerating the rest from a pose sequence alone. Pose carries no appearance evidence of the swapped-in identity, so over long clips, occlusions, and extreme pose excursions the synthesized identity has a long unanchored span on which to drift; no published ablation examines anchor count or placement. We propose Adaptive Identity Anchoring (AIA): (i) generalize the synthesizer to arbitrary anchor sets, architecturally natural for diffusion-forcing-style transformers where conditioning on a frame is clamping its tokens to zero noise; (ii) place anchors by a closed feedback loop that scores every generated frame against the real reference identity and inserts an image-face-swapped anchor at the worst-scoring frame until the pair passes a threshold or exhausts a budget; (iii) reuse the loop's verdict as an automatic data filter. A second pathology, the beauty-filter look of over-smoothed skin, has the same root cause: micro-texture, like identity, is priced by none of the pipeline's objectives. We therefore pair AIA with Reality-Referenced Texture Restoration: matched re-graining from each real frame's non-face regions, band-split transfer of sub-identity micro-texture from the real footage, and a second, spectral acceptance channel refereed by the footage's own spectrum. Identity-anchor density, we argue, is a controllable quality dial, and we specify falsifiable experiments -- drift-versus-gap curves, uniform-versus-adaptive placement at matched budgets, student training on AIA-minted data, and texture ablations with a human beauty-filter study -- that would validate or refute the proposal.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 18 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
16 of 18 references.
References · 16
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 321
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 131
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 44
- 2025CanonSwap: High-Fidelity and Consistent Video Face Swapping via Canonical Space Modulationcited by 16
4 more
- 2025DreamID: High-Fidelity and Fast diffusion-based Face Swapping via Triplet ID Group Learningcited by 10
- 2024HiFiVFS: High Fidelity Video Face Swappingcited by 9
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformercited by 9
- 2024VividFace: A Diffusion-Based Hybrid Framework for High-Fidelity Video Face Swappingcited by 6
Built on by
Not cited yet.