mlsanityData to 7 Oct 2026

Face-Trace: Open-Set Attribution and Progressive Discovery of Synthetic Face Generators

arXiv 2607.07545 ↗First posted 8 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in generative Artificial Intelligence have made synthetic face images increasingly realistic, creating new challenges for multimedia forensics. Source attribution methods should identify the generator of an image when the source is known, but also handle samples produced by unseen models. Most existing approaches, however, address synthetic face attribution in a closed-set setting, assuming that test samples can only originate from generators observed during training. This assumption does not hold in real-world scenarios, where new generators continuously appear and detecting an image as unknown is not sufficient, since rejected samples should also be organized according to their underlying sources. We introduce Face-Trace, a pipeline for open-set synthetic face source attribution that combines known generator classification, energy-based rejection, and unknown generator discovery. A classifier trained on frozen I-JEPA embeddings attributes known generators, while rejected samples are represented by combining projected I-JEPA features with complementary forensic traces and grouped to identify coherent sets of samples produced by unknown generators. We also extend the discovery stage to an incremental scenario, where rejected samples arrive over time. Experiments on the WILD dataset show 96.73% closed-set attribution accuracy, while rejection reaches 71.25% balanced accuracy and rejected samples are clustered into meaningful unknown-generator groups, with an Adjusted Rand Index of 0.81, a Normalized Mutual Information of 0.90, and an overall purity of 87.74%. In the incremental setting, the discovered generator space is progressively extended while maintaining a final purity of 99.23%, and cross-dataset experiments suggest that the pipeline can operate beyond the original data distribution.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

33 of 47 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  3. 2020Supervised Contrastive Learningcited by 2,803
  4. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  5. 2025DINOv3cited by 1,297
  6. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  7. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  8. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  9. 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 338
  10. 2019Learning to Discover Novel Visual Categories via Deep Transfer Clusteringcited by 223
  11. 2022Generalized Category Discoverycited by 209
  12. 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 167
21 more
  1. 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
  2. 2022Parametric Classification for Generalized Category Discovery: A Baseline Studycited by 113
  3. 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
  4. 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learningcited by 48
  5. 2022Deepfake Network Architecture Attributioncited by 47
  6. 2022RepMix: Representation Mixing for Robust Attribution of Synthesized Imagescited by 39
  7. 2023Progressive Open Space Expansion for Open-Set Model Attributioncited by 32
  8. 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmarkcited by 28
  9. 2023Novel Class Discovery: an Introduction and Key Conceptscited by 24
  10. 2025ProtoGCD: Unified and Unbiased Prototype Learning for Generalized Category Discoverycited by 19
  11. 2024Are CLIP features all you need for Universal Synthetic Image Origin Attribution?cited by 14
  12. 2025Forensic Self-Descriptions Are All You Need for Zero-Shot Detection, Open-Set Source Attribution, and Clustering of AI-generated Imagescited by 11
  13. 2025WILD: a new in-the-Wild Image Linkage Dataset for synthetic image attributioncited by 9
  14. 2024BOSC: A Backdoor-based Framework for Open Set Synthetic Image Attributioncited by 6
  15. 2024Deepfake Media Forensics: State of the Art and Challenges Aheadcited by 6
  16. 2022Is it all a cluster game? -- Exploring Out-of-Distribution Detection based on Clustering in the Embedding Spacecited by 5
  17. 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learningcited by 5
  18. 2025Face Deepfakes -- A Comprehensive Reviewcited by 3
  19. 2025Beyond Deepfake vs Real: Facial Deepfake Detection in the Open-Set Paradigmcited by 1
  20. 2025Autonomous and Self-Adapting System for Synthetic Media Detection and Attributioncited by 1
  21. 2025Supervised Contrastive Learning for Few-Shot AI-Generated Image Detection and Attributioncited by 1

Built on by

Not cited yet.