mlsanityData to 7 Oct 2026

When Eyes Betray AI: Social Gaze Consistency as a Semantic Cue for AI-Generated Image Detection

arXiv 2605.27348 ↗First posted 26 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent generative models have largely closed the gap on low-level artifacts - pixel fingerprints, frequency anomalies, upsampling traces - particularly in person-centric and partial-edit settings where the manipulated region is small and surrounded by photometrically authentic content. We introduce Social Gaze Consistency, a high-level semantic cue defined as the mutual coherence of gaze direction, head-eye alignment, and pupil placement between interacting individuals, and show that it constitutes a previously underutilized detection axis orthogonal to existing low-level paradigms. We instantiate this insight through three coupled mechanisms: (i) a controlled diagnostic dataset with region-specific perturbations of gaze-consistent imagery, where strict pair-level grouping forecloses generator-fingerprint memorization as an optimization-time shortcut rather than relying on augmentation; (ii) Block-Compositional Caption Supervision, which holds a single 5-block reasoning skeleton invariant across 1,250 macro-combined captions, decoupling reasoning consistency from surface diversity; (iii) Cross-architecture validation showing the same supervision improves a vision-language backbone (FakeVLM) by +3.7 pp on the COCOAI Interaction subset (balanced accuracy 67.8 -> 71.5) and +1.3 pp on the COCOAI Person subset (83.0 -> 84.3), with consistent gains on a vision-only backbone (Effort), evidencing a backbone-agnostic cue. Real- and fake-class recalls rise simultaneously, ruling out a "predict-all-fake" artifact. A four-step mechanistic account - paired-edit shortcut blocking, hard-to-easy difficulty transfer, CLIP prior preservation, and diffusion-family shared spectral weakness in periocular structure - explains why training on a single inpainter (FLUX.1-Fill) transfers to multi-generator suites. We will release the code upon acceptance to facilitate reproducibility.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 37 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

30 of 37 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  7. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  8. 2018Datasheets for Datasetscited by 1,371
  9. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  10. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  11. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
  12. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
18 more
  1. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
  2. 2024A Sanity Check for AI-generated Image Detectioncited by 187
  3. 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 173
  4. 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
  5. 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
  6. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
  7. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
  8. 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 88
  9. 2020Detecting Attended Visual Targets in Videocited by 76
  10. 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 66
  11. 2020Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlightscited by 59
  12. 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
  13. 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
  14. 2021Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Facescited by 48
  15. 2019LAEO-Net: revisiting people Looking At Each Other in videoscited by 34
  16. 2025SocialGesture: Delving into Multi-person Gesture Understandingcited by 11
  17. 2020Boosting Image-based Mutual Gaze Detection using Pseudo 3D Gazecited by 10
  18. 2026A Comprehensive Dataset for Human vs. AI Generated Image Detectioncited by 4

Built on by

Not cited yet.