When Eyes Betray AI: Social Gaze Consistency as a Semantic Cue for AI-Generated Image Detection
Not on the map. Why?
Abstract (arXiv)
Recent generative models have largely closed the gap on low-level artifacts - pixel fingerprints, frequency anomalies, upsampling traces - particularly in person-centric and partial-edit settings where the manipulated region is small and surrounded by photometrically authentic content. We introduce Social Gaze Consistency, a high-level semantic cue defined as the mutual coherence of gaze direction, head-eye alignment, and pupil placement between interacting individuals, and show that it constitutes a previously underutilized detection axis orthogonal to existing low-level paradigms. We instantiate this insight through three coupled mechanisms: (i) a controlled diagnostic dataset with region-specific perturbations of gaze-consistent imagery, where strict pair-level grouping forecloses generator-fingerprint memorization as an optimization-time shortcut rather than relying on augmentation; (ii) Block-Compositional Caption Supervision, which holds a single 5-block reasoning skeleton invariant across 1,250 macro-combined captions, decoupling reasoning consistency from surface diversity; (iii) Cross-architecture validation showing the same supervision improves a vision-language backbone (FakeVLM) by +3.7 pp on the COCOAI Interaction subset (balanced accuracy 67.8 -> 71.5) and +1.3 pp on the COCOAI Person subset (83.0 -> 84.3), with consistent gains on a vision-only backbone (Effort), evidencing a backbone-agnostic cue. Real- and fake-class recalls rise simultaneously, ruling out a "predict-all-fake" artifact. A four-step mechanistic account - paired-edit shortcut blocking, hard-to-easy difficulty transfer, CLIP prior preservation, and diffusion-family shared spectral weakness in periocular structure - explains why training on a single inpainter (FLUX.1-Fill) transfers to multi-generator suites. We will release the code upon acceptance to facilitate reproducibility.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 37 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
30 of 37 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Visual Instruction Tuningcited by 7,792
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2018Datasheets for Datasetscited by 1,371
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
18 more
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
- 2024A Sanity Check for AI-generated Image Detectioncited by 187
- 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 173
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
- 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 88
- 2020Detecting Attended Visual Targets in Videocited by 76
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 66
- 2020Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlightscited by 59
- 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2021Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Facescited by 48
- 2019LAEO-Net: revisiting people Looking At Each Other in videoscited by 34
- 2025SocialGesture: Delving into Multi-person Gesture Understandingcited by 11
- 2020Boosting Image-based Mutual Gaze Detection using Pseudo 3D Gazecited by 10
- 2026A Comprehensive Dataset for Human vs. AI Generated Image Detectioncited by 4
Built on by
Not cited yet.