mlsanityData to 7 Oct 2026

Gaze-Anchored Social Net: Decoding Implicit Relations via Joint Modeling

arXiv 2607.22847 ↗First posted 24 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human gaze does more than point to visual targets; it serves as a subtle indicator of social intent within static images, whereas standard models typically process individuals independently, treating gaze as an i.i.d. quantity or predicting social semantics in isolation. Recent multi-person methods attempt to address this but often treat social relations as rigid, post-hoc classifications decoupled from the gaze estimation process. This oversimplification fails to capture the nuanced nature of social intent, which acts as an underlying driver of gaze behavior rather than a secondary categorical output. We address these limitations by proposing ANCHOR, a target-centric paradigm designed to decode gaze-anchored social intent by modeling the joint distribution of visual attention and latent implicit relations. Our approach surfaces these dependencies as the latent structural scaffolding of gaze behavior. The architecture utilizes a relational attention mechanism to capture fine-grained interpersonal links, leveraging feature-wise modulation for efficient multi-person parsing from a single vision backbone. To stabilize the training of this coupled formulation, we implement an optimization synergy to resolve the inherent conflicts between spatial gaze accuracy and latent social reasoning. This approach ensures robust generalization by seeking stable, flat minima while simultaneously harmonizing competing task gradients. We validate our framework on an extended benchmark featuring dense multi-person annotations and novel social influence rankings. Our results demonstrate state-of-the-art performance and provide the first quantitative evidence that implicit social hierarchies can be robustly disentangled and learned directly from static gaze patterns.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 24 Jul 2026.

Builds on

20 of 38 references.

References · 20

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  3. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  4. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  5. 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 173
  6. 2020Detecting Attended Visual Targets in Videocited by 76
  7. 2018Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliencycited by 53
  8. 2022End-to-End Human-Gaze-Target Detection with Transformerscited by 47
  9. 2019Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoningcited by 39
  10. 2024Gaze-LLE: Gaze Target Estimation via Large-Scale Learned Encoderscited by 36
  11. 2023ChildPlay: A New Benchmark for Understanding Children's Gaze Behaviourcited by 35
  12. 2023A Modular Multimodal Architecture for Gaze Target Prediction: Application to Privacy-Sensitive Settingscited by 31
8 more
  1. 2015SALSA: A Novel Dataset for Multimodal Group Behavior Analysiscited by 27
  2. 2023Object-aware Gaze Target Detectioncited by 27
  3. 2021GOO: A Dataset for Gaze Object Prediction in Retail Environmentscited by 26
  4. 2014F-formation Detection: Individuating Free-standing Conversational Groups in Imagescited by 16
  5. 2024JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groupscited by 13
  6. 2020Attention Flow: End-to-End Joint Attention Estimationcited by 11
  7. 2023Multi-Modal Gaze Following in Conversational Scenarioscited by 6
  8. 2016Following Gaze Across Viewscited by 2

Built on by

Not cited yet.