Real-time Trajectory-based Social Group Detection
Not on the map. Why?
Abstract (arXiv)
Social group detection is a crucial aspect of various robotic applications, including robot navigation and human-robot interactions. To date, a range of model-based techniques have been employed to address this challenge, such as the F-formation and trajectory similarity frameworks. However, these approaches often fail to provide reliable results in crowded and dynamic scenarios. Recent advancements in this area have mainly focused on learning-based methods, such as deep neural networks that use visual content or human pose. Although visual content-based methods have demonstrated promising performance on large-scale datasets, their computational complexity poses a significant barrier to their practical use in real-time applications. To address these issues, we propose a simple and efficient framework for social group detection. Our approach explores the impact of motion trajectory on social grouping and utilizes a novel, reliable, and fast data-driven method. We formulate the individuals in a scene as a graph, where the nodes are represented by LSTM-encoded trajectories and the edges are defined by the distances between each pair of tracks. Our framework employs a modified graph transformer module and graph clustering losses to detect social groups. Our experiments on the popular JRDBAct dataset reveal noticeable improvements in performance, with relative improvements ranging from 2% to 11%. Furthermore, our framework is significantly faster, with up to 12x faster inference times compared to state-of-the-art methods under the same computation resources. These results demonstrate that our proposed method is suitable for real-time robotic applications.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 37 references that are in the map. First posted on arXiv 12 Apr 2023.
Builds on
13 of 37 references.
References · 13
- 2017Graph Attention Networkscited by 8,854
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2020A Generalization of Transformer Networks to Graphscited by 653
- 2020Joint Learning of Social Groups, Individuals Action and Sub-group Activities in Videoscited by 39
- 2021JRDB-Act: A Large-scale Dataset for Spatio-temporal Action, Social Group and Activity Detectioncited by 38
- 2014F-formation Detection: Individuating Free-standing Conversational Groups in Imagescited by 16
- 2018Eigendecomposition-free Training of Deep Networks with Zero Eigenvalue-based Lossescited by 15
- 2022Panoramic Human Activity Recognitioncited by 13
- 2021Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaborationcited by 8
- 2022Self-supervised Social Relation Representation for Human Group Detectioncited by 7
- 2020Let me join you! Real-time F-formation recognition by a socially aware robotcited by 5
- 2020I can attend a meeting too! Towards a human-like telepresence avatar robot to attend meeting on your behalfcited by 3
1 more
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 1.
4 papers.
- 2024GSON: A Group-based Social Navigation Framework with Large Multimodal Modelcited by 6
- 2025Dynamic Group Detection using VLM-augmented Temporal Groupness Graphcited by 3
- 2024Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learningcited by 0
- 2026Where Should I Join? Robot Group Joining via Language-Guided Goal Predictioncited by 0
- 2026Where Should I Join? Robot Group Joining via Language-Guided Goal Prediction23 Sep 2026
- 2025Dynamic Group Detection using VLM-augmented Temporal Groupness Graph5 Sep 2025
- 2024GSON: A Group-based Social Navigation Framework with Large Multimodal Model26 Sep 2024
- 2024Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learning8 Apr 2024