GRITv2: Efficient and Light-weight Social Relation Recognition
Not on the map. Why?
Abstract (arXiv)
Our research focuses on the analysis and improvement of the Graph-based Relation Inference Transformer (GRIT), which serves as an important benchmark in the field. We conduct a comprehensive ablation study using the PISC-fine dataset, to find and explore improvement in efficiency and performance of GRITv2. Our research has provided a new state-of-the-art relation recognition model on the PISC relation dataset. We introduce several features in the GRIT model and analyse our new benchmarks in two versions: GRITv2-L (large) and GRITv2-S (small). Our proposed GRITv2-L surpasses existing methods on relation recognition and the GRITv2-S is within 2% performance gap of GRITv2-L, which has only 0.0625x the model size and parameters of GRITv2-L. Furthermore, we also address the need for model compression, an area crucial for deploying efficient models on resource-constrained platforms. By applying quantization techniques, we efficiently reduced the GRITv2-S size to 22MB and deployed it on the flagship OnePlus 12 mobile which still surpasses the PISC-fine benchmarks in performance, highlighting the practical viability and improved efficiency of our model on mobile devices.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 11 Mar 2024.
Builds on
19 of 28 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2013Network In Networkcited by 600
- 2022TinyViT: Fast Pretraining Distillation for Small Vision Transformerscited by 232
- 2021Understanding and Overcoming the Challenges of Efficient Transformer Quantizationcited by 139
- 2022MiniViT: Compressing Vision Transformers with Weight Multiplexingcited by 88
7 more
- 2017Contrastive Learning for Image Captioningcited by 54
- 2018Deep Reasoning with Knowledge Graph for Social Relationship Understandingcited by 44
- 2017Dual-Glance Model for Deciphering Social Relationshipscited by 21
- 2015Beyond Frontal Faces: Improving Person Recognition Using Multiple Cuescited by 20
- 2020Graph-Based Social Relation Reasoningcited by 14
- 2019An End-to-End Network for Generating Social Relationship Graphscited by 11
- 2019Multi-Granularity Reasoning for Social Relation Recognition from Imagescited by 8
Built on by
Not cited yet.