mlsanityData to 7 Oct 2026

GRITv2: Efficient and Light-weight Social Relation Recognition

arXiv 2403.06895 ↗First posted 11 Mar 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Our research focuses on the analysis and improvement of the Graph-based Relation Inference Transformer (GRIT), which serves as an important benchmark in the field. We conduct a comprehensive ablation study using the PISC-fine dataset, to find and explore improvement in efficiency and performance of GRITv2. Our research has provided a new state-of-the-art relation recognition model on the PISC relation dataset. We introduce several features in the GRIT model and analyse our new benchmarks in two versions: GRITv2-L (large) and GRITv2-S (small). Our proposed GRITv2-L surpasses existing methods on relation recognition and the GRITv2-S is within 2% performance gap of GRITv2-L, which has only 0.0625x the model size and parameters of GRITv2-L. Furthermore, we also address the need for model compression, an area crucial for deploying efficient models on resource-constrained platforms. By applying quantization techniques, we efficiently reduced the GRITv2-S size to 22MB and deployed it on the flagship OnePlus 12 mobile which still surpasses the PISC-fine benchmarks in performance, highlighting the practical viability and improved efficiency of our model on mobile devices.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 11 Mar 2024.

Builds on

19 of 28 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2017Squeeze-and-Excitation Networkscited by 4,763
  6. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  7. 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
  8. 2015Gated Graph Sequence Neural Networkscited by 792
  9. 2013Network In Networkcited by 600
  10. 2022TinyViT: Fast Pretraining Distillation for Small Vision Transformerscited by 232
  11. 2021Understanding and Overcoming the Challenges of Efficient Transformer Quantizationcited by 139
  12. 2022MiniViT: Compressing Vision Transformers with Weight Multiplexingcited by 88
7 more
  1. 2017Contrastive Learning for Image Captioningcited by 54
  2. 2018Deep Reasoning with Knowledge Graph for Social Relationship Understandingcited by 44
  3. 2017Dual-Glance Model for Deciphering Social Relationshipscited by 21
  4. 2015Beyond Frontal Faces: Improving Person Recognition Using Multiple Cuescited by 20
  5. 2020Graph-Based Social Relation Reasoningcited by 14
  6. 2019An End-to-End Network for Generating Social Relationship Graphscited by 11
  7. 2019Multi-Granularity Reasoning for Social Relation Recognition from Imagescited by 8

Built on by

Not cited yet.