mlsanityData to 7 Oct 2026

iCAN: Instance-Centric Attention Network for Human-Object Interaction Detection

arXiv 1808.10437 ↗First posted 30 Aug 2018cs.CVcited by 126

Not on the map. Why?

Abstract (arXiv)

Recent years have witnessed rapid progress in detecting and recognizing individual object instances. To understand the situation in a scene, however, computers need to recognize how humans interact with surrounding objects. In this paper, we tackle the challenging task of detecting human-object interactions (HOI). Our core idea is that the appearance of a person or an object instance contains informative cues on which relevant parts of an image to attend to for facilitating interaction prediction. To exploit these cues, we propose an instance-centric attention module that learns to dynamically highlight regions in an image conditioned on the appearance of each instance. Such an attention-based network allows us to selectively aggregate features relevant for recognizing HOIs. We validate the efficacy of the proposed network on the Verb in COCO and HICO-DET datasets and show that our approach compares favorably with the state-of-the-arts.

Key facts. Cited by 126 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Aug 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 24; 2022: 32; 2023: 35; 2024: 15; 2025: 13; 2026: 7.

126 papers.

Sort:

By area:

  1. 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
  2. 2021QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Informationcited by 147
  3. 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 134
  4. 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 119
  5. 2021Mining the Benefits of Two-stage and One-stage HOI Detectioncited by 103
  6. 2021Reformulating HOI Detection as Adaptive Set Predictioncited by 95
  7. 2021Detecting Human-Object Interaction via Fabricated Compositional Learningcited by 79
  8. 2021Affordance Transfer Learning for Human-Object Interaction Detectioncited by 79
  9. 2021Glance and Gaze: Inferring Action-aware Points for One-Stage Human-Object Interaction Detectioncited by 58
  10. 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
  11. 2022RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detectioncited by 54
  12. 2021Forecasting Action through Contact Representations from First Person Videocited by 46
38 more
  1. 2022Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detectioncited by 46
  2. 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 44
  3. 2023ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detectioncited by 41
  4. 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
  5. 2022Interactiveness Field in Human-Object Interactionscited by 40
  6. 2022Human-Object Interaction Detection via Disentangled Transformercited by 40
  7. 2023Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memorycited by 38
  8. 2022Interaction Region Visual Transformer for Egocentric Action Anticipationcited by 36
  9. 2022What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactionscited by 35
  10. 2023Relational Context Learning for Human-Object Interaction Detectioncited by 35
  11. 2022MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detectioncited by 34
  12. 2022Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detectioncited by 34
  13. 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
  14. 2021Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queriescited by 31
  15. 2023UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detectioncited by 31
  16. 2022End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillationcited by 30
  17. 2023FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detectioncited by 30
  18. 2021QAHOI: Query-Based Anchors for Human-Object Interaction Detectioncited by 28
  19. 2022HAKE: A Knowledge Engine Foundation for Human Activity Understandingcited by 28
  20. 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
  21. 2023Neural-Logic Human-Object Interaction Detectioncited by 25
  22. 2024Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detectioncited by 25
  23. 2021Exploiting Scene Graphs for Human-Object Interaction Detectioncited by 22
  24. 2022Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semanticscited by 22
  25. 2022Category-Aware Transformer Network for Better Human-Object Interaction Detectioncited by 22
  26. 2023Category Query Learning for Human-Object Interaction Classificationcited by 21
  27. 2023Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Modelcited by 21
  28. 2021ST-HOI: A Spatial-Temporal Baseline for Human-Object Interaction Detection in Videoscited by 20
  29. 2021Video-Text Pre-training with Learned Regionscited by 20
  30. 2022Iwin: Human-Object Interaction Detection via Transformer with Irregular Windowscited by 19
  31. 2023Vision Relation Transformer for Unbiased Scene Graph Generationcited by 18
  32. 2022Geometric Features Informed Multi-person Human-object Interaction Recognition in Videoscited by 17
  33. 2022Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detectioncited by 16
  34. 2021Improving Human-Object Interaction Detection via Phrase Learning and Label Compositioncited by 15
  35. 2022Discovering Human-Object Interaction Concepts via Self-Compositional Learningcited by 15
  36. 2023Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detectioncited by 15
  37. 2024Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Modelscited by 15
  38. 2023Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial Scenariocited by 14

50 most cited of 126 All 126 (JSON)