mlsanityData to 7 Oct 2026

UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detection

arXiv 2312.12664 ↗First posted 19 Dec 2023cs.CVcited by 31

Not on the map. Why?

Abstract (arXiv)

Recent advances in deep neural networks have achieved significant progress in detecting individual objects from an image. However, object detection is not sufficient to fully understand a visual scene. Towards a deeper visual understanding, the interactions between objects, especially humans and objects are essential. Most prior works have obtained this information with a bottom-up approach, where the objects are first detected and the interactions are predicted sequentially by pairing the objects. This is a major bottleneck in HOI detection inference time. To tackle this problem, we propose UnionDet, a one-stage meta-architecture for HOI detection powered by a novel union-level detector that eliminates this additional inference stage by directly capturing the region of interaction. Our one-stage detector for human-object interaction shows a significant reduction in interaction prediction time 4x~14x while outperforming state-of-the-art methods on two public datasets: V-COCO and HICO-DET.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 19 Dec 2023.

Builds on

26 of 35 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  6. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  7. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  8. 2019YOLACT: Real-time Instance Segmentationcited by 441
  9. 2017Cascaded Pyramid Network for Multi-Person Pose Estimationcited by 341
  10. 2016RMPE: Regional Multi-person Pose Estimationcited by 340
  11. 2016Visual Relationship Detection with Language Priorscited by 333
  12. 2017Learning to Detect Human-Object Interactionscited by 238
14 more
  1. 2013OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networkscited by 224
  2. 2018CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmarkcited by 214
  3. 2017Detecting and Recognizing Human-Object Interactionscited by 199
  4. 2015Visual Semantic Role Labelingcited by 188
  5. 2018Learning Human-Object Interactions by Graph Parsing Neural Networkscited by 176
  6. 2017Single-Shot Refinement Neural Network for Object Detectioncited by 129
  7. 2018iCAN: Instance-Centric Attention Network for Human-Object Interaction Detectioncited by 126
  8. 2019Pose-aware Multi-level Feature Network for Human Object Interaction Detectioncited by 88
  9. 2018M2Det: A Single-Shot Object Detector based on Multi-Level Feature Pyramid Networkcited by 76
  10. 2019Deep Contextual Attention for Human-Object Interaction Detectioncited by 54
  11. 2019Detecting Human-Object Interactions via Functional Generalizationcited by 53
  12. 2018Pairwise Body-Part Attention for Recognizing Human-Object Interactionscited by 34
  13. 2018Detecting Visual Relationships Using Box Attentioncited by 16
  14. 2017Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Taskscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 13; 2025: 14; 2026: 4.

31 papers.

Sort:

By area:

  1. 2024Open-World Human-Object Interaction Detection via Multi-modal Promptscited by 28
  2. 2024Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detectioncited by 25
  3. 2024Learning from Observer Gaze:Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognitioncited by 17
  4. 2024Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Modelscited by 15
  5. 2024Nonverbal Interaction Detectioncited by 14
  6. 2025Locality-Aware Zero-Shot Human-Object Interaction Detectioncited by 12
  7. 2024Groupwise Query Specialization and Quality-Aware Multi-Assignment for Transformer-based Visual Relationship Detectioncited by 11
  8. 2024Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detectioncited by 7
  9. 2025Open-Vocabulary HOI Detection with Interaction-aware Prompt and Concept Calibrationcited by 7
  10. 2024Enhancing Human-Centered Dynamic Scene Understanding via Multiple LLMs Collaborated Reasoningcited by 6
  11. 2024A Review of Human-Object Interaction Detectioncited by 5
  12. 2025An Image-like Diffusion Method for Human-Object Interaction Detectioncited by 5
19 more
  1. 2025Learning Human-Object Interaction as Groupscited by 5
  2. 2024UAHOI: Uncertainty-aware Robust Interaction Learning for HOI Detectioncited by 4
  3. 2025SGC-Net: Stratified Granular Comparison Network for Open-Vocabulary HOI Detectioncited by 3
  4. 2025Egocentric Human-Object Interaction Detection: A New Benchmark and Methodcited by 3
  5. 2025RoHOI: Robustness Benchmark for Human-Object Interaction Detectioncited by 3
  6. 2025No More Sibling Rivalry: Debiasing Human-Object Interaction Detectioncited by 3
  7. 2025Visual Diversity and Region-aware Prompt Learning for Zero-shot HOI Detectioncited by 3
  8. 2026HOI-aware Adaptive Network for Weakly-supervised Action Segmentationcited by 3
  9. 2024Geometric Features Enhanced Human-Object Interaction Detectioncited by 2
  10. 2024Towards Flexible Visual Relationship Segmentationcited by 2
  11. 2025Dynamic Scoring with Enhanced Semantics for Training-Free Human-Object Interaction Detectioncited by 2
  12. 2024SGTR+: End-to-end Scene Graph Generation with Transformercited by 1
  13. 2026Mining Instance-Centric Vision-Language Contexts for Human-Object Interaction Detectioncited by 1
  14. 2025On the Robustness of Human-Object Interaction Detection against Distribution Shiftcited by 0
  15. 2025Conceptualizing Multi-scale Wavelet Attention and Ray-based Encoding for Human-Object Interaction Detectioncited by 0
  16. 2025HOID-R1: Reinforcement Learning for Open-World Human-Object Interaction Detection Reasoning with Multimodal Large Language Modelcited by 0
  17. 2025Multimodal Graph Network Modeling for Human-Object Interaction Detection with PDE Graph Diffusioncited by 0
  18. 2026RegFormer: Transferable Relational Grounding for Efficient Weakly-Supervised Human-Object Interaction Detectioncited by 0
  19. 2026Towards Unconstrained Human-Object Interactioncited by 0