Mitigating Long-Tail Bias in HOI Detection via Adaptive Diversity Cache
Not on the map. Why?
Abstract (arXiv)
Human-Object Interaction (HOI) detection is a fundamental task in computer vision, empowering machines to comprehend human-object relationships in diverse real-world scenarios. Recent advances in VLMs have significantly improved HOI detection by leveraging rich cross-modal representations. However, most existing VLM-based approaches rely heavily on additional training or prompt tuning, resulting in substantial computational overhead and limited scalability, particularly in long-tailed scenarios where rare interactions are severely underrepresented. In this paper, we propose the Adaptive Diversity Cache (ADC) module, a novel training-free and plug-and-play mechanism designed to mitigate long-tail bias in HOI detection. ADC constructs class-specific caches that accumulate high-confidence and diverse feature representations during inference. The method incorporates adaptive capacity allocation favoring rare categories and dynamic feature augmentation to enable robust prediction calibration without requiring additional training or fine-tuning. Extensive experiments on HICO-DET and V-COCO datasets show that ADC consistently improves existing HOI detectors, particularly enhancing rare category detection while preserving overall performance. These findings confirm the effectiveness of ADC as a training-free, plug-and-play solution for long-tail bias mitigation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
45 of 61 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2015VQA: Visual Question Answeringcited by 2,506
- 2022MaPLe: Multi-modal Prompt Learningcited by 687
- 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 286
- 2022Contrastive Test-Time Adaptationcited by 261
- 2017Learning to Detect Human-Object Interactionscited by 240
- 2015Visual Semantic Role Labelingcited by 190
- 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
- 2020Human Action Recognition from Various Data Modalities: A Reviewcited by 163
- 2021QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Informationcited by 147
33 more
- 2024Efficient Test-Time Adaptation of Vision-Language Modelscited by 141
- 2018iCAN: Instance-Centric Attention Network for Human-Object Interaction Detectioncited by 127
- 2022GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detectioncited by 120
- 2020DRG: Dual Relation Graph for Human-Object Interaction Detectioncited by 117
- 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
- 2022MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentationcited by 76
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
- 2023HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Modelscited by 61
- 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
- 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
- 2022RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detectioncited by 55
- 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 45
- 2023ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detectioncited by 41
- 2022Interactiveness Field in Human-Object Interactionscited by 40
- 2023Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memorycited by 38
- 2024Dual Prototype Evolving for Test-Time Generalization of Vision-Language Modelscited by 38
- 2023Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Modelscited by 34
- 2023FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detectioncited by 30
- 2024EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI Detectioncited by 28
- 2023Neural-Logic Human-Object Interaction Detectioncited by 25
- 2024Prototypical Calibrating Ambiguous Samples for Micro-Action Recognitioncited by 22
- 2024BoostAdapter: Improving Vision-Language Test-Time Adaptation via Regional Bootstrappingcited by 19
- 2023Efficient Test-Time Adaptation for Super-Resolution with Second-Order Degradation and Reconstructioncited by 18
- 2022Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detectioncited by 16
- 2024Unseen No More: Unlocking the Potential of CLIP for Generative Zero-shot HOI Detectioncited by 11
- 2024Multimodal Commonsense Knowledge Distillation for Visual Question Answeringcited by 11
- 2024Frame Order Matters: A Temporal Sequence-Aware Model for Few-Shot Action Recognitioncited by 10
- 2023HODN: Disentangling Human-Object Feature for HOI Detectioncited by 9
- 2024Simultaneous Detection and Interaction Reasoning for Object-Centric Action Recognitioncited by 8
- 2024Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detectioncited by 7
- 2024Decoupled Prototype Learning for Reliable Test-Time Adaptationcited by 7
- 2025Bidirectional Prototype-Reward co-Evolution for Test-Time Adaptation of Vision-Language Modelscited by 6
- 2025Large model enhanced computational ghost imagingcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Towards Unconstrained Human-Object Interaction
- 2024CycleHOI: Improving Human-Object Interaction Detection with Cycle Consistency of Detection and Generation
- 2023Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning
- 2025Dynamic Scoring with Enhanced Semantics for Training-Free Human-Object Interaction Detection
- 2026Streamlined Open-Vocabulary Human-Object Interaction Detection
- 2023Enhancing HOI Detection with Contextual Cues from Large Vision-Language Models
- 2024VLM-HOI: Vision Language Models for Interpretable Human-Object Interaction Analysis
- 2025HOLa: Zero-Shot HOI Detection with Low-Rank Decomposed VLM Feature Adaptation