AgentHOI: Multi-Agent Reasoning for Human-Object-Interaction Video Generation via Implicit Representation Alignment
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in video diffusion models have spurred interest in human-object interaction (HOI) video generation, which demands fine-grained control over interaction logic beyond single-subject animation. However, existing HOI methods rely heavily on explicit motion control, limiting scalability and generalization across diverse objects and interactions. In this study, we propose AgentHOI, a text-driven HOI video generation following a thinking-before-generation framework that bridges the gap between high-level textual intent and physical execution through multi-agent reasoning over perception, interaction, and motion planning. Building upon the generated interaction plans, we further strengthen text-driven motion understanding. We introduce an implicit text-motion alignment strategy that distills text-to-motion priors into the video diffusion model, enabling robust HOI synthesis without explicit motion inputs at inference. Experiments show that AgentHOI significantly improves interaction naturalness, object appearance preservation, and adherence to complex textual instructions across challenging object-centric scenarios such as wearing and riding. The code is available at https://github.com/bone-11/agenthoi.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. First posted on arXiv 24 Jul 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025FantasyHSI: Video-Generation-Centric 4D Human Synthesis In Any Scene through A Graph-based Multi-Agent Framework
- 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction
- 2026PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions
- 2025MoReGen: Multi-Agent Motion-Reasoning Engine for Code-based Text-to-Video Synthesis
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videos
- 2026SparseCtrl-HOI: Sparse Temporal Control for Human-Object Interaction Video Generation
- 2024ReCorD: Reasoning and Correcting Diffusion for HOI Generation
- 2025HOI-PAGE: Zero-Shot Human-Object Interaction Generation with Part Affordance Guidance