mlsanityData to 14 Oct 2026

Unleashing Guidance Without Classifiers for Human-Object Interaction Animation

arXiv 2603.25734 ↗First posted 26 Mar 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Generating realistic human-object interaction (HOI) animations remains challenging because it requires jointly modeling dynamic human actions and diverse object geometries. Prior diffusion-based approaches often rely on hand-crafted contact priors or human-imposed kinematic constraints to improve contact quality. We propose LIGHT, a data-driven alternative in which guidance emerges from the denoising pace itself, reducing dependence on manually designed priors. Building on diffusion forcing, we factor the representation into modality-specific components and assign individualized noise levels with asynchronous denoising schedules. In this paradigm, cleaner components guide noisier ones through cross-attention, yielding guidance without auxiliary classifiers. We find that this data-driven guidance is inherently contact-aware, and can be enhanced when training is augmented with a broad spectrum of synthetic object geometries, encouraging invariance of contact semantics to geometric diversity. Extensive experiments show that pace-induced guidance more effectively mirrors the benefits of contact priors than conventional classifier-free guidance, while achieving higher contact fidelity, more realistic HOI generation, and stronger generalization to unseen objects and tasks.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 80 of its 88 references that are in the map. First posted on arXiv 26 Mar 2026.

Builds on

80 of 88 references.

References · 80

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Classifier-Free Diffusion Guidancecited by 5,847
  8. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  9. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  10. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  11. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  12. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
38 more
  1. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  2. 2022Human Motion Diffusion Modelcited by 1,080
  3. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  4. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  5. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  6. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  7. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 408
  8. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
  9. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
  10. 2023Human Motion Diffusion as a Generative Priorcited by 357
  11. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
  12. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 295
  13. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  14. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 238
  15. 2023Object Motion Guided Human Motion Synthesiscited by 212
  16. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  17. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  18. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  19. 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
  20. 2020Long-term Human Motion Prediction with Scene Contextcited by 192
  21. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
  22. 2020Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wildcited by 152
  23. 2023MotionGPT: Finetuned LLMs Are General-Purpose Motion Generatorscited by 145
  24. 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 144
  25. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
  26. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 138
  27. 2024Scaling Up Dynamic Human-Scene Interaction Modelingcited by 137
  28. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 135
  29. 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
  30. 2023Controllable Human-Object Interaction Synthesiscited by 109
  31. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 104
  32. 2019Efficient Learning on Point Clouds with Basis Point Setscited by 103
  33. 2023Inter-X: Towards Versatile Human-Human Interaction Analysiscited by 98
  34. 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
  35. 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 93
  36. 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Modelscited by 93
  37. 2021SAGA: Stochastic Whole-Body Grasping with Contactcited by 91
  38. 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 86

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.