mlsanityData to 14 Oct 2026

InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generation

arXiv 2607.10287 ↗First posted 11 Jul 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Human-pet interaction estimation and generation remain underexplored due to the absence of a high-quality large-scale dataset. We present InterPet4D, the first multimodal dataset capturing natural interactions between humans and dogs. Using a synchronized multi-view capture system, we record human-dog obedience tasks and provide annotations for both humans and dogs, including multi-view and egocentric videos, segmentations, 2D and 3D keypoints, meshes, and audio tracks. InterPet4D consists of 6.8 million frames collected from 13 dogs of 11 breeds interacting with 23 human participants. We further introduce the InterPetMoGen framework for human-pet interaction motion generation. Our proposed model achieves an FID score of 11.21 and substantially outperforms the Seq2Seq and DiT baselines, demonstrating the effectiveness of InterPet4D for modeling realistic human-pet interactions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 40 of its 51 references that are in the map. First posted on arXiv 11 Jul 2026.

Builds on

40 of 51 references.

References · 40

  1. 2017Mask R-CNNcited by 7,277
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  4. 2022Human Motion Diffusion Modelcited by 1,080
  5. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
  6. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  7. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  8. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  9. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  10. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  11. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
  12. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
28 more
  1. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 312
  2. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
  3. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  4. 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
  5. 2018Markerless tracking of user-defined features with deep learningcited by 206
  6. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 206
  7. 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 195
  8. 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 181
  9. 2022Generating Holistic 3D Human Motion from Speechcited by 180
  10. 2020Whole-Body Human Pose Estimation in the Wildcited by 178
  11. 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 178
  12. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
  13. 2026Qwen3-ASR Technical Reportcited by 118
  14. 2019Cross-Domain Adaptation for Animal Pose Estimationcited by 108
  15. 2023EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modelingcited by 105
  16. 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 103
  17. 2018Creatures great and SMAL: Recovering the shape and motion of animals from videocited by 84
  18. 2020Who Left the Dogs Out? 3D Animal Reconstruction with Expectation Maximization in the Loopcited by 81
  19. 2024Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompanimentcited by 47
  20. 2025RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assetscited by 47
  21. 2025Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Datasetcited by 40
  22. 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactionscited by 31
  23. 2022Common Pets in 3D: Dynamic New-View Synthesis of Real-Life Deformable Categoriescited by 29
  24. 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videoscited by 26
  25. 2025FloodDiffusion: Tailored Diffusion Forcing for Streaming Motion Generationcited by 16
  26. 2026DyaDiT: A Multi-Modal Diffusion Transformer for Socially Favorable Dyadic Gesture Generationcited by 7
  27. 2025DogMo: A Large-Scale Multi-View RGB-D Dataset for 4D Canine Motion Recoverycited by 4
  28. 2024RatBodyFormer: Rat Body Surface from Keypointscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animalscited by 0