mlsanityData to 7 Oct 2026

ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactions

arXiv 2401.10232 ↗First posted 18 Jan 2024cs.CVcited by 54

Not on the map. Why?

Abstract (arXiv)

To enable machines to understand the way humans interact with the physical world in daily life, 3D interaction signals should be captured in natural settings, allowing people to engage with multiple objects in a range of sequential and casual manipulations. To achieve this goal, we introduce our ParaHome system designed to capture dynamic 3D movements of humans and objects within a common home environment. Our system features a multi-view setup with 70 synchronized RGB cameras, along with wearable motion capture devices including an IMU-based body suit and hand motion capture gloves. By leveraging the ParaHome system, we collect a new human-object interaction dataset, including 486 minutes of sequences across 207 captures with 38 participants, offering advancements with three key aspects: (1) capturing body motion and dexterous hand manipulation motion alongside multiple objects within a contextual home environment; (2) encompassing sequential and concurrent manipulations paired with text descriptions; and (3) including articulated objects with multiple parts represented by 3D parameterized models. We present detailed design justifications for our system, and perform key generative modeling experiments to demonstrate the potential of our dataset.

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 83 of its 134 references that are in the map. First posted on arXiv 18 Jan 2024.

Builds on

83 of 134 references.

References · 83

  1. 2020Denoising Diffusion Implicit Modelscited by 9,655
  2. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  3. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  4. 2022Human Motion Diffusion Modelcited by 1,062
  5. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  6. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  7. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  8. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  9. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  10. 2023Segment Anything in High Qualitycited by 373
  11. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  12. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
38 more
  1. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  2. 2023Reconstructing Hands in 3D with Transformerscited by 298
  3. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  4. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
  5. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  6. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  7. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
  8. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  9. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
  10. 2017Hand Keypoint Detection in Single Images using Multiview Bootstrappingcited by 231
  11. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 229
  12. 2023Object Motion Guided Human Motion Synthesiscited by 206
  13. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  14. 2020Long-term Human Motion Prediction with Scene Contextcited by 191
  15. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  16. 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
  17. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
  18. 2020Populating 3D Scenes by Learning Human-Scene Interactioncited by 164
  19. 2018Monocular Total Capture: Posing Face, Body, and Hands in the Wildcited by 162
  20. 2022HUMANISE: Language-conditioned Human Motion Generation in 3D Scenescited by 156
  21. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  22. 2020Reconstructing Hand-Object Interactions in the Wildcited by 143
  23. 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
  24. 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 140
  25. 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
  26. 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
  27. 2020Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenescited by 135
  28. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
  29. 2020CPF: Learning a Contact Potential Field to Model the Hand-Object Interactioncited by 127
  30. 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
  31. 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
  32. 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
  33. 2021D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactionscited by 109
  34. 2023Controllable Human-Object Interaction Synthesiscited by 107
  35. 2023Synthesizing Physical Character-Scene Interactionscited by 102
  36. 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
  37. 2022Towards Diverse and Natural Scene-aware 3D Human Motion Synthesiscited by 91
  38. 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 90

50 most cited of 83 All 83 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 20; 2026: 24.

54 papers.

Sort:

By area:

  1. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 109
  2. 2025InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactionscited by 67
  3. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
  4. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
  5. 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learningcited by 56
  6. 2025InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generationcited by 31
  7. 2025HUMOTO: A 4D Dataset of Mocap Human Object Interactionscited by 30
  8. 2024SemGrasp: Semantic Grasp Generation via Language Aligned Discretizationcited by 29
  9. 2025A Survey on Human Interaction Motion Generationcited by 25
  10. 2025SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrationscited by 23
  11. 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
  12. 2024TriDi: Trilateral Diffusion of 3D Humans, Objects, and Interactionscited by 18
38 more
  1. 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 17
  2. 2024Survey on Modeling of Human-made Articulated Objectscited by 14
  3. 2024SCENIC: Scene-aware Semantic Navigation with Instruction-guided Controlcited by 13
  4. 2025PhySIC: Physically Plausible 3D Human-Scene Interaction and Contact from a Single Imagecited by 13
  5. 2025Learning to Transfer Human Hand Skills for Robot Manipulationscited by 10
  6. 2026InterPrior: Scaling Generative Control for Physics-Based Human-Object Interactionscited by 10
  7. 2024SCRREAM : SCan, Register, REnder And Map:A Framework for Annotating Accurate and Dense 3D Indoor Scenes with a Benchmarkcited by 9
  8. 2025ART: Articulated Reconstruction Transformercited by 9
  9. 2024FORCE: Physics-aware Human-object Interactioncited by 7
  10. 2025Target-Aware Video Diffusion Modelscited by 7
  11. 2026WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videoscited by 7
  12. 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videoscited by 7
  13. 20253D Human Interaction Generation: A Surveycited by 6
  14. 2025Learning 3D Object Spatial Relationships from Pre-trained 2D Diffusion Modelscited by 5
  15. 2026Unleashing Guidance Without Classifiers for Human-Object Interaction Animationcited by 5
  16. 2025DAViD: Modeling Dynamic Affordance of 3D Objects Using Pre-trained Video Diffusion Modelscited by 4
  17. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
  18. 2024Agent-to-Sim: Learning Interactive Behavior Models from Casual Longitudinal Videoscited by 3
  19. 2025PA-HOI: A Physics-Aware Human and Object Interaction Datasetcited by 3
  20. 2026InfBaGel: Human-Object-Scene Interaction Generation with Dynamic Perception and Iterative Refinementcited by 3
  21. 2025MMHOI: Modeling Complex 3D Multi-Human Multi-Object Interactionscited by 2
  22. 2026NymeriaPlus: Enriching Nymeria Dataset with Additional Annotations and Datacited by 2
  23. 2026Hand Visibility Detector: Per-Keypoint Visibility Estimation for Handscited by 2
  24. 2025InterPose: Learning to Generate Human-Object Interactions from Large-Scale Web Videoscited by 1
  25. 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 1
  26. 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 1
  27. 2026Seeing Without Eyes: 4D Human-Scene Understanding from Wearable IMUscited by 1
  28. 2026Uni-HOI:A Unified framework for Learning the Joint distribution of Text and Human-Object Interactioncited by 1
  29. 2026Dex2HOI: Dexterous Bimanual Two-Object Interaction Generationcited by 1
  30. 2026GIRAF: Towards Generalizable Human Interactions with Articulated Objectscited by 1
  31. 2026Surface Keypoint Representation for Multi-Object and Articulated Human-Object Interaction Generationcited by 1
  32. 2025Learning to Generate Human-Human-Object Interactions from Textual Descriptionscited by 0
  33. 2026DexterCap: An Affordable and Automated System for Capturing Dexterous Hand-Object Manipulationcited by 0
  34. 2026Action Motifs: Self-Supervised Hierarchical Representation of Human Body Movementscited by 0
  35. 2026OmniRobotHome: A Multi-Camera Home Platform for Real-Time Human-Robot Interactioncited by 0
  36. 2026Dynamic Full-body Motion Agent with Object Interaction via Blending Pre-trained Modular Controllerscited by 0
  37. 2026REACH: Hand Pose Estimation from Room Cornerscited by 0
  38. 2026Recovering Physically Plausible Human-Object Interactions from Monocular Videoscited by 0

50 most cited of 54 All 54 (JSON)