mlsanityData to 7 Oct 2026

BimArt: A Unified Approach for the Synthesis of 3D Bimanual Interaction with Articulated Objects

arXiv 2412.05066 ↗First posted 6 Dec 2024cs.CV cs.GR cs.ROcited by 29

Not on the map. Why?

Abstract (arXiv)

We present BimArt, a novel generative approach for synthesizing 3D bimanual hand interactions with articulated objects. Unlike prior works, we do not rely on a reference grasp, a coarse hand trajectory, or separate modes for grasping and articulating. To achieve this, we first generate distance-based contact maps conditioned on the object trajectory with an articulation-aware feature representation, revealing rich bimanual patterns for manipulation. The learned contact prior is then used to guide our hand motion generator, producing diverse and realistic bimanual motions for object movement and articulation. Our work offers key insights into feature representation and contact prior for articulated objects, demonstrating their effectiveness in taming the complex, high-dimensional space of bimanual hand-object interactions. Through comprehensive quantitative experiments, we demonstrate a clear step towards simplified and high-quality hand-object animations that surpass the state of the art in motion quality and diversity. Project page: https://vcai.mpi-inf.mpg.de/projects/bimart/.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 73 of its 88 references that are in the map. First posted on arXiv 6 Dec 2024.

Builds on

73 of 88 references.

References · 73

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  9. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  10. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  11. 2022Human Motion Diffusion Modelcited by 1,062
  12. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
38 more
  1. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  2. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  3. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  4. 2017On human motion prediction using recurrent neural networkscited by 336
  5. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  6. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  7. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  8. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  9. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  10. 2023Object Motion Guided Human Motion Synthesiscited by 206
  11. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  12. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  13. 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
  14. 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
  15. 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 145
  16. 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
  17. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
  18. 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 129
  19. 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
  20. 2021D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactionscited by 109
  21. 2023Controllable Human-Object Interaction Synthesiscited by 107
  22. 2019Efficient Learning on Point Clouds with Basis Point Setscited by 101
  23. 2023UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learningcited by 101
  24. 2023Optimizing Diffusion Noise Can Serve As Universal Motion Priorscited by 97
  25. 2022What's in your hands? 3D Reconstruction of Generic Objects in Handscited by 90
  26. 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Modelscited by 89
  27. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 88
  28. 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 85
  29. 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 84
  30. 2024Generating Human Interaction Motions in Scenes with Text Controlcited by 80
  31. 2023Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clipscited by 73
  32. 2022TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinementcited by 69
  33. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  34. 2024DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptionscited by 60
  35. 2024GraspXL: Generating Grasping Motions for Diverse Objects at Scalecited by 59
  36. 2023CAMS: CAnonicalized Manipulation Spaces for Category-Level Functional Hand-Object Manipulation Synthesiscited by 54
  37. 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulationcited by 53
  38. 2023Physically Plausible Full-Body Hand-Object Interaction Synthesiscited by 52

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 20.

29 papers.

Sort:

By area:

  1. 2025A Survey on Human Interaction Motion Generationcited by 25
  2. 2025OpenHOI: Open-World Hand-Object Interaction Synthesis with Multimodal Large Language Modelcited by 17
  3. 2025HOIDiNi: Human-Object Interaction through Diffusion Noise Optimizationcited by 16
  4. 2024SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesiscited by 12
  5. 2026LOME: Learning Human-Object Manipulation with Action-Conditioned Egocentric World Modelcited by 12
  6. 2025CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objectscited by 10
  7. 2026WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videoscited by 7
  8. 2026Unleashing Guidance Without Classifiers for Human-Object Interaction Animationcited by 5
  9. 2025VHOI: Controllable Video Generation of Human-Object Interactions from Sparse Trajectories via Motion Densificationcited by 4
  10. 2025SIGHT: Synthesizing Image-Text Conditioned and Geometry-Guided 3D Hand-Object Trajectoriescited by 3
  11. 2026SceMoS: Scene-Aware 3D Human Motion Synthesis by Planning with Geometry-Grounded Tokenscited by 2
  12. 2026HandX: Scaling Bimanual Motion and Interaction Generationcited by 2
17 more
  1. 2026Open-CHOIR: Open-World Contact-Aware 4D Hand-Object Interaction Reconstructioncited by 2
  2. 2026RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generationcited by 2
  3. 2026JointHOI: Jointly Generating Contact Maps Enhances Hand Object Interaction Generationcited by 2
  4. 2025Bimanual 3D Hand Motion and Articulation Forecasting in Everyday Imagescited by 1
  5. 2025Interaction-Aware 4D Gaussian Splatting for Dynamic Hand-Object Interaction Reconstructioncited by 1
  6. 2026CLUTCH: Contextualized Language model for Unlocking Text-Conditioned Hand motion modelling in the wildcited by 1
  7. 2026HO-Flow: Generalizable Hand-Object Interaction Generation with Latent Flow Matchingcited by 1
  8. 2026Uni-HOI:A Unified framework for Learning the Joint distribution of Text and Human-Object Interactioncited by 1
  9. 2026UniCross: Unified Cross-Skill Dexterous Manipulation Synthesiscited by 1
  10. 2026Surface Keypoint Representation for Multi-Object and Articulated Human-Object Interaction Generationcited by 1
  11. 2026LEXIS: LatEnt ProXimal Interaction Signatures for 3D HOI from an Imagecited by 0
  12. 2026PhysHanDI: Physics-Based Reconstruction of Hand-Deformable Object Interactionscited by 0
  13. 2026DCGrasp: Distance-aware Controllable Grasp Generationcited by 0
  14. 2026A Synthetic-Driven Vision System for Assembly Step Recognitioncited by 0
  15. 2026Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfercited by 0
  16. 2026PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photographcited by 0
  17. 2026MAD-HOI: Masked Autoregressive Diffusion for Generating Articulated Hand Object Interactions from Textcited by 0