VIRDO: Visio-tactile Implicit Representations of Deformable Objects
Not on the map. Why?
Abstract (arXiv)
Deformable object manipulation requires computationally efficient representations that are compatible with robotic sensing modalities. In this paper, we present VIRDO:an implicit, multi-modal, and continuous representation for deformable-elastic objects. VIRDO operates directly on visual (point cloud) and tactile (reaction forces) modalities and learns rich latent embeddings of contact locations and forces to predict object deformations subject to external contacts.Here, we demonstrate VIRDOs ability to: i) produce high-fidelity cross-modal reconstructions with dense unsupervised correspondences, ii) generalize to unseen contact formations,and iii) state-estimation with partial visio-tactile feedback
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Feb 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 8; 2023: 7; 2024: 5; 2025: 4; 2026: 1.
25 papers.
Sort:
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
- 2022Touch and Go: Learning from Human-Collected Vision and Touchcited by 84
- 2022Learning Multi-Object Dynamics with Compositional Neural Radiance Fieldscited by 63
- 2022SE(3)-Equivariant Relational Rearrangement with Neural Descriptor Fieldscited by 51
- 2022Reinforcement Learning with Neural Radiance Fieldscited by 43
- 2022Visuo-Tactile Transformers for Manipulationcited by 43
- 2024PoCo: Policy Composition from and for Heterogeneous Robot Learningcited by 42
- 2023D3Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangementcited by 35
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2022ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulationcited by 24
- 2023TouchSDF: A DeepSDF Approach for 3D Shape Reconstruction using Vision-Based Tactile Sensingcited by 15
- 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Handscited by 12
13 more
- 2024Learning rigid-body simulators over implicit shapes for large-scale scenes and visioncited by 12
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environmentscited by 11
- 2024DoughNet: A Visual Predictive Model for Topological Manipulation of Deformable Objectscited by 9
- 2023Controllable Visual-Tactile Synthesiscited by 8
- 2023SculptBot: Pre-Trained Models for 3D Deformable Object Manipulationcited by 8
- 2023Learning Generalizable Tool-use Skills through Trajectory Generationcited by 6
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedbackcited by 3
- 2025ViTaSCOPE: Visuo-tactile Implicit Representation for In-hand Pose and Extrinsic Contact Estimationcited by 3
- 2025Implicit Neural-Representation Learning for Elastic Deformable-Object Manipulationscited by 2
- 2025Force-Modulated Visual Policy for Robot-Assisted Dressing with Arm Motionscited by 2
- 2024Implicit Contact Diffuser: Sequential Contact Reasoning with Latent Point Cloud Diffusioncited by 1
- 2023Shape from Shading for Robotic Manipulationcited by 0
- 2026ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objectscited by 0
- 2026ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects28 May 2026
- 2025Force-Modulated Visual Policy for Robot-Assisted Dressing with Arm Motions16 Sep 2025
- 2025ViTaSCOPE: Visuo-tactile Implicit Representation for In-hand Pose and Extrinsic Contact Estimation13 Jun 2025
- 2025Implicit Neural-Representation Learning for Elastic Deformable-Object Manipulations1 May 2025
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environments9 Apr 2025
- 2024Implicit Contact Diffuser: Sequential Contact Reasoning with Latent Point Cloud Diffusion21 Oct 2024
- 2024Learning rigid-body simulators over implicit shapes for large-scale scenes and vision22 May 2024
- 2024DoughNet: A Visual Predictive Model for Topological Manipulation of Deformable Objects18 Apr 2024
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenes22 Mar 2024
- 2024PoCo: Policy Composition from and for Heterogeneous Robot Learning4 Feb 2024
- 2023TouchSDF: A DeepSDF Approach for 3D Shape Reconstruction using Vision-Based Tactile Sensing21 Nov 2023
- 2023Learning Generalizable Tool-use Skills through Trajectory Generation29 Sep 2023
13 more
- 2023D3Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangement28 Sep 2023
- 2023SculptBot: Pre-Trained Models for 3D Deformable Object Manipulation15 Sep 2023
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedback23 May 2023
- 2023Controllable Visual-Tactile Synthesis4 May 2023
- 2023Shape from Shading for Robotic Manipulation24 Apr 2023
- 2022Touch and Go: Learning from Human-Collected Vision and Touch22 Nov 2022
- 2022SE(3)-Equivariant Relational Rearrangement with Neural Descriptor Fields17 Nov 2022
- 2022Visuo-Tactile Transformers for Manipulation30 Sep 2022
- 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Hands6 Jul 2022
- 2022Reinforcement Learning with Neural Radiance Fields3 Jun 2022
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perception5 Apr 2022
- 2022ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation14 Mar 2022
- 2022Learning Multi-Object Dynamics with Compositional Neural Radiance Fields24 Feb 2022
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
- 2022Touch and Go: Learning from Human-Collected Vision and Touchcited by 84
- 2022Learning Multi-Object Dynamics with Compositional Neural Radiance Fieldscited by 63
- 2022SE(3)-Equivariant Relational Rearrangement with Neural Descriptor Fieldscited by 51
- 2022Reinforcement Learning with Neural Radiance Fieldscited by 43
- 2022Visuo-Tactile Transformers for Manipulationcited by 43
- 2024PoCo: Policy Composition from and for Heterogeneous Robot Learningcited by 42
- 2023D3Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangementcited by 35
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2022ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulationcited by 24
- 2023TouchSDF: A DeepSDF Approach for 3D Shape Reconstruction using Vision-Based Tactile Sensingcited by 15
- 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Handscited by 12
12 most cited of 25 All 25 (JSON)
- 2026ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects28 May 2026
- 2025Force-Modulated Visual Policy for Robot-Assisted Dressing with Arm Motions16 Sep 2025
- 2025ViTaSCOPE: Visuo-tactile Implicit Representation for In-hand Pose and Extrinsic Contact Estimation13 Jun 2025
- 2025Implicit Neural-Representation Learning for Elastic Deformable-Object Manipulations1 May 2025
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environments9 Apr 2025
- 2024Implicit Contact Diffuser: Sequential Contact Reasoning with Latent Point Cloud Diffusion21 Oct 2024
- 2024Learning rigid-body simulators over implicit shapes for large-scale scenes and vision22 May 2024
- 2024DoughNet: A Visual Predictive Model for Topological Manipulation of Deformable Objects18 Apr 2024
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenes22 Mar 2024
- 2024PoCo: Policy Composition from and for Heterogeneous Robot Learning4 Feb 2024
- 2023TouchSDF: A DeepSDF Approach for 3D Shape Reconstruction using Vision-Based Tactile Sensing21 Nov 2023
- 2023Learning Generalizable Tool-use Skills through Trajectory Generation29 Sep 2023
12 newest of 25 All 25 (JSON)