Robotic Compliant Object Prying Using Diffusion Policy Guided by Vision and Force Observations
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
The growing adoption of batteries in the electric vehicle industry and various consumer products has created an urgent need for effective recycling solutions. These products often contain a mix of compliant and rigid components, making robotic disassembly a critical step toward achieving scalable recycling processes. Diffusion policy has emerged as a promising approach for learning low-level skills in robotics. To effectively apply diffusion policy to contact-rich tasks, incorporating force as feedback is essential. In this paper, we apply diffusion policy with vision and force in a compliant object prying task. However, when combining low-dimensional contact force with high-dimensional image, the force information may be diluted. To address this issue, we propose a method that effectively integrates force with image data for diffusion policy observations. We validate our approach on a battery prying task that demands high precision and multi-step execution. Our model achieves a 96% success rate in diverse scenarios, marking a 57% improvement over the vision-only baseline. Our method also demonstrates zero-shot transfer capability to handle unseen objects and battery types. Supplementary videos and implementation codes are available on our project website. https://rros-lab.github.io/diffusion-with-force.github.io/
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 37 of its 49 references that are in the map. First posted on arXiv 6 Mar 2025.
Builds on
37 of 49 references.
Closest ancestors · 11
Same direction, newest first
- 2024TacDiffusion: Force-domain Diffusion Policy for Precise Tactile Manipulation17 Sep
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct
- 2023Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Models13 Oct
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration11 Oct
- 2023Goal-Conditioned Imitation Learning using Score-based Diffusion Policies5 Apr
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
- 2023ReorientDiff: Diffusion Model based Reorientation for Object Manipulation28 Feb
- 2023Imitating Human Behaviour with Diffusion Models25 Jan
- 2022DALL-E-Bot: Introducing Web-Scale Diffusion Models to Robotics5 Oct
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusion8 Sep
- 2022Diffusion Policies as an Expressive Policy Class for Offline Reinforcement Learning12 Aug
Other references · 26
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2021Implicit Behavioral Cloningcited by 452
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 344
- 2022Behavior Transformers: Cloning k modes with one stonecited by 304
- 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 289
14 more
- 2018Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Taskscited by 154
- 2020Learning to Generalize Across Long-Horizon Tasks from Human Demonstrationscited by 115
- 2019Self-Supervised Correspondence in Visuomotor Policy Learningcited by 107
- 2017Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-To-End Learning from Demonstrationcited by 100
- 2019IRIS: Implicit Reinforcement without Interaction at Scale for Learning Control from Offline Robot Manipulation Datacited by 86
- 2022ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfercited by 75
- 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulationcited by 68
- 2020Strictly Batch Imitation Learning by Energy-based Distribution Matchingcited by 54
- 2019Deep Imitation Learning of Sequential Fabric Smoothing From an Algorithmic Supervisorcited by 44
- 2023The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objectscited by 41
- 2024ManiWAV: Learning Robot Manipulation from In-the-Wild Audio-Visual Datacited by 31
- 2022Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learningcited by 22
- 2024Hearing Touch: Audio-Visual Pretraining for Contact-Rich Manipulationcited by 14
- 2022That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulationcited by 12
Built on by
Citing papers per year: 2025: 4; 2026: 6.
10 papers.
- 2025FILIC: Dual-Loop Force-Guided Imitation Learning with Impedance Torque Control for Contact-Rich Manipulation Taskscited by 7
- 2026OCRA: Object-Centric Learning with 3D and Tactile Priors for Human-to-Robot Action Transfercited by 6
- 2025Multimodal Diffusion Forcing for Forceful Manipulationcited by 4
- 2025AnoF-Diff: One-Step Diffusion-Based Anomaly Detection for Forceful Tool Usecited by 1
- 2026Refinement of Accelerated Demonstrations via Incremental Iterative Reference Learning Control for Fast Contact-Rich Imitation Learningcited by 1
- 2025ReSeFlow: Rectifying SE(3)-Equivariant Policy Learning Flowscited by 0
- 2026Spacetime Optimal-Transport Attention for Visuo-Haptic Imitation Learning of Contact-Rich Manipulationcited by 0
- 2026A Hierarchical Approach to Imitation Learning for Manipulation Tasks Requiring Time Varying Forcescited by 0
- 2026Vision-Language Grounded Task-Context-Aware Imitation Learning for Robotic Disassemblycited by 0
- 2026Force-Modulated Dexterity: Unified Compliance for Contact-Rich Manipulationcited by 0
- 2026Force-Modulated Dexterity: Unified Compliance for Contact-Rich Manipulation12 Oct 2026
- 2026Vision-Language Grounded Task-Context-Aware Imitation Learning for Robotic Disassembly15 Sep 2026
- 2026A Hierarchical Approach to Imitation Learning for Manipulation Tasks Requiring Time Varying Forces4 Aug 2026
- 2026Spacetime Optimal-Transport Attention for Visuo-Haptic Imitation Learning of Contact-Rich Manipulation19 May 2026
- 2026Refinement of Accelerated Demonstrations via Incremental Iterative Reference Learning Control for Fast Contact-Rich Imitation Learning18 Apr 2026
- 2026OCRA: Object-Centric Learning with 3D and Tactile Priors for Human-to-Robot Action Transfer15 Mar 2026
- 2025Multimodal Diffusion Forcing for Forceful Manipulation6 Nov 2025
- 2025FILIC: Dual-Loop Force-Guided Imitation Learning with Impedance Torque Control for Contact-Rich Manipulation Tasks21 Sep 2025
- 2025ReSeFlow: Rectifying SE(3)-Equivariant Policy Learning Flows20 Sep 2025
- 2025AnoF-Diff: One-Step Diffusion-Based Anomaly Detection for Forceful Tool Use18 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Gentle Object Retraction in Dense Clutter Using Multimodal Force Sensing and Imitation Learning
- 2024Learning Diffusion Policies from Demonstrations For Compliant Contact-rich Manipulation
- 2025Diffusion Models for Robotic Manipulation: A Survey
- 2026Robotic Agentic Platform for Intelligent Electric Vehicle Disassembly ↗
- 2024Just Add Force for Contact-Rich Robot Policies ↗
- 2025FLEX: A Framework for Learning Robot-Agnostic Force-based Skills Involving Sustained Contact Object Manipulation
- 2023Teaching contact-rich tasks from visual demonstrations by constraint extraction ↗
- 2026Residual Compliant Policy: Learning Compliant Policies from Few Demonstrations ↗