Meta-Reinforcement Learning for Robotic Industrial Insertion Tasks
Not on the map. Why?
Abstract (arXiv)
Robotic insertion tasks are characterized by contact and friction mechanics, making them challenging for conventional feedback control methods due to unmodeled physical effects. Reinforcement learning (RL) is a promising approach for learning control policies in such settings. However, RL can be unsafe during exploration and might require a large amount of real-world training data, which is expensive to collect. In this paper, we study how to use meta-reinforcement learning to solve the bulk of the problem in simulation by solving a family of simulated industrial insertion tasks and then adapt policies quickly in the real world. We demonstrate our approach by training an agent to successfully perform challenging real-world insertion tasks using less than 20 trials of real-world experience. Videos and other material are available at https://pearl-insertion.github.io/
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 9; 2023: 5; 2024: 6; 2025: 1; 2026: 1.
28 papers.
Sort:
By area:
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 50
- 2022Factory: Fast Contact for Robotic Assemblycited by 49
- 2021Offline Meta-Reinforcement Learning for Industrial Insertioncited by 37
- 2024JUICER: Data-Efficient Imitation Learning for Robotic Assemblycited by 36
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulationcited by 30
- 2021Robust Multi-Modal Policies for Industrial Assembly via Reinforcement Learning and Demonstrations: A Large-Scale Studycited by 24
- 2024TacDiffusion: Force-domain Diffusion Policy for Precise Tactile Manipulationcited by 23
- 2025ObjectVLA: End-to-End Open-World Object Manipulation Without Demonstrationcited by 20
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Taskscited by 18
- 2022Robust Policy Learning over Multiple Uncertainty Setscited by 16
- 2022Learning on the Job: Self-Rewarding Offline-to-Online Finetuning for Industrial Insertion of Novel Connectors from Visioncited by 11
- 2021Coarse-to-Fine for Sim-to-Real: Sub-Millimetre Precision Across Wide Task Spacescited by 9
16 more
- 2021Residual Feedback Learning for Contact-Rich Manipulation Tasks with Uncertaintycited by 6
- 2022Giving Feedback on Interactive Student Programs with Meta-Explorationcited by 6
- 2022Zero-Shot Policy Transfer with Disentangled Task Representation of Meta-Reinforcement Learningcited by 5
- 2022Real2Sim or Sim2Real: Robotics Visual Insertion using Deep Reinforcement Learning and Real2Sim Policy Adaptationcited by 3
- 2024Meta-Evolve: Continuous Robot Evolution for One-to-many Policy Transfercited by 3
- 2022Accelerating Robot Learning of Contact-Rich Manipulations: A Curriculum Learning Studycited by 2
- 2023Zero-Shot Transfer of Haptics-Based Object Insertion Policiescited by 2
- 2023On First-Order Meta-Reinforcement Learning with Moreau Envelopescited by 1
- 2024Deep Reinforcement Learning for Traveling Purchaser Problemscited by 1
- 2024Automating Deformable Gasket Assemblycited by 1
- 2021Analyzing the Hidden Activations of Deep Policy Networks: Why Representation Matterscited by 0
- 2022Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holescited by 0
- 2022Economical Precise Manipulation and Auto Eye-Hand Coordination with Binocular Visual Reinforcement Learningcited by 0
- 2023Knolling Bot: Teaching Robots the Human Notion of Tidinesscited by 0
- 2023PolyFit: A Peg-in-hole Assembly Framework for Unseen Polygon Shapes via Sim-to-real Adaptationcited by 0
- 2026Few-Shot Learning for Dynamic Operations of Automated Electric Taxi Fleets under Evolving Charging Infrastructure: A Meta-Deep Reinforcement Learning Approachcited by 0
- 2026Few-Shot Learning for Dynamic Operations of Automated Electric Taxi Fleets under Evolving Charging Infrastructure: A Meta-Deep Reinforcement Learning Approach29 Jan 2026
- 2025ObjectVLA: End-to-End Open-World Object Manipulation Without Demonstration26 Feb 2025
- 2024TacDiffusion: Force-domain Diffusion Policy for Precise Tactile Manipulation17 Sep 2024
- 2024Automating Deformable Gasket Assembly22 Aug 2024
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction16 May 2024
- 2024Meta-Evolve: Continuous Robot Evolution for One-to-many Policy Transfer6 May 2024
- 2024JUICER: Data-Efficient Imitation Learning for Robotic Assembly4 Apr 2024
- 2024Deep Reinforcement Learning for Traveling Purchaser Problems3 Apr 2024
- 2023PolyFit: A Peg-in-hole Assembly Framework for Unseen Polygon Shapes via Sim-to-real Adaptation5 Dec 2023
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation25 Oct 2023
- 2023Knolling Bot: Teaching Robots the Human Notion of Tidiness6 Oct 2023
- 2023On First-Order Meta-Reinforcement Learning with Moreau Envelopes20 May 2023
16 more
- 2023Zero-Shot Transfer of Haptics-Based Object Insertion Policies29 Jan 2023
- 2022Giving Feedback on Interactive Student Programs with Meta-Exploration16 Nov 2022
- 2022Learning on the Job: Self-Rewarding Offline-to-Online Finetuning for Industrial Insertion of Novel Connectors from Vision27 Oct 2022
- 2022Zero-Shot Policy Transfer with Disentangled Task Representation of Meta-Reinforcement Learning1 Oct 2022
- 2022Real2Sim or Sim2Real: Robotics Visual Insertion using Deep Reinforcement Learning and Real2Sim Policy Adaptation6 Jun 2022
- 2022Economical Precise Manipulation and Auto Eye-Hand Coordination with Binocular Visual Reinforcement Learning12 May 2022
- 2022Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holes9 May 2022
- 2022Factory: Fast Contact for Robotic Assembly7 May 2022
- 2022Accelerating Robot Learning of Contact-Rich Manipulations: A Curriculum Learning Study27 Apr 2022
- 2022Robust Policy Learning over Multiple Uncertainty Sets14 Feb 2022
- 2021Offline Meta-Reinforcement Learning for Industrial Insertion8 Oct 2021
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Tasks26 Jun 2021
- 2021Residual Feedback Learning for Contact-Rich Manipulation Tasks with Uncertainty8 Jun 2021
- 2021Coarse-to-Fine for Sim-to-Real: Sub-Millimetre Precision Across Wide Task Spaces24 May 2021
- 2021Robust Multi-Modal Policies for Industrial Assembly via Reinforcement Learning and Demonstrations: A Large-Scale Study21 Mar 2021
- 2021Analyzing the Hidden Activations of Deep Policy Networks: Why Representation Matters11 Mar 2021
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 50
- 2022Factory: Fast Contact for Robotic Assemblycited by 49
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulationcited by 30
- 2021Robust Multi-Modal Policies for Industrial Assembly via Reinforcement Learning and Demonstrations: A Large-Scale Studycited by 24
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Taskscited by 18
- 2022Robust Policy Learning over Multiple Uncertainty Setscited by 16
- 2021Coarse-to-Fine for Sim-to-Real: Sub-Millimetre Precision Across Wide Task Spacescited by 9
- 2021Residual Feedback Learning for Contact-Rich Manipulation Tasks with Uncertaintycited by 6
- 2022Giving Feedback on Interactive Student Programs with Meta-Explorationcited by 6
- 2022Zero-Shot Policy Transfer with Disentangled Task Representation of Meta-Reinforcement Learningcited by 5
- 2022Real2Sim or Sim2Real: Robotics Visual Insertion using Deep Reinforcement Learning and Real2Sim Policy Adaptationcited by 3
- 2024Meta-Evolve: Continuous Robot Evolution for One-to-many Policy Transfercited by 3
12 most cited of 23 All 23 (JSON)
- 2026Few-Shot Learning for Dynamic Operations of Automated Electric Taxi Fleets under Evolving Charging Infrastructure: A Meta-Deep Reinforcement Learning Approach29 Jan 2026
- 2024Automating Deformable Gasket Assembly22 Aug 2024
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction16 May 2024
- 2024Meta-Evolve: Continuous Robot Evolution for One-to-many Policy Transfer6 May 2024
- 2024Deep Reinforcement Learning for Traveling Purchaser Problems3 Apr 2024
- 2023PolyFit: A Peg-in-hole Assembly Framework for Unseen Polygon Shapes via Sim-to-real Adaptation5 Dec 2023
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation25 Oct 2023
- 2023Knolling Bot: Teaching Robots the Human Notion of Tidiness6 Oct 2023
- 2023On First-Order Meta-Reinforcement Learning with Moreau Envelopes20 May 2023
- 2023Zero-Shot Transfer of Haptics-Based Object Insertion Policies29 Jan 2023
- 2022Giving Feedback on Interactive Student Programs with Meta-Exploration16 Nov 2022
- 2022Zero-Shot Policy Transfer with Disentangled Task Representation of Meta-Reinforcement Learning1 Oct 2022
12 newest of 23 All 23 (JSON)