Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulators
Not on the map. Why?
Abstract (arXiv)
Few-shot adaptation is an important capability for intelligent robots that perform tasks in open-world settings such as everyday environments or flexible production. In this paper, we propose a novel approach for non-prehensile manipulation which incrementally adapts a physics-based dynamics model for model-predictive control (MPC). The model prediction is aligned with a few examples of robot-object interactions collected with the MPC. This is achieved by using a parallelizable rigid-body physics simulation as dynamic world model and sampling-based optimization of the model parameters. In turn, the optimized dynamics model can be used for MPC using efficient sampling-based optimization. We evaluate our few-shot adaptation approach in object pushing experiments in simulation and with a real robot.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 20 Sep 2024.
Builds on
20 of 35 references.
References · 20
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2016Deep Visual Foresight for Planning Robot Motioncited by 276
- 2018Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experiencecited by 203
- 2020Sample-efficient Cross-Entropy Method for Real-time Planningcited by 90
- 2018Deep Online Learning via Meta-Learning: Continual Adaptation for Model-Based RLcited by 80
- 2020Scalable Differentiable Physics for Learning and Controlcited by 72
- 2021STORM: An Integrated Framework for Fast Joint-Space Model-Predictive Control for Reactive Manipulationcited by 46
- 2022Predictive Sampling: Real-time Behaviour Synthesis with MuJoCocited by 39
- 2022Curious Exploration via Structured World Models Yields Zero-Shot Object Manipulationcited by 29
- 2024ASID: Active Exploration for System Identification in Robotic Manipulationcited by 27
- 2021DiffSDFSim: Differentiable Rigid-Body Dynamics With Implicit Shapescited by 14
8 more
- 2021Non-prehensile Planar Manipulation via Trajectory Optimization with Complementarity Constraintscited by 13
- 2021Dual Online Stein Variational Inference for Control and Dynamicscited by 10
- 2020Model-Based Generalization Under Parameter Uncertainty Using Path Integral Controlcited by 7
- 2019Accurate Vision-based Manipulation through Contact Reasoningcited by 5
- 2017Uncertainty Averse Pushing with Model Predictive Path Integral Controlcited by 4
- 2023Fine-Tuning Generative Models as an Inference Method for Robotic Taskscited by 4
- 2023Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videoscited by 3
- 2020Self-Adapting Recurrent Models for Object Pushing from Learning in Simulationcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulation
- 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Models
- 2025Prior Reinforce: Goal-Conditioned Dynamic Manipulation with Limited Trials ↗
- 2024Dynamic Non-Prehensile Object Transport via Model-Predictive Reinforcement Learning
- 2026ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics
- 2026World Models for Robotic Manipulation: A Survey
- 2025Dynamic Manipulation of Deformable Objects in 3D: Simulation, Benchmark and Learning Strategy
- 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation