mlsanityData to 7 Oct 2026

Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulators

arXiv 2409.13228 ↗First posted 20 Sep 2024cs.RO cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Few-shot adaptation is an important capability for intelligent robots that perform tasks in open-world settings such as everyday environments or flexible production. In this paper, we propose a novel approach for non-prehensile manipulation which incrementally adapts a physics-based dynamics model for model-predictive control (MPC). The model prediction is aligned with a few examples of robot-object interactions collected with the MPC. This is achieved by using a parallelizable rigid-body physics simulation as dynamic world model and sampling-based optimization of the model parameters. In turn, the optimized dynamics model can be used for MPC using efficient sampling-based optimization. We evaluate our few-shot adaptation approach in object pushing experiments in simulation and with a real robot.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 20 Sep 2024.

Builds on

20 of 35 references.

References · 20

  1. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  2. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
  3. 2016Deep Visual Foresight for Planning Robot Motioncited by 276
  4. 2018Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experiencecited by 203
  5. 2020Sample-efficient Cross-Entropy Method for Real-time Planningcited by 90
  6. 2018Deep Online Learning via Meta-Learning: Continual Adaptation for Model-Based RLcited by 80
  7. 2020Scalable Differentiable Physics for Learning and Controlcited by 72
  8. 2021STORM: An Integrated Framework for Fast Joint-Space Model-Predictive Control for Reactive Manipulationcited by 46
  9. 2022Predictive Sampling: Real-time Behaviour Synthesis with MuJoCocited by 39
  10. 2022Curious Exploration via Structured World Models Yields Zero-Shot Object Manipulationcited by 29
  11. 2024ASID: Active Exploration for System Identification in Robotic Manipulationcited by 27
  12. 2021DiffSDFSim: Differentiable Rigid-Body Dynamics With Implicit Shapescited by 14
8 more
  1. 2021Non-prehensile Planar Manipulation via Trajectory Optimization with Complementarity Constraintscited by 13
  2. 2021Dual Online Stein Variational Inference for Control and Dynamicscited by 10
  3. 2020Model-Based Generalization Under Parameter Uncertainty Using Path Integral Controlcited by 7
  4. 2019Accurate Vision-based Manipulation through Contact Reasoningcited by 5
  5. 2017Uncertainty Averse Pushing with Model Predictive Path Integral Controlcited by 4
  6. 2023Fine-Tuning Generative Models as an Inference Method for Robotic Taskscited by 4
  7. 2023Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videoscited by 3
  8. 2020Self-Adapting Recurrent Models for Object Pushing from Learning in Simulationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulation
  2. 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Models
  3. 2025Prior Reinforce: Goal-Conditioned Dynamic Manipulation with Limited Trials ↗
  4. 2024Dynamic Non-Prehensile Object Transport via Model-Predictive Reinforcement Learning
  5. 2026ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics
  6. 2026World Models for Robotic Manipulation: A Survey
  7. 2025Dynamic Manipulation of Deformable Objects in 3D: Simulation, Benchmark and Learning Strategy
  8. 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation