More than a Million Ways to Be Pushed: A High-Fidelity Experimental Dataset of Planar Pushing
Not on the map. Why?
Abstract (arXiv)
Pushing is a motion primitive useful to handle objects that are too large, too heavy, or too cluttered to be grasped. It is at the core of much of robotic manipulation, in particular when physical interaction is involved. It seems reasonable then to wish for robots to understand how pushed objects move. In reality, however, robots often rely on approximations which yield models that are computable, but also restricted and inaccurate. Just how close are those models? How reasonable are the assumptions they are based on? To help answer these questions, and to get a better experimental understanding of pushing, we present a comprehensive and high-fidelity dataset of planar pushing experiments. The dataset contains timestamped poses of a circular pusher and a pushed object, as well as forces at the interaction.We vary the push interaction in 6 dimensions: surface material, shape of the pushed object, contact position, pushing direction, pushing speed, and pushing acceleration. An industrial robot automates the data capturing along precisely controlled position-velocity-acceleration trajectories of the pusher, which give dense samples of positions and forces of uniform quality. We finish the paper by characterizing the variability of friction, and evaluating the most common assumptions and simplifications made by models of frictional pushing in robotics.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 6; 2024: 7; 2025: 6; 2026: 1.
30 papers.
Sort:
By area:
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
- 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learningcited by 143
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2023On Bringing Robots Homecited by 101
- 2024AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agentscited by 83
- 2023QUAR-VLA: Vision-Language-Action Model for Quadruped Robotscited by 55
- 2022End-to-End Affordance Learning for Robotic Manipulationcited by 54
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulationcited by 52
- 2022Learning rigid dynamics with face interaction graph networkscited by 43
18 more
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applicationscited by 28
- 2023HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulationcited by 27
- 2025Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactionscited by 27
- 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulationcited by 22
- 2025DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulationcited by 21
- 2021HyperDynamics: Meta-Learning Object and Agent Dynamics with Hypernetworkscited by 18
- 2022Learning Category-Level Generalizable Object Manipulation Policy via Generative Adversarial Self-Imitation Learning from Demonstrationscited by 15
- 2024Control-oriented Clustering of Visual Latent Representationcited by 8
- 2025MoMaGen: Generating Demonstrations under Soft and Hard Constraints for Multi-Step Bimanual Mobile Manipulationcited by 7
- 2021Object and Relation Centric Representations for Push Effect Predictioncited by 5
- 2022Learning Sequential Latent Variable Models from Multimodal Time Series Datacited by 4
- 2025Latent Adaptive Planner for Dynamic Manipulationcited by 4
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedbackcited by 3
- 2024Enhancing Exploration with Diffusion Policies in Hybrid Off-Policy RL: Application to Non-Prehensile Manipulationcited by 3
- 2021An Efficient Image-to-Image Translation HourGlass-based Architecture for Object Pushing Policy Learningcited by 2
- 2021Single RGB-D Camera Teleoperation for General Robotic Manipulationcited by 1
- 2025Localized Graph-Based Neural Dynamics Models for Terrain Manipulationcited by 1
- 2026Modeling What Changes: Sparse, Residual World Models for Object-Centric Manipulationcited by 0
- 2026Modeling What Changes: Sparse, Residual World Models for Object-Centric Manipulation2 Sep 2026
- 2025Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions6 Nov 2025
- 2025MoMaGen: Generating Demonstrations under Soft and Hard Constraints for Multi-Step Bimanual Mobile Manipulation21 Oct 2025
- 2025Latent Adaptive Planner for Dynamic Manipulation6 May 2025
- 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulation23 Apr 2025
- 2025Localized Graph-Based Neural Dynamics Models for Terrain Manipulation30 Mar 2025
- 2025DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulation21 Mar 2025
- 2024Enhancing Exploration with Diffusion Policies in Hybrid Off-Policy RL: Application to Non-Prehensile Manipulation22 Nov 2024
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct 2024
- 2024Control-oriented Clustering of Visual Latent Representation7 Oct 2024
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulation10 Jul 2024
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots4 Jun 2024
18 more
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applications1 Mar 2024
- 2024AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents23 Jan 2024
- 2023QUAR-VLA: Vision-Language-Action Model for Quadruped Robots22 Dec 2023
- 2023On Bringing Robots Home27 Nov 2023
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations26 Oct 2023
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul 2023
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedback23 May 2023
- 2023HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulation6 May 2023
- 2022Learning rigid dynamics with face interaction graph networks7 Dec 2022
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Parts10 Nov 2022
- 2022End-to-End Affordance Learning for Robotic Manipulation26 Sep 2022
- 2022Learning Sequential Latent Variable Models from Multimodal Time Series Data21 Apr 2022
- 2022Learning Category-Level Generalizable Object Manipulation Policy via Generative Adversarial Self-Imitation Learning from Demonstrations4 Mar 2022
- 2021An Efficient Image-to-Image Translation HourGlass-based Architecture for Object Pushing Policy Learning2 Aug 2021
- 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learning15 Jul 2021
- 2021Single RGB-D Camera Teleoperation for General Robotic Manipulation28 Jun 2021
- 2021HyperDynamics: Meta-Learning Object and Agent Dynamics with Hypernetworks17 Mar 2021
- 2021Object and Relation Centric Representations for Push Effect Prediction3 Feb 2021
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
- 2022Learning Category-Level Generalizable Object Manipulation Policy via Generative Adversarial Self-Imitation Learning from Demonstrationscited by 15
- 2025MoMaGen: Generating Demonstrations under Soft and Hard Constraints for Multi-Step Bimanual Mobile Manipulationcited by 7
- 2025MoMaGen: Generating Demonstrations under Soft and Hard Constraints for Multi-Step Bimanual Mobile Manipulation21 Oct 2025
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations26 Oct 2023
- 2022Learning Category-Level Generalizable Object Manipulation Policy via Generative Adversarial Self-Imitation Learning from Demonstrations4 Mar 2022
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023QUAR-VLA: Vision-Language-Action Model for Quadruped Robotscited by 55
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
- 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learningcited by 143
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2023On Bringing Robots Homecited by 101
- 2022End-to-End Affordance Learning for Robotic Manipulationcited by 54
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulationcited by 52
- 2022Learning rigid dynamics with face interaction graph networkscited by 43
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applicationscited by 28
- 2023HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulationcited by 27
- 2025Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactionscited by 27
- 2021HyperDynamics: Meta-Learning Object and Agent Dynamics with Hypernetworkscited by 18
- 2024Control-oriented Clustering of Visual Latent Representationcited by 8
12 most cited of 19 All 19 (JSON)
- 2025Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions6 Nov 2025
- 2025Latent Adaptive Planner for Dynamic Manipulation6 May 2025
- 2025Localized Graph-Based Neural Dynamics Models for Terrain Manipulation30 Mar 2025
- 2024Control-oriented Clustering of Visual Latent Representation7 Oct 2024
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulation10 Jul 2024
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots4 Jun 2024
- 2024A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applications1 Mar 2024
- 2023On Bringing Robots Home27 Nov 2023
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedback23 May 2023
- 2023HACMan: Learning Hybrid Actor-Critic Maps for 6D Non-Prehensile Manipulation6 May 2023
- 2022Learning rigid dynamics with face interaction graph networks7 Dec 2022
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Parts10 Nov 2022
12 newest of 19 All 19 (JSON)