Analysis and Observations from the First Amazon Picking Challenge
Not on the map. Why?
Abstract (arXiv)
This paper presents a overview of the inaugural Amazon Picking Challenge along with a summary of a survey conducted among the 26 participating teams. The challenge goal was to design an autonomous robot to pick items from a warehouse shelf. This task is currently performed by human workers, and there is hope that robots can someday help increase efficiency and throughput while lowering cost. We report on a 28-question survey posed to the teams to learn about each team's background, mechanism design, perception apparatus, planning and control approach. We identify trends in this data, correlate it with each team's success in the competition, and discuss observations and lessons learned based on survey results and the authors' personal experiences during the challenge.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jan 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 9; 2024: 6; 2025: 10; 2026: 3.
41 papers.
Sort:
By area:
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2023Language-Driven Representation Learning for Roboticscited by 163
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
- 2021Visual Room Rearrangementcited by 101
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapescited by 70
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiescited by 63
- 2023Train Offline, Test Online: A Real Robot Learning Benchmarkcited by 47
29 more
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldcited by 46
- 2021Sample-Efficient Safety Assurances using Conformal Predictioncited by 41
- 2023KITE: Keypoint-Conditioned Policies for Semantic Manipulationcited by 39
- 2021From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligencecited by 35
- 2023Parameter is Not All You Need: Starting from Non-Parametric Networks for 3D Point Cloud Analysiscited by 34
- 2025Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactionscited by 27
- 2024An Economic Framework for 6-DoF Grasp Detectioncited by 23
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Taskscited by 18
- 2023ARMBench: An Object-centric Benchmark Dataset for Robotic Manipulationcited by 18
- 2025RobotArena ∞: Scalable Robot Benchmarking via Real-to-Sim Translationcited by 15
- 2022HRPose: Real-Time High-Resolution 6D Pose Estimation Network Using Knowledge Distillationcited by 11
- 2021Cooperative Multi-Agent Path Finding: Beyond Path Planning and Collision Avoidancecited by 8
- 2025GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenescited by 8
- 2021Benchmarking Off-The-Shelf Solutions to Robotic Assembly Taskscited by 6
- 2022A Simple Approach for Visual Rearrangement: 3D Mapping and Semantic Searchcited by 6
- 2023Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysiscited by 5
- 2023Literature Review: Computer Vision Applications in Transportation Logistics and Warehousingcited by 5
- 2023Model-free Grasping with Multi-Suction Cup Grippers for Robotic Bin Pickingcited by 5
- 2022Category-Level Global Camera Pose Estimation with Multi-Hypothesis Point Cloud Correspondencescited by 3
- 2025Demonstrating Multi-Suction Item Picking at Scale via Multi-Modal Learning of Pick Successcited by 1
- 2025Language-Guided Grasp Detection with Coarse-to-Fine Learning for Robotic Manipulationcited by 1
- 2022Physics-Based Object 6D-Pose Estimation during Non-Prehensile Manipulationcited by 0
- 2024An Integrated Approach to Robotic Object Grasping and Manipulationcited by 0
- 2025Learning to Optimize Package Picking for Large-Scale, Real-World Robot Inductioncited by 0
- 2025RoboEye: Enhancing 2D Robotic Object Identification with Selective 3D Geometric Keypoint Matchingcited by 0
- 2025Constant-Time Planning for Chaining Collision-free Motion to Manipulation Behaviorscited by 0
- 2026Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshotscited by 0
- 2026Robustness of Robotic Manipulation: Foundations and Frontierscited by 0
- 2026Robustness of Robotic Manipulation: Foundations and Frontiers30 Jun 2026
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robots4 Mar 2026
- 2026Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots12 Feb 2026
- 2025Language-Guided Grasp Detection with Coarse-to-Fine Learning for Robotic Manipulation24 Dec 2025
- 2025Constant-Time Planning for Chaining Collision-free Motion to Manipulation Behaviors30 Nov 2025
- 2025Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions6 Nov 2025
- 2025RobotArena ∞: Scalable Robot Benchmarking via Real-to-Sim Translation27 Oct 2025
- 2025RoboEye: Enhancing 2D Robotic Object Identification with Selective 3D Geometric Keypoint Matching18 Sep 2025
- 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies22 Jun 2025
- 2025Demonstrating Multi-Suction Item Picking at Scale via Multi-Modal Learning of Pick Success12 Jun 2025
- 2025Learning to Optimize Package Picking for Large-Scale, Real-World Robot Induction11 Jun 2025
- 2025GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenes9 Apr 2025
29 more
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real World31 Mar 2025
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov 2024
- 2024An Integrated Approach to Robotic Object Grasping and Manipulation20 Nov 2024
- 2024An Economic Framework for 6-DoF Grasp Detection11 Jul 2024
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detection17 Jun 2024
- 2024Evaluating Real-World Robot Manipulation Policies in Simulation9 May 2024
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation14 Mar 2024
- 2023Model-free Grasping with Multi-Suction Cup Grippers for Robotic Bin Picking31 Jul 2023
- 2023KITE: Keypoint-Conditioned Policies for Semantic Manipulation29 Jun 2023
- 2023HomeRobot: Open-Vocabulary Mobile Manipulation20 Jun 2023
- 2023Train Offline, Test Online: A Real Robot Learning Benchmark1 Jun 2023
- 2023Literature Review: Computer Vision Applications in Transportation Logistics and Warehousing12 Apr 2023
- 2023ARMBench: An Object-centric Benchmark Dataset for Robotic Manipulation29 Mar 2023
- 2023Parameter is Not All You Need: Starting from Non-Parametric Networks for 3D Point Cloud Analysis14 Mar 2023
- 2023Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis1 Mar 2023
- 2023Language-Driven Representation Learning for Robotics24 Feb 2023
- 2022Physics-Based Object 6D-Pose Estimation during Non-Prehensile Manipulation24 Nov 2022
- 2022Category-Level Global Camera Pose Estimation with Multi-Hypothesis Point Cloud Correspondences28 Sep 2022
- 2022A Simple Approach for Visual Rearrangement: 3D Mapping and Semantic Search21 Jun 2022
- 2022HRPose: Real-Time High-Resolution 6D Pose Estimation Network Using Knowledge Distillation20 Apr 2022
- 2021From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligence28 Oct 2021
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapes12 Oct 2021
- 2021Sample-Efficient Safety Assurances using Conformal Prediction28 Sep 2021
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments6 Aug 2021
- 2021Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Tasks26 Jun 2021
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baseline9 Jun 2021
- 2021Cooperative Multi-Agent Path Finding: Beyond Path Planning and Collision Avoidance23 May 2021
- 2021Visual Room Rearrangement30 Mar 2021
- 2021Benchmarking Off-The-Shelf Solutions to Robotic Assembly Tasks8 Mar 2021
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2023Language-Driven Representation Learning for Roboticscited by 163
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
- 2021Visual Room Rearrangementcited by 101
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapescited by 70
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiescited by 63
- 2023Train Offline, Test Online: A Real Robot Learning Benchmarkcited by 47
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
12 most cited of 38 All 38 (JSON)
- 2026Robustness of Robotic Manipulation: Foundations and Frontiers30 Jun 2026
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robots4 Mar 2026
- 2025Language-Guided Grasp Detection with Coarse-to-Fine Learning for Robotic Manipulation24 Dec 2025
- 2025Constant-Time Planning for Chaining Collision-free Motion to Manipulation Behaviors30 Nov 2025
- 2025Real-to-Sim Robot Policy Evaluation with Gaussian Splatting Simulation of Soft-Body Interactions6 Nov 2025
- 2025RoboEye: Enhancing 2D Robotic Object Identification with Selective 3D Geometric Keypoint Matching18 Sep 2025
- 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies22 Jun 2025
- 2025Demonstrating Multi-Suction Item Picking at Scale via Multi-Modal Learning of Pick Success12 Jun 2025
- 2025Learning to Optimize Package Picking for Large-Scale, Real-World Robot Induction11 Jun 2025
- 2025GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenes9 Apr 2025
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real World31 Mar 2025
- 2024An Integrated Approach to Robotic Object Grasping and Manipulation20 Nov 2024
12 newest of 38 All 38 (JSON)