Coarse-to-Fine Q-attention with Learned Path Ranking
Not on the map. Why?
Abstract (arXiv)
We propose Learned Path Ranking (LPR), a method that accepts an end-effector goal pose, and learns to rank a set of goal-reaching paths generated from an array of path generating methods, including: path planning, Bezier curve sampling, and a learned policy. The core idea being that each of the path generation modules will be useful in different tasks, or at different stages in a task. When LPR is added as an extension to C2F-ARM, our new system, C2F-ARM+LPR, retains the sample efficiency of its predecessor, while also being able to accomplish a larger set of tasks; in particular, tasks that require very specific motions (e.g. opening toilet seat) that need to be inferred from both demonstrations and exploration data. In addition to benchmarking our approach across 16 RLBench tasks, we also learn real-world tasks, tabula rasa, in 10-15 minutes, with only 3 demonstrations.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 4 Apr 2022.
Builds on
16 of 24 references.
References · 16
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 202
- 2018Sim-to-Real via Sim-to-Sim: Data-efficient Robotic Grasping via Randomized-to-Canonical Adaptation Networkscited by 171
- 2016Value Iteration Networkscited by 158
- 2018Sim-to-Real Reinforcement Learning for Deformable Object Manipulationcited by 124
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 120
- 2021Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulationcited by 85
- 2018Motion Planning Networkscited by 78
- 2018Composable Deep Reinforcement Learning for Robotic Manipulationcited by 70
- 2017PRM-RL: Long-range Robotic Navigation Tasks by Combining Reinforcement Learning and Sampling-based Planningcited by 64
- 2020Object Rearrangement Using Learned Implicit Collision Functionscited by 43
4 more
- 2019Differentiable Gaussian Process Motion Planningcited by 27
- 2019Neural Path Planning: Fixed Time, Near-Optimal Path Generation via Oracle Imitationcited by 23
- 20163D Simulation for Robot Arm Control with Deep Q-Learningcited by 19
- 2022Bingham Policy Parameterization for 3D Rotations in Reinforcement Learningcited by 7
Built on by
Citing papers per year: 2022: 5; 2023: 1; 2024: 3; 2025: 1; 2026: 3.
13 papers.
Sort:
By area:
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2022Masked World Models for Visual Controlcited by 169
- 2022Instruction-driven history-aware policies for robotic manipulationscited by 93
- 2024Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulationcited by 92
- 2023Multi-View Masked World Models for Visual Robotic Manipulationcited by 78
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 45
- 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmarkcited by 30
- 2022On the Effectiveness of Fine-tuning Versus Meta-reinforcement Learningcited by 18
- 2025Chain-of-Action: Trajectory Autoregressive Modeling for Robotic Manipulationcited by 16
- 2022Coarse-to-fine Q-attention with Tree Expansioncited by 9
- 2026KEMO: Event-Driven Keyframe Memory for Long-Horizon Robot Manipulation with VLA Policiescited by 5
- 2026Lift3D-VLA: Lifting VLA Models to 3D Geometry and Dynamics-Aware Manipulationcited by 1
1 more
- 2026Lift3D-VLA: Lifting VLA Models to 3D Geometry and Dynamics-Aware Manipulation7 Jul 2026
- 2026KEMO: Event-Driven Keyframe Memory for Long-Horizon Robot Manipulation with VLA Policies22 Jun 2026
- 2026SkiP: When to Skip and When to Refine for Efficient Robot Manipulation15 May 2026
- 2025Chain-of-Action: Trajectory Autoregressive Modeling for Robotic Manipulation11 Jun 2025
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulation27 Nov 2024
- 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmark10 Jul 2024
- 2024Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation6 Mar 2024
- 2023Multi-View Masked World Models for Visual Robotic Manipulation5 Feb 2023
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation12 Sep 2022
- 2022Instruction-driven history-aware policies for robotic manipulations11 Sep 2022
- 2022Masked World Models for Visual Control28 Jun 2022
- 2022On the Effectiveness of Fine-tuning Versus Meta-reinforcement Learning7 Jun 2022
1 more
- 2022Coarse-to-fine Q-attention with Tree Expansion26 Apr 2022
- 2022Masked World Models for Visual Controlcited by 169
- 2023Multi-View Masked World Models for Visual Robotic Manipulationcited by 78
- 2023Multi-View Masked World Models for Visual Robotic Manipulation5 Feb 2023
- 2022Masked World Models for Visual Control28 Jun 2022
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2022Instruction-driven history-aware policies for robotic manipulationscited by 93
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 45
- 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmarkcited by 30
- 2022On the Effectiveness of Fine-tuning Versus Meta-reinforcement Learningcited by 18
- 2025Chain-of-Action: Trajectory Autoregressive Modeling for Robotic Manipulationcited by 16
- 2022Coarse-to-fine Q-attention with Tree Expansioncited by 9
- 2025Chain-of-Action: Trajectory Autoregressive Modeling for Robotic Manipulation11 Jun 2025
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulation27 Nov 2024
- 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmark10 Jul 2024
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation12 Sep 2022
- 2022Instruction-driven history-aware policies for robotic manipulations11 Sep 2022
- 2022On the Effectiveness of Fine-tuning Versus Meta-reinforcement Learning7 Jun 2022
- 2022Coarse-to-fine Q-attention with Tree Expansion26 Apr 2022