Visual Closed-Loop Control for Pouring Liquids
Not on the map. Why?
Abstract (arXiv)
Pouring a specific amount of liquid is a challenging task. In this paper we develop methods for robots to use visual feedback to perform closed-loop control for pouring liquids. We propose both a model-based and a model-free method utilizing deep learning for estimating the volume of liquid in a container. Our results show that the model-free method is better able to estimate the volume. We combine this with a simple PID controller to pour specific amounts of liquid, and show that the robot is able to achieve an average 38ml deviation from the target amount. To our knowledge, this is the first use of raw visual feedback to pour liquids in robotics.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Oct 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 7; 2022: 5; 2023: 5; 2024: 6; 2025: 2.
26 papers.
Sort:
By area:
- 2021PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-trainingcited by 302
- 2020COG: Connecting New Skills to Past Experience with Offline Reinforcement Learningcited by 83
- 2023Preference Transformer: Modeling Human Preferences using Transformers for RLcited by 79
- 2021A Workflow for Offline Model-Free Robotic Reinforcement Learningcited by 69
- 2023Inverse Preference Learning: Preference-based RL without a Reward Functioncited by 68
- 2023DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physicscited by 23
- 2024Continuously Improving Mobile Manipulation with Autonomous Real-World RLcited by 22
- 2024Privileged Sensing Scaffolds Reinforcement Learningcited by 19
- 2021Explainable Hierarchical Imitation Learning for Robotic Drink Pouringcited by 11
- 2022Self-supervised Transparent Liquid Segmentation for Robotic Pouringcited by 10
- 2024Efficient Preference-based Reinforcement Learning via Aligned Experience Estimationcited by 9
- 2021Manipulation of Granular Materials by Learning Particle Interactionscited by 7
14 more
- 2022One-Shot Domain-Adaptive Imitation Learning via Progressive Learningcited by 6
- 2023DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physicscited by 6
- 2021Improving filling level classification with adversarial trainingcited by 5
- 2024The Sound of Water: Inferring Physical Properties from Pouring Liquidscited by 5
- 2021Image Based Reconstruction of Liquids from 2D Surface Detectionscited by 4
- 2024Vision-based robot manipulation of transparent liquid containers in a laboratory settingcited by 2
- 2021Neural Task Success Classifiers for Robotic Manipulation from Few Real Demonstrationscited by 1
- 2022Visual-Tactile Sensing for Real-time Liquid Volume Estimation in Graspingcited by 1
- 2022Data augmentation with mixtures of max-entropy transformations for filling-level classificationcited by 1
- 2022Training Robots to Evaluate Robots: Example-Based Interactive Reward Functions for Policy Learningcited by 1
- 2023Fluid Viscosity Prediction Leveraging Computer Vision and Robot Interactioncited by 1
- 2024Trajectory-Oriented Policy Optimization with Sparse Rewardscited by 1
- 2025SCOOP'D: Learning Mixed-Liquid-Solid Scooping via Sim2Real Generative Policycited by 1
- 2025ViscNet: Vision-Based In-line Viscometry for Fluid Mixing Processcited by 0
- 2025ViscNet: Vision-Based In-line Viscometry for Fluid Mixing Process1 Dec 2025
- 2025SCOOP'D: Learning Mixed-Liquid-Solid Scooping via Sim2Real Generative Policy13 Oct 2025
- 2024The Sound of Water: Inferring Physical Properties from Pouring Liquids18 Nov 2024
- 2024Continuously Improving Mobile Manipulation with Autonomous Real-World RL30 Sep 2024
- 2024Efficient Preference-based Reinforcement Learning via Aligned Experience Estimation29 May 2024
- 2024Privileged Sensing Scaffolds Reinforcement Learning23 May 2024
- 2024Vision-based robot manipulation of transparent liquid containers in a laboratory setting25 Apr 2024
- 2024Trajectory-Oriented Policy Optimization with Sparse Rewards4 Jan 2024
- 2023DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics11 Dec 2023
- 2023Fluid Viscosity Prediction Leveraging Computer Vision and Robot Interaction4 Aug 2023
- 2023Inverse Preference Learning: Preference-based RL without a Reward Function24 May 2023
- 2023DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics27 Mar 2023
14 more
- 2023Preference Transformer: Modeling Human Preferences using Transformers for RL2 Mar 2023
- 2022Training Robots to Evaluate Robots: Example-Based Interactive Reward Functions for Policy Learning17 Dec 2022
- 2022One-Shot Domain-Adaptive Imitation Learning via Progressive Learning24 Apr 2022
- 2022Data augmentation with mixtures of max-entropy transformations for filling-level classification8 Mar 2022
- 2022Self-supervised Transparent Liquid Segmentation for Robotic Pouring3 Mar 2022
- 2022Visual-Tactile Sensing for Real-time Liquid Volume Estimation in Grasping23 Feb 2022
- 2021Image Based Reconstruction of Liquids from 2D Surface Detections22 Nov 2021
- 2021Manipulation of Granular Materials by Learning Particle Interactions3 Nov 2021
- 2021A Workflow for Offline Model-Free Robotic Reinforcement Learning22 Sep 2021
- 2021Neural Task Success Classifiers for Robotic Manipulation from Few Real Demonstrations1 Jul 2021
- 2021PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-training9 Jun 2021
- 2021Explainable Hierarchical Imitation Learning for Robotic Drink Pouring16 May 2021
- 2021Improving filling level classification with adversarial training8 Feb 2021
- 2020COG: Connecting New Skills to Past Experience with Offline Reinforcement Learning27 Oct 2020
- 2020COG: Connecting New Skills to Past Experience with Offline Reinforcement Learningcited by 83
- 2021A Workflow for Offline Model-Free Robotic Reinforcement Learningcited by 69
- 2021Explainable Hierarchical Imitation Learning for Robotic Drink Pouringcited by 11
- 2022One-Shot Domain-Adaptive Imitation Learning via Progressive Learningcited by 6
- 2022One-Shot Domain-Adaptive Imitation Learning via Progressive Learning24 Apr 2022
- 2021A Workflow for Offline Model-Free Robotic Reinforcement Learning22 Sep 2021
- 2021Explainable Hierarchical Imitation Learning for Robotic Drink Pouring16 May 2021
- 2020COG: Connecting New Skills to Past Experience with Offline Reinforcement Learning27 Oct 2020
- 2021PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-trainingcited by 302
- 2023Inverse Preference Learning: Preference-based RL without a Reward Functioncited by 68
- 2024Efficient Preference-based Reinforcement Learning via Aligned Experience Estimationcited by 9
- 2024Efficient Preference-based Reinforcement Learning via Aligned Experience Estimation29 May 2024
- 2023Inverse Preference Learning: Preference-based RL without a Reward Function24 May 2023
- 2021PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-training9 Jun 2021
- 2023Preference Transformer: Modeling Human Preferences using Transformers for RLcited by 79
- 2023DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physicscited by 23
- 2024Continuously Improving Mobile Manipulation with Autonomous Real-World RLcited by 22
- 2024Privileged Sensing Scaffolds Reinforcement Learningcited by 19
- 2022Self-supervised Transparent Liquid Segmentation for Robotic Pouringcited by 10
- 2021Manipulation of Granular Materials by Learning Particle Interactionscited by 7
- 2023DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physicscited by 6
- 2021Improving filling level classification with adversarial trainingcited by 5
- 2024The Sound of Water: Inferring Physical Properties from Pouring Liquidscited by 5
- 2021Image Based Reconstruction of Liquids from 2D Surface Detectionscited by 4
- 2024Vision-based robot manipulation of transparent liquid containers in a laboratory settingcited by 2
- 2021Neural Task Success Classifiers for Robotic Manipulation from Few Real Demonstrationscited by 1
12 most cited of 18 All 18 (JSON)
- 2025ViscNet: Vision-Based In-line Viscometry for Fluid Mixing Process1 Dec 2025
- 2025SCOOP'D: Learning Mixed-Liquid-Solid Scooping via Sim2Real Generative Policy13 Oct 2025
- 2024The Sound of Water: Inferring Physical Properties from Pouring Liquids18 Nov 2024
- 2024Continuously Improving Mobile Manipulation with Autonomous Real-World RL30 Sep 2024
- 2024Privileged Sensing Scaffolds Reinforcement Learning23 May 2024
- 2024Vision-based robot manipulation of transparent liquid containers in a laboratory setting25 Apr 2024
- 2023DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics11 Dec 2023
- 2023Fluid Viscosity Prediction Leveraging Computer Vision and Robot Interaction4 Aug 2023
- 2023DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics27 Mar 2023
- 2023Preference Transformer: Modeling Human Preferences using Transformers for RL2 Mar 2023
- 2022Training Robots to Evaluate Robots: Example-Based Interactive Reward Functions for Policy Learning17 Dec 2022
- 2022Data augmentation with mixtures of max-entropy transformations for filling-level classification8 Mar 2022
12 newest of 18 All 18 (JSON)