Learn Fast, Segment Well: Fast Object Segmentation Learning on the iCub Robot
Not on the map. Why?
Abstract (arXiv)
The visual system of a robot has different requirements depending on the application: it may require high accuracy or reliability, be constrained by limited resources or need fast adaptation to dynamically changing environments. In this work, we focus on the instance segmentation task and provide a comprehensive study of different techniques that allow adapting an object segmentation model in presence of novel objects or different domains. We propose a pipeline for fast instance segmentation learning designed for robotic applications where data come in stream. It is based on an hybrid method leveraging on a pre-trained CNN for feature extraction and fast-to-train Kernel-based classifiers. We also propose a training protocol that allows to shorten the training time by performing feature extraction during the data acquisition. We benchmark the proposed pipeline on two robotics datasets and we deploy it on a real robot, i.e. the iCub humanoid. To this aim, we adapt our method to an incremental setting in which novel objects are learned on-line by the robot. The code to reproduce the experiments is publicly available on GitHub.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 41 of its 57 references that are in the map. First posted on arXiv 27 Jun 2022.
Builds on
41 of 57 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2019Objects as Pointscited by 1,175
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
- 2018Path Aggregation Network for Instance Segmentationcited by 798
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
29 more
- 2019YOLACT: Real-time Instance Segmentationcited by 443
- 2016R-FCN: Object Detection via Region-based Fully Convolutional Networkscited by 414
- 2019Mask Scoring R-CNNcited by 266
- 2017Incremental Learning of Object Detectors without Catastrophic Forgettingcited by 208
- 2020BlendMask: Top-Down Meets Bottom-Up for Instance Segmentationcited by 145
- 2019Incremental Learning Techniques for Semantic Segmentationcited by 141
- 2020Deep Snake for Real-Time Instance Segmentationcited by 112
- 2017Online Adaptation of Convolutional Neural Networks for Video Object Segmentationcited by 109
- 2018Continuous Learning in Single-Incremental-Task Scenarioscited by 109
- 2020Incremental Few-Shot Object Detectioncited by 102
- 2019TensorMask: A Foundation for Dense Object Segmentationcited by 101
- 2020Kernel methods through the roof: handling billions of points efficientlycited by 89
- 2019SSAP: Single-Shot Instance Segmentation With Affinity Pyramidcited by 85
- 2020Unseen Object Instance Segmentation for Robotic Environmentscited by 85
- 2017FALKON: An Optimal Large Scale Kernel Methodcited by 84
- 2016Deep Watershed Transform for Instance Segmentationcited by 78
- 2016Learning to Refine Object Segmentscited by 67
- 2016InstanceCut: from Edges to Instances with MultiCutcited by 49
- 2019ShapeMask: Learning to Segment Novel Objects by Refining Shape Priorscited by 43
- 2019The Best of Both Modes: Separately Leveraging RGB and Depth for Unseen Object Instance Segmentationcited by 39
- 2016Instance-sensitive Fully Convolutional Networkscited by 36
- 2018Video Object Segmentation using Teacher-Student Adaptation in a Human Robot Interaction (HRI) Settingcited by 27
- 2018Learning Instance Segmentation by Interactioncited by 18
- 2020Self-supervised Transfer Learning for Instance Segmentation through Physical Interactioncited by 13
- 2020Joint Learning of Instance and Semantic Segmentation for Robotic Pick-and-Place with Heavy Occlusions in Cluttercited by 12
- 2015Enabling Depth-driven Visual Attention on the iCub Humanoid Robot: Instructions for Use and New Perspectivescited by 4
- 2018Speeding-up Object Detection Training for Robotics with FALKONcited by 2
- 2020Fast Region Proposal Learning for Object Detection for Roboticscited by 1
- 2020Fast Object Segmentation Learning with Kernel-based Methods for Roboticscited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 1.
3 papers.
- 2025ZISVFM: Zero-Shot Object Instance Segmentation in Indoor Robotic Environments with Vision Foundation Modelscited by 5
- 2022Progressive Self-Distillation for Ground-to-Aerial Perception Knowledge Transfercited by 0
- 2022Top-Tuning: a study on transfer learning for an efficient alternative to fine tuning for image classification with fast kernel methodscited by 0
- 2025ZISVFM: Zero-Shot Object Instance Segmentation in Indoor Robotic Environments with Vision Foundation Models5 Feb 2025
- 2022Top-Tuning: a study on transfer learning for an efficient alternative to fine tuning for image classification with fast kernel methods16 Sep 2022
- 2022Progressive Self-Distillation for Ground-to-Aerial Perception Knowledge Transfer29 Aug 2022