mlsanityData to 7 Oct 2026

Seeing by haptic glance: reinforcement learning-based 3D object Recognition

arXiv 2102.07599 ↗First posted 15 Feb 2021cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Human is able to conduct 3D recognition by a limited number of haptic contacts between the target object and his/her fingers without seeing the object. This capability is defined as `haptic glance' in cognitive neuroscience. Most of the existing 3D recognition models were developed based on dense 3D data. Nonetheless, in many real-life use cases, where robots are used to collect 3D data by haptic exploration, only a limited number of 3D points could be collected. In this study, we thus focus on solving the intractable problem of how to obtain cognitively representative 3D key-points of a target object with limited interactions between the robot and the object. A novel reinforcement learning based framework is proposed, where the haptic exploration procedure (the agent iteratively predicts the next position for the robot to explore) is optimized simultaneously with the objective 3D recognition with actively collected 3D points. As the model is rewarded only when the 3D object is accurately recognized, it is driven to find the sparse yet efficient haptic-perceptual 3D representation of the object. Experimental results show that our proposed model outperforms the state of the art models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 15 Feb 2021.

Builds on

14 of 21 references.

References · 14

  1. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  3. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  4. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
  5. 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
  6. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  7. 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
  8. 2018PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attentioncited by 105
  9. 2019DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processingcited by 104
  10. 2019Effective Rotation-invariant Point CNN with Spherical Harmonics kernelscited by 57
  11. 2018Pointwise Rotation-Invariant Network with Adaptive Sampling and 3D Spherical Voxel Convolutioncited by 16
  12. 2020RobustPointSet: A Dataset for Benchmarking Robustness of Point Cloud Classifierscited by 10
2 more
  1. 2019Learning efficient haptic shape exploration with a rigid tactile sensor arraycited by 6
  2. 2020PointMask: Towards Interpretable and Bias-Resilient Point Cloud Processingcited by 5

Built on by

Not cited yet.