mlsanityData to 14 Oct 2026

MaskPlanner: Learning-Based Object-Centric Motion Generation from 3D Point Clouds

arXiv 2502.18745 ↗First posted 26 Feb 2025cs.RO cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Object-Centric Motion Generation (OCMG) plays a key role in a variety of industrial applicationsunicodex2014such as robotic spray painting and weldingunicodex2014requiring efficient, scalable, and generalizable algorithms to plan multiple long-horizon trajectories over free-form 3D objects. However, existing solutions rely on specialized heuristics, expensive optimization routines, or restrictive geometry assumptions that limit their adaptability to real-world scenarios. In this work, we introduce a novel, fully data-driven framework that tackles OCMG directly from 3D point clouds, learning to generalize expert path patterns across free-form surfaces. We propose MaskPlanner, a deep learning method that predicts local path segments for a given object while simultaneously inferring "path masks" to group these segments into distinct paths. This design induces the network to capture both local geometric patterns and global task requirements in a single forward pass. Extensive experimentation on a realistic robotic spray painting scenario shows that our approach attains near-complete coverage (above 99%) for unseen objects, while it remains task-agnostic and does not explicitly optimize for paint deposition. Moreover, our real-world validation on a 6-DoF specialized painting robot demonstrates that the generated trajectories are directly executable and yield expert-level painting quality. Our findings crucially highlight the potential of the proposed learning method for OCMG to reduce engineering overhead and seamlessly adapt to several industrial use cases.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 39 of its 79 references that are in the map. First posted on arXiv 26 Feb 2025.

Builds on

39 of 79 references.

References · 39

  1. 2020End-to-End Object Detection with Transformerscited by 7,414
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  3. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  5. 2016Generative Adversarial Imitation Learningcited by 1,597
  6. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
  7. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  8. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
  9. 2018An Algorithmic Perspective on Imitation Learningcited by 459
  10. 2018PCN: Point Completion Networkcited by 384
  11. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
  12. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
27 more
  1. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  2. 2015Order Matters: Sequence to sequence for setscited by 237
  3. 2019Human Motion Trajectory Prediction: A Surveycited by 232
  4. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  5. 2015End-to-end people detection in crowded scenescited by 140
  6. 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 117
  7. 2021Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completioncited by 112
  8. 2019Learning to Paint With Model-based Deep Reinforcement Learningcited by 71
  9. 2018Robust Watertight Manifold Surface Generation Method for ShapeNet Modelscited by 59
  10. 2019DeepGait: Planning and Control of Quadrupedal Gaits using Deep Reinforcement Learningcited by 50
  11. 2016From Perception to Decision: A Data-driven Approach to End-to-end Motion Planning for Autonomous Ground Robotscited by 44
  12. 2016Watch This: Scalable Cost-Function Learning for Path Planning in Urban Environmentscited by 33
  13. 2013Scalable Object Detection using Deep Neural Networkscited by 31
  14. 2018A survey on Deep Learning Advances on Different 3D Data Representationscited by 25
  15. 2019Neural Path Planning: Fixed Time, Near-Optimal Path Generation via Oracle Imitationcited by 23
  16. 2021Denoise and Contrast for Category Agnostic Shape Completioncited by 17
  17. 2016DeepSetNet: Predicting Sets with Deep Neural Networkscited by 15
  18. 20233DSGrasp: 3D Shape-Completion for Robotic Graspcited by 13
  19. 2020Motion Generation Using Bilateral Control-Based Imitation Learning with Autoregressive Learningcited by 11
  20. 2023Fast Kinodynamic Planning on the Constraint Manifold with Deep Neural Networkscited by 9
  21. 2020Multi-UAV Coverage Path Planning for the Inspection of Large and Complex Structurescited by 7
  22. 2022Multi-UAV trajectory planning for 3D visual inspection of complex structurescited by 7
  23. 2022PaintNet: Unstructured Multi-Path Learning from 3D Point Clouds for Robotic Spray Paintingcited by 5
  24. 2023Learning Coverage Paths in Unknown Environments with Deep Reinforcement Learningcited by 5
  25. 2020Motion Planning by Reinforcement Learning for an Unmanned Aerial Vehicle in Virtual Open Space with Static Obstaclescited by 4
  26. 2022Towards Confidence-guided Shape Completion for Robotic Applicationscited by 2
  27. 2024The State of Robot Motion Generationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.