mlsanityData to 14 Oct 2026

GOPLA: Generalizable Object Placement Learning via Synthetic Augmentation of Human Arrangement

arXiv 2510.14627 ↗First posted 16 Oct 2025cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Robots are expected to serve as intelligent assistants, helping humans with everyday household organization. A central challenge in this setting is the task of object placement, which requires reasoning about both semantic preferences (e.g., common-sense object relations) and geometric feasibility (e.g., collision avoidance). We present GOPLA, a hierarchical framework that learns generalizable object placement from augmented human demonstrations. A multi-modal large language model translates human instructions and visual inputs into structured plans that specify pairwise object relationships. These plans are then converted into 3D affordance maps with geometric common sense by a spatial mapper, while a diffusion-based planner generates placement poses guided by test-time costs, considering multi-plan distributions and collision avoidance. To overcome data scarcity, we introduce a scalable pipeline that expands human placement demonstrations into diverse synthetic training data. Extensive experiments show that our approach improves placement success rates by 30.04 percentage points over the runner-up, evaluated on positioning accuracy and physical plausibility, demonstrating strong generalization across a wide range of real-world robotic placement scenarios.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 49 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

41 of 49 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  10. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  11. 2022Video Diffusion Modelscited by 2,305
  12. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
29 more
  1. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  2. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
  3. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  4. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  5. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  6. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  7. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  8. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
  9. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 311
  10. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 254
  11. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  12. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  13. 2024PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMscited by 190
  14. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 138
  15. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
  16. 2024MOKA: Open-World Robotic Manipulation through Mark-Based Visual Promptingcited by 129
  17. 2023Evaluating Spatial Understanding of Large Language Modelscited by 66
  18. 2018MID-Fusion: Octree-based Object-Level Multi-Instance Dynamic SLAMcited by 65
  19. 2022GenDexGrasp: Generalizable Dexterous Graspingcited by 56
  20. 2024An Empirical Analysis on Spatial Reasoning Capabilities of Large Multimodal Modelscited by 50
  21. 2021O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance Learningcited by 46
  22. 2025VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulationcited by 46
  23. 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangementcited by 29
  24. 2021My House, My Rules: Learning Tidying Preferences with Graph Neural Networkscited by 27
  25. 2025AnyPlace: Learning Generalized Object Placement for Robot Manipulationcited by 11
  26. 2022TO-Scene: A Large-scale Dataset for Understanding 3D Tabletop Scenescited by 10
  27. 2024Seeing the Unseen: Visual Common Sense for Semantic Placementcited by 9
  28. 2024ClutterGen: A Cluttered Scene Generator for Robot Learningcited by 8
  29. 2023Towards Learning Geometric Eigen-Lengths Crucial for Fitting Taskscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMs
  2. 2023Working Backwards: Learning to Place by Picking
  3. 2025Inference of Human-derived Specifications of Object Placement via Demonstration
  4. 2026Abstention-Aware Personalized Object Rearrangement via Uncertainty-Guided LLM Assistance ↗
  5. 2024"Set It Up!": Functional Object Arrangement with Compositional Generative Models
  6. 2025Improving Generalization of Language-Conditioned Robot Manipulation
  7. 2024Efficient Learning of Object Placement with Intra-Category Transfer
  8. 2026Hierarchical Prompting with Dual LLM Modules for Robotic Task and Motion Planning ↗