mlsanityData to 14 Oct 2026

Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications

arXiv 2606.20272 ↗First posted 18 Jun 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

AI vision models are a driving factor for the potential use case scenarios of cognitive robotics within in the industry and household applications. A large array of methods from semantic environment analysis towards 6D and grasping pose estimation have been proposed based on the latest AI achievements. However, such advancements require further strong and efficient methods w.r.t. training data and AI-architectures, which are capable in synergy to tackle current challenges, precision limits, and scalability beyond domain gaps. In this paper, we discuss these current limits and trends in the related state-of-the-art which are challenging those. Further we discuss our current work in progress on bridging the domain gap between simulations and real world applications by linking those in the training data generation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 59 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

45 of 59 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2023Segment Anythingcited by 8,234
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2020End-to-End Object Detection with Transformerscited by 7,414
  8. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  9. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  10. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  11. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  12. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
33 more
  1. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  2. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  3. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  4. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  5. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  6. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
  7. 2015A Neural Algorithm of Artistic Stylecited by 483
  8. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  9. 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
  10. 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 316
  11. 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 274
  12. 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 264
  13. 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 242
  14. 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
  15. 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 208
  16. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  17. 2021Multi-Task Reinforcement Learning with Context-based Representationscited by 174
  18. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  19. 2013Deep Learning for Detecting Robotic Graspscited by 116
  20. 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 116
  21. 2019HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objectscited by 110
  22. 2019Self-supervised 6D Object Pose Estimation for Robot Manipulationcited by 101
  23. 2018MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objectscited by 95
  24. 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
  25. 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 87
  26. 2023Contrastive Preference Learning: Learning from Human Feedback without RLcited by 79
  27. 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objectscited by 70
  28. 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
  29. 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 48
  30. 2021SuctionNet-1Billion: A Large-Scale Benchmark for Suction Graspingcited by 32
  31. 2019Learning Grasp Affordance Reasoning through Semantic Relationscited by 23
  32. 2022Unseen Object 6D Pose Estimation: A Benchmark and Baselinescited by 12
  33. 2022DefGraspSim: Physics-based simulation of grasp outcomes for 3D deformable objectscited by 10

Built on by

Not cited yet.