mlsanityData to 7 Oct 2026

Map Imagination Like Blind Humans: Group Diffusion Model for Robotic Map Generation

arXiv 2412.16908 ↗First posted 22 Dec 2024cs.RO cs.AIcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Can robots imagine or generate maps like humans do, especially when only limited information can be perceived like blind people? To address this challenging task, we propose a novel group diffusion model (GDM) based architecture for robots to generate point cloud maps with very limited input information.Inspired from the blind humans' natural capability of imagining or generating mental maps, the proposed method can generate maps without visual perception data or depth data. With additional limited super-sparse spatial positioning data, like the extra contact-based positioning information the blind individuals can obtain, the map generation quality can be improved even more.Experiments on public datasets are conducted, and the results indicate that our method can generate reasonable maps solely based on path data, and produce even more refined maps upon incorporating exiguous LiDAR data.Compared to conventional mapping approaches, our novel method significantly mitigates sensor dependency, enabling the robots to imagine and generate elementary maps without heavy onboard sensory devices.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 25 of its 38 references that are in the map. First posted on arXiv 22 Dec 2024.

Builds on

25 of 38 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Fast LiDAR Upsampling using Conditional Diffusion Models8 May
  2. 2024Towards Realistic Scene Generation with LiDAR Diffusion Models31 Mar
  3. 2024Scaling Diffusion Models to Real-World 3D LiDAR Scene Completion20 Mar
  4. 2023Pyramid Diffusion for Fine 3D Large Scene Generation20 Nov
  5. 2023Diffusion Probabilistic Models for Scene-Scale 3D Categorical Data2 Jan
  6. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  7. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 18

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  7. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
  8. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  9. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  10. 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
  11. 2023DeepCache: Accelerating Diffusion Models for Freecited by 346
  12. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
6 more
  1. 2023Rich Human Feedback for Text-to-Image Generationcited by 139
  2. 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
  3. 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Conditioncited by 89
  4. 2024FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometrycited by 40
  5. 2021Learning 3D Dense Correspondence via Canonical Point Autoencodercited by 21
  6. 2020High-Speed Robot Navigation using Predicted Occupancy Mapscited by 10

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Robust Robotic Exploration and Mapping Using Generative Occupancy Map Synthesis
  2. 2024Joint Localization and Planning using Diffusion
  3. 2025Generative AI in Map-Making: A Technical Exploration and Its Implications for Cartographers
  4. 2024LidarDM: Generative LiDAR Simulation in a Generated World
  5. 2026Plug-and-Play Label Map Diffusion for Universal Goal-Oriented Navigation
  6. 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation
  7. 2024Generation of skill-specific maps from graph world models for robotic systems
  8. 2025SceneScout: Towards AI Agent-driven Access to Street View Imagery for Blind Users