mlsanityData to 14 Oct 2026

Mind2Cloud: EEG-to-Point Cloud Generation with Two-Granularity Diffusion Decoding

arXiv 2609.13991 ↗First posted 12 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reconstructing 3D objects from brain signals offers a promising avenue for understanding human visual cognition. While prior work has shown initial success using EEG signals for 3D reconstruction, existing methods typically employ a uniform diffusion decoder, overlooking the evolving semantic granularity of both EEG representations and the diffusion denoising process. In this paper, we propose Mind2Cloud, a novel EEG-to-point-cloud generation framework based on two-granularity diffusion decoding. The core of Mind2Cloud is a time-aware decoder that integrates a global Transformer branch and a local Point-Voxel CNN (PVCNN) branch across diffusion timesteps through a learnable fusion mask. Specifically, Transformer layers are incorporated into the early upsampling stages to capture global object structure under high uncertainty, while PVCNN modules are used in later stages to refine local geometric details. Inspired by the hierarchical nature of EEG-based visual representations, this design dynamically adapts its spatial granularity in accordance with the coarse-to-fine trajectory of diffusion denoising. We further introduce an adversarial refinement module to enhance geometric realism and semantic consistency. Extensive experiments on the EEG-3D dataset across all 12 subjects demonstrate that Mind2Cloud outperforms prior work in both geometric accuracy and semantic alignment, setting a new benchmark for EEG-to-point-cloud generation. Our source code is available at https://github.com/duasoi/Mind2Cloud.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 53 references that are in the map. First posted on arXiv 12 Sep 2026.

Builds on

45 of 53 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2022Generative Adversarial Networkscited by 5,627
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
33 more
  1. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  2. 2020Point Transformercited by 1,470
  3. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  4. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  5. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  6. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  7. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  8. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  9. 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
  10. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 333
  11. 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorscited by 160
  12. 2022Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decodingcited by 144
  13. 2015Generic decoding of seen and imagined objects using hierarchical visual featurescited by 120
  14. 2022Mind Reader: Reconstructing complex images from brain activitiescited by 85
  15. 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
  16. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  17. 2023Cinematic Mindscapes: High-quality Video Reconstruction from Brain Activitycited by 71
  18. 2019From voxels to pixels and back: Self-supervision in natural-image reconstruction from fMRIcited by 67
  19. 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesiscited by 63
  20. 2022Reconstruction of Perceived Images from fMRI Patterns and Semantic Brain Exploration using Instance-Conditioned GANscited by 55
  21. 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 52
  22. 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Informationcited by 28
  23. 2023Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Viewscited by 25
  24. 2024Neuro-3D: Towards 3D Visual Decoding from EEG Signalscited by 23
  25. 2022A Penny for Your (visual) Thoughts: Self-Supervised Reconstruction of Natural Movies from Brain Activitycited by 20
  26. 2023PGCN: Pyramidal Graph Convolutional Network for EEG Emotion Recognitioncited by 15
  27. 2023Accelerating Text-to-Image Editing via Cache-Enabled Sparse Diffusion Inferencecited by 11
  28. 2023MinD-3D: Reconstruct High-quality 3D objects in Human Braincited by 11
  29. 2024NeuroCine: Decoding Vivid Video Sequences from Human Brain Activtiescited by 10
  30. 2023Dual PatchNormcited by 9
  31. 2023O2-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Modelcited by 8
  32. 2024MinD-3D++: Advancing fMRI-Based 3D Reconstruction with High-Quality Textured Mesh Generation and a Comprehensive Datasetcited by 6
  33. 2016Deep Neural Networks predict Hierarchical Spatio-temporal Cortical Dynamics of Human Visual Object Recognitioncited by 2

Built on by

Not cited yet.