Mind2Cloud: EEG-to-Point Cloud Generation with Two-Granularity Diffusion Decoding
Not on the map. Why?
Abstract (arXiv)
Reconstructing 3D objects from brain signals offers a promising avenue for understanding human visual cognition. While prior work has shown initial success using EEG signals for 3D reconstruction, existing methods typically employ a uniform diffusion decoder, overlooking the evolving semantic granularity of both EEG representations and the diffusion denoising process. In this paper, we propose Mind2Cloud, a novel EEG-to-point-cloud generation framework based on two-granularity diffusion decoding. The core of Mind2Cloud is a time-aware decoder that integrates a global Transformer branch and a local Point-Voxel CNN (PVCNN) branch across diffusion timesteps through a learnable fusion mask. Specifically, Transformer layers are incorporated into the early upsampling stages to capture global object structure under high uncertainty, while PVCNN modules are used in later stages to refine local geometric details. Inspired by the hierarchical nature of EEG-based visual representations, this design dynamically adapts its spatial granularity in accordance with the coarse-to-fine trajectory of diffusion denoising. We further introduce an adversarial refinement module to enhance geometric realism and semantic consistency. Extensive experiments on the EEG-3D dataset across all 12 subjects demonstrate that Mind2Cloud outperforms prior work in both geometric accuracy and semantic alignment, setting a new benchmark for EEG-to-point-cloud generation. Our source code is available at https://github.com/duasoi/Mind2Cloud.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 53 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
45 of 53 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
33 more
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2020Point Transformercited by 1,470
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
- 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 333
- 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorscited by 160
- 2022Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decodingcited by 144
- 2015Generic decoding of seen and imagined objects using hierarchical visual featurescited by 120
- 2022Mind Reader: Reconstructing complex images from brain activitiescited by 85
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
- 2023Cinematic Mindscapes: High-quality Video Reconstruction from Brain Activitycited by 71
- 2019From voxels to pixels and back: Self-supervision in natural-image reconstruction from fMRIcited by 67
- 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesiscited by 63
- 2022Reconstruction of Perceived Images from fMRI Patterns and Semantic Brain Exploration using Instance-Conditioned GANscited by 55
- 2024EEGFormer: Towards Transferable and Interpretable Large-Scale EEG Foundation Modelcited by 52
- 2024CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Informationcited by 28
- 2023Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Viewscited by 25
- 2024Neuro-3D: Towards 3D Visual Decoding from EEG Signalscited by 23
- 2022A Penny for Your (visual) Thoughts: Self-Supervised Reconstruction of Natural Movies from Brain Activitycited by 20
- 2023PGCN: Pyramidal Graph Convolutional Network for EEG Emotion Recognitioncited by 15
- 2023Accelerating Text-to-Image Editing via Cache-Enabled Sparse Diffusion Inferencecited by 11
- 2023MinD-3D: Reconstruct High-quality 3D objects in Human Braincited by 11
- 2024NeuroCine: Decoding Vivid Video Sequences from Human Brain Activtiescited by 10
- 2023Dual PatchNormcited by 9
- 2023O2-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Modelcited by 8
- 2024MinD-3D++: Advancing fMRI-Based 3D Reconstruction with High-Quality Textured Mesh Generation and a Comprehensive Datasetcited by 6
- 2016Deep Neural Networks predict Hierarchical Spatio-temporal Cortical Dynamics of Human Visual Object Recognitioncited by 2
Built on by
Not cited yet.